GCP Data Engineer - III

The Judge Group
Richardson, TX
Full-time

Our client is currently seeking a GCP Data Engineer - III in Irving, TX (Hybrid) Job description : MUST HAVE SKILLS (Most Important) :

  • 5+ Years Hands on experience on Google Cloud Platform - GCP including BQ, AirFlow, Cloud Storage, and Dataproc
  • Must know Teradata and knowledge of Bigdata Technology
  • 3 years' Experience in Python. UNIX is a must.
  • Working knowledge of database (Teradata) and SQL (Structured Query Language).
  • 5+ Years Hands of experience on Teradata Utilities (Bteq / Mload / Tpump / QG / Fast Export)
  • General operational expertise such as good troubleshooting skills, understanding of system’s capacity, bottlenecks, data anomalies. Good To Have :
  • 3 Years Hands on experience on HIVE / Spark / HSQL / OOZIE
  • Experience in Design and build of the infrastructure for data extraction, preparation, and loading of data from a variety of sources using technology such as Non -SQL and Big data.
  • Experience in Building data and analytics tools that will offer deeper insight into the pipeline, allowing for critical discoveries surrounding key performance indicators and customer activity
  • Experience in Identifying valuable data sources and automate collection processes
  • Experience in Undertaking and preprocessing of structured and unstructured data
  • Experience in Analyzing large amounts of information to discover trends and patterns DESIRED SKILLS : - Ability to drive communications with diverse groups, and deliver change throughout the organization - Ability to go deep on technology trends and architectural questions - Strong critical thinking and written / verbal communication - Strong ability to understand and synthesize data to generate key insights - Ability to drive communications with diverse groups, and deliver change throughout the organization - Ability to go deep on technology trends and architectural questions - Strong critical thinking and written / verbal communication - Strong ability to understand and synthesize data to generate key insights JOB DUTIES :
  • Candidate needs to accomplish end to end build of the pipeline and data harmonization component to enable insight generation for executive and channels to take proactive action on time.
  • Design, develop, and implement software based on requirements.
  • Troubleshoot production issues and coordinate with the support team for code deployment.
  • Collaborate with team members to follow process, procedures, and data security.
  • Knowledge on Jenkins, Jira, Git,DAGs, Airflow etc.
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.

EDUCATION / CERTIFICATIONS : . or equivalent Engineering degree with at least 5 Years of work experience

30+ days ago
Related jobs
Promoted
VirtualVocations
Carrollton, Texas

A company is looking for a QA SDET III-Data (AI+A) to lead testing efforts for their big data infrastructure. ...

Promoted
Diligent Tec, Inc
TX, United States

Develop and manage data pipelines using GCP services such as Dataflow, Dataproc, and Pub/Sub. Job Title: GCP Data Engineer (Only W2). Design, build, and maintain scalable data processing systems on GCP. Create and manage data storage solutions using GCP services such as BigQuery, Cloud Storage, and ...

Promoted
VirtualVocations
Carrollton, Texas

A company is looking for a Data Integration Engineer III. ...

HexaQuEST Global
Irving, Texas

We are seeking a System Security Engineer subject matter expert with a DoD Top Secret Clearance to represent program protection equities in the system engineering technical review (SETR) process. The System Security Engineer (SSE) will provide Technology Protection and engineering assistance to an A...

JPMorgan Chase & Co.
Plano, Texas

Experience in Data Engineering, ETL and Data warehouse technologies. As a Software Engineer III at JPMorgan Chase within the Commercial & Investment Bank, Digital & Platform Service team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products...

Elgebra
Richardson, Texas

Designing and developing robust ETL/ELT pipelines to extract, transform, and load data from various sources into our new product/application. ...

Aditi Consulting
Dallas, Texas

Utilize modern cloud database and storage concepts to for data storage and versioning (Data Lakes with AWS S). Design, build, and maintain data pipelines using modern Big Data technologies such as AWS Redshift, S, Glue, Athena, EMR, Spark, Hive, etc. Plan, design, implement, and manage a deployment ...

JPMorgan Chase & Co.
Plano, Texas

As a Software Engineer III - Lead Tester at JPMorgan Chase within the Consumer and Community Banking team, you serve as a seasoned member of an agile team to design and testing trusted market-leading technology products in a secure, stable, and scalable way. We have an exciting and rewarding opportu...

eTeam
Dallas, Texas
Remote

Work with on-prem data sources (Hadoop, SQL Server), understand the data model, business rules behind the data and build data pipelines (with GCP, Informatica) for one or more business verticals. Develop EL/ELT/ETL pipelines to make data available in BigQuery analytical data store from disparate bat...

JPMorgan Chase & Co.
Plano, Texas

As a Software Engineer III at JPMorgan Chase within the Corporate & Investment Bank under Payments Technology Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. Experience with statistical data...