Data Engineer : Hybrid opportunity
Hybrid opportunity
Location : Dearborn , MI
Fulltime position
Payrate : $65 - $70 p / h
Advantage Technical has partnered with an American multinational automobile manufacturer on a search for a Data Engineer to join their team.
This position will be part of the Data Factory Operational Curation & Landing product group using tools like Attunity, Hive, Hbase, Spark, GCP, etc.
The product team's objective is to ingest data from hundreds of sources within the company to the Data Factory in the cloud environment and perform transformations to make it usable for data scientists in GDI&A.
This position will require an individual who has a strong background with multiple database technologies, who is process oriented and has knowledge of Big Data and GCP environment.
This role is part of a highly dynamic team supporting GDI&A activities.
Skills Required :
- Experience with GCP based Big Data deployments (Batch / Real-Time) leveraging Big Query, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, Cloud functions etc.
- Experience with relational SQL databases -Experience building and optimizing "big data" data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management. -Experience with big data tools : Hadoop, Spark, Kafka, etc.
- Experience supporting and working with cross-functional teams in agile mode.
Skills Preferred :
Proficient in Python and SQL
Experience Required :
10+ years of application development experience
3+ years of GCP experience
4+ years of experience with large-scale solutioning and operationalization of data warehouses and / or data lakes.
Education Required :
Bachelor's degree in Computer Science, Electronics Engineering or a closely related field of study
Hybrid
Data Engineer II
JobPosting","title":"Data Engineer II","datePosted":"2024-04-15T00:00:00","validThrough":null,"description":"Data Engineer II (Multiple Openings), Project Management Institute, Inc. Data Engineer II (Multiple Openings), Project Management Institute, Inc. The position requires a minimum of a Bachelor...
Data Engineer with GCP (Google Cloud Platform) Experience (Only W2 role & strictly no C2C Accepted) 6.26.24
Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services: o BigQuery, DataFlow (Apache Beam), Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer (Apache Airflow), Cloud SQL, Compute Engine, Cloud Functions, and App Engin...
Data Engineer
Experience with GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, Cloud functions etc. Experience with relational SQL databases -Experience building and optimizing "big data" data pipelines, architectures and data s...
Senior Data Engineer
SiriusXM is seeking a highly motivated and experienced Senior Data Engineer to join our Data Org. In this role, you will be responsible for designing and developing data processing pipelines, data warehousing solutions, and real-time data ingestion systems. Build and maintain data infrastructure, in...
Data Engineer
Transform data feeds into reliable and easily updatable data extracts for use in reporting and modeling. Identify data relationships and develop solutions in various data blending tools. Identify and supply proper data sets, write required rules and extract data sets for use by team members and part...
Lead Data Engineer
Lead an engineering team to design, code, and test cloud-based data pipelines to process and store large-scale datasets. Ipsos Global Data Management Tower serves as the backbone of Ipsos’ efforts to harness and integrate the power of data, globally. We’re looking for someone with a deep interest an...
Data Engineer (Integration Development)
MsoNoSpacing"><b>Data Engineer (Integration Development)</b></p> <p class="MsoNoSpacing"><b>Detroit, MI (ONSITE/ ONLY LOCAL)</b></p> <p class="MsoNoSpacing"><b>USC OR GC</b></p> <p class="MsoNoSpaci...
Data Engineer - Digital Operations – Advanced Analytics
As a Data Engineer, the individual will work with a wide variety of data sources including Oracle, Teradata, Greenplum, Hadoop databases to extract information and integrate to help create “key performance indicators” - The KPI’s would serve as a benchmark of the critical program’s success. Identify...
Staff Engineer - Data Security / Governance
Function as a subject matter expert in multiple service areas of data security and operations – Data Loss Prevention (DLP), data minimization, data discovery, cloud data protection, Privileged Access Management (PAM), data privacy, data classification and rights management, key and certificate...
Data Engineer II
Perform moderately complex data analysis and data profiling against source systems and data warehouse. Sound understanding of business intelligence best practices, relational data structures, dimensional data modeling, and data warehouse and reporting techniques. Apply data warehousing best practice...