Design and build production data engineering solutions to deliver our pipeline patterns using Google Cloud Platform (GCP) services: o BigQuery, DataFlow (Apache Beam), Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer (Apache Airflow), Cloud SQL, Compute Engine, Cloud Functions, and App Engin...
Experience with GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, Cloud functions etc. Experience with relational SQL databases -Experience building and optimizing "big data" data pipelines, architectures and data s...
Experience with GCP based Big Data deployments (Batch/Real-Time) leveraging Big Query, Google Cloud Storage, Pub-Sub, Data Fusion, Dataflow, Dataproc, Cloud functions etc. Experience with relational SQL databases -Experience building and optimizing "big data" data pipelines, architectures ...
Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...
ETL Testing, BigData testing and tools. Data Testing in GCP environment with GCP tools. Data verification, table comparison, Strong query skills. ...
Interface with other data engineering, product, and data science teams to implement client needs and initiatives. Utilize strong SQL & Python skills to engineer sound data pipelines and conduct routine and ad hoc analysis to assess the performance of legacy products and the saliency of new features....
The Data Acquisition engineer is responsible for recording the data, validating the data and performing preliminary analysis of the data. The Data Acquisition engineer works closely with the platform engineers, CAE and modeling groups to help define the test and determine the required channels neede...
Collaborates with the Data Factory Engineering Organization, Data Architecture, Information Technology and Data Consumers to drive data engineering capabilities, product design and proof of concepts, MVPs, to expand understanding, define technical optimization, explore configurations and overcome ch...
Software Engineers here work in teams of 6-10 engineers to build scalable, distributed systems for some of the most important data on the planet. Show a strong track record of shipping software in the face of ambiguity Demonstrate experience in owning all aspects of a system lifecycle, from proper d...
MOTOR Information Systems, an owned subsidiary of Hearst, is actively seeking a Data Engineer/Database Architect who possesses talent, passion and expertise to help design and implement highly scalable and available database solutions to support our growing business needs. As a Data Engineer/Databas...
Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products. Work effectively with fellow data engineers, product owners, data champions and other technical experts. Experience in workin...
The Ford Data Factory Platform covers all business processes and technical components involved in ingesting a wide range of enterprise data into the Global Data Insight & Analytics Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics. This ro...
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Heitmeyer is seeking a Data Quality Engineer to support its global banking client on a long-term regulatory and cloud initiative. Must be knowledgeable in data lakes or large data sets. TOSCA Di experience or any data warehousing automation tool. Azure Cloud / Databricks experience. ...
BS Degree in Engineering, Physics, Computer Science, Data Science, or Control Systems. MS Degree in Engineering, Physics, Computer Science, Data Science, or Control Systems. You will use connected data and analytics to continuously monitor the functionality of ADAS features, systems, and components ...
They are seeking multiple Senior Data Engineer to join their growing Data Team!As a Senior Data Engineer, you’ll own a problem from end to end and will be empowered to take the lead with technology and implementation while joining a rare hyper-growth company. Design and build mission-critical data p...
The platform you would be working on covers all business processes and technical components involved in ingesting a wide range of enterprise data into the Global Data Insight & Analytics Data Factory (Data Lake) and the transformation of that data into consumable data sets in support of analytics. T...
This position will be part of the Data Factory Operational Curation & Landing product group using tools like. The product team's objective is to i ngest data from hundreds of sources within the company to the Da. ...
As a Data Engineer, you will design, develop, and maintain data pipelines, data warehouses, and data platforms that support the analytics and business intelligence needs of our clients. Implement data-related business logic on modern data platforms, such as AWS Glue, Databricks, Snowflake, Elastic, ...
Knowledge of data structures/database, cloud platform (Azure). Masters degree in engineering, computer science, or a related technical field; PhD preferred. ...
Lead an engineering team to design, code, and test cloud-based data pipelines to process and store large-scale datasets. Ipsos Global Data Management Tower serves as the backbone of Ipsos’ efforts to harness and integrate the power of data, globally. We’re looking for someone with a deep interest an...
Barton Malow is seeking an experienced Data Engineer with a strong Software Engineering background to join the Data and Automation team. Engage in solving architectural challenges related to data lakes, lake houses, data warehouses, change data capture, messaging systems, event streaming, and the de...
Engage in Test-first Development, Test Driven Development (TDD) • -+ years of experience with: • Object-oriented development languages, such as but not limited to: • Java (Spring Boot) • JavaScript • AngularJS • Karma • Modern databases (Relational and non-relational) SQL Server, Teradata and BigDat...
This role within the 'Data Engineering & Self-Service Products' team involves architecting and engineering analytic data solutions, including designing and developing data marts in Databricks using PySpark or Spark SQL, building interactive Power BI dashboards to visualize KPIs and trends, and creat...
As a Senior Data Engineer on the MMA National IT Data and Analytics Team, we will count on you to develop and maintain scalable data pipelines, enhance data models, and provide subject matter expertise in data acquisition and consumption pipelines on Azure, Databricks and Confluent. In-depth underst...