A company is looking for a Data Engineer to enhance their academic research paper processing capabilities.Key ResponsibilitiesBuild and optimize the academic research paper pipeline for high performance and data qualityEnhance data infrastructure by implementing efficient data partitioning and deduplication processesMaintain and improve data quality management processes to ensure accuracy and reliabilityRequired Qualifications5+ years of experience as a data engineer with high data volumesStrong proficiency in Python and experience with Spark for data pipeline optimizationProficient in SQL, including aggregation functions and partitioning strategiesExperience with Parquet file formats and cloud-based scalable data solutionsStrong data quality management skills and experience in handling large datasets
Lead Data Engineer, Data Reliability
The Data Reliability Engineering team for Disney’s Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment’s big data platform, which processes hundreds of terabytes of data and billions of events daily. The Lead Data Engineer will help ...
Healthcare Data Engineer
A company is looking for a Healthcare Data Engineer II to join their data engineering team. ...
AWS Data Engineer
Duration: 12 months Position type: W2 contract Key skills Needed: AWS (the dataset from the Cloud Engineer and Snowflake data lake), Snowflake, SQL, Python and PowerBI will enable you to excel in this role. Hands on Data Engineer that is really good with PowerBI and have experience working with A...
Data Engineer People Analytics
A company is looking for a Data Engineer, People Analytics for a 6-month contract. ...
Data Engineer II - Artificial Intelligence
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Azure Data Engineer
A company is looking for an Azure Data Engineer with expertise in Azure Databricks and PySpark. ...
Data Engineer - II (Data Modeler)
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
ML Data Science Engineer
We are looking for a ML / Data Science Engineer to join our growing team. Bachelor’s degree in Computer Information Systems, Computer Science, Engineering, Technology, Mathematics, Statistics or related field, or suitable combination of education, experience and training. Software Development or Com...
Data Engineer I (SQL, Analysis) - Bond & Specialty Insurance
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and trans...
Senior Support Data Engineer ( DataStage)
Secondary:Oracle Database, Teradata, MS SQL Server, DB2, IBM MQ ,Databricks, Python,Cloud Watch, Apache Airflow, AWS, SPLUNK, Dynatrace,. ...