Position : Sr. Data Engineer
Location : Chicago, IL. (Hybrid)
Duration : + Months Contract
Summary :
We are seeking an experienced data engineer to contribute to a high data volume Electronic Medical Records (EMR) application.
This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (Client) and Master Data applications.
In the future, there's a plan to migrate the existing EMR application to AWS Glue.
The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications.
Exposure to various design patterns within the data engineering paradigm is crucial for success in this role.
Our development process adheres to an agile methodology, with Program Increment (PI) planning occurring every six weeks, equivalent to three sprints.
If you are a skilled data engineer who thrives in an agile environment and has a solid background in designing and optimizing applications, we invite you to join our dynamic team.
Skill Set :
- AWS Cloud Technologies :
- Strong command of Apache Spark (- years)
- AWS Glue expertise (- years)
PySpark Application Development :
Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications
Proven track record in processing and handling large datasets
Performance Tuning :
Hands-on experience in performance tuning Spark applications
Skills to optimize Spark code for scalability, performance, and maintainability
Microservices Development :
Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (- years)
Code Management :
Strong proficiency in using GitHub for efficient code management and sharing
Nice to have :
Experience in Databricks
Experience in the ,
Sr SQL Data Engineer in Tennessee
A company is looking for a Sr SQL Data Engineer (Modeling/PowerBI) for a remote position based in Nashville, TN. ...
Sr. Data Engineer - Integrations
Sr Data Engineer, Data & Decision Intelligence. Data Engineer will play a key role in delivering fairlife's ambition of building a best-in-class Data and Decision Intelligence (DDI) ecosystem. Design, implement, and operationalize data pipelines to support the data lifecycle for our factory IIoT dat...
Sr Data Engineer
Key Responsibilities:Design, build, and maintain data pipelines for processing dataDevelop and maintain data strategy for the companyProvide technical leadership in data systems developmentRequired Qualifications:Bachelor's degree in Computer Science, MIS, Engineering, or related field6-8 years of d...
Sr. Data Operations Engineer
As a Data Operations Engineer you will be, for the Beyond Finance data ecosystem, a firefighter, an architect, an analyst, and a detective. You will support the Data Engineering and Business Intelligence teams, and interact with and support the data needs of nearly every segment of the company. You’...
Sr Software Engineer - Real-Time Data
Software Development Engineer in Real-Time and Big Data. Key Responsibilities:Work with a team to design, build, and maintain software capabilities and enhancementsDevelop Java and Scala components for user experience and geospatial workflowsPrototype, design, and deliver scalable software features ...
Sr Software Test Engineer, Data Analytics
Specifically verify data visualization dashboards for accuracy from a data accuracy perspective. Trace data queries and their results from source (app triggers) to the backend databases. That’s why we’re focused on helping people with diabetes manage their health more effectively and comfortably, wi...
Sr. Software Engineer in Test (Data & Analytics/SQL/ETL) - Paze
Engineering at Early Warning (EWS) is a blend of teams organized around many different platforms, capabilities and products that are brought together to power core capabilities at the biggest banks in America – this includes ubiquitous products like Zelle and Paze. The Senior Software Engineer in Te...
Sr. Data Engineer
As a core member of the Data Engineering department, the Sr Data Engineer will be in a dynamic environment that works cross-functionally with all other departments, such as Engineering, Product, Customer Success, and Marketing. Design, develop, maintain, and streamline scalable data pipelines to sup...
Sr. Data Engineer / Cloud
As a Senior Cloud Data Engineer, you will work on the creation of Enterprise Data Platform. NEW ROLE***SENIOR DATA ENGINEER CLOUD***. Design and develops enterprise data solutions based on architecture and standards leveraging leading architecture practices and advanced data technologies. Implement ...
Sr. Data Engineer-Google Cloud
Preferred experience in building data analytics solutions using Google Cloud Platform services such as Google BigQuery, Cloud Storage, Dataflow, DataProc, Pub/Sub, Cloud Composer, or DataPrep. May lead or sub-lead the design, implementation and automation of data pipelines sourcing data from interna...