An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity.
Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support.
With a focus on driving market success and maximizing value for portfolio companies, they are seeking a skilled Senior Data Engineer to contribute to their data-driven strategies and drive innovation forward.
This role presents an exciting opportunity to collaborate with visionary entrepreneurs and make a significant impact in the world of investment.
As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data.
Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to identify and resolve data quality and performance issues, and collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and translate them into technical specification.
Additionally, you will collaborate with software and data engineers to help build a highly valuable software product and work closely with ML Engineers to deploy, monitor, and maintain ML models in production environments.
Your leadership will be instrumental in integrating ML workflows with CI / CD pipelines, ensuring consistent and seamless model versioning, testing, and rollout.
Required Skills & Experience :
- 5+ years of professional data experience
- Proficiency in Python
- Experience Dockerizing containers and working with Kubernetes
- Experience with Prefect or Airflow
- Data warehousing experience, preferably with BigQuery, Snowflake or Postgres
- B.S. in Computer Science or related field
Desired Skills & Experience :
Cloud experience, preferably with GCP
Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.
LI-GF1
Lead Data Engineer (Python/Docker/k8s)
As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data. Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to i...
Lead Software Engineer, Full Stack (Python, AWS)
Lead Software Engineer, Full Stack (Python, AWS). Utilize programming languages like JavaScript, Java, HTML/CSS, TypeScript, SQL, Python, and Go, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. New York...
Lead Software Engineer, Back End (Java, AWS, Python)
Center 1 (19052), United States of America, McLean, VirginiaLead Software Engineer, Back End (Java, AWS, Python). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a ...
Lead Electrical Engineer (Mission Critical/Data Center)
Candidate will have previous experience as a lead project electrical engineer capable of directing the project team. Bachelor’s degree in Electrical Engineering or Architectural Engineering with electrical building systems emphasis. W Mission Critical Engineering. Apply deep knowledge of engineering...
Lead Data Engineer, Card Tech
West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Data Engineer, Card Tech. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a majo...
Python Developer - Data Engineer
Our Data Intelligence team is seeking a Software/Data Engineer to help build out our platform that empowers our product and data engineering teams to deliver timely and accurate data. This data acquired is utilized by various business units allowing them to make the best decisions for our bottom lin...
Lead Machine Learning Engineer (Python, Spark, MLOPS, AWS)
West 19th Street (22008), United States of America, New York, New YorkLead Machine Learning Engineer (Python, Spark, MLOPS, AWS). The MLE role overlaps with many disciplines, such as Ops, Modeling, and Data Engineering. New York City (Hybrid On-Site): $201,400 - $229,900 for Lead Machine Learning En...
Lead Data Engineer, Card Tech
We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Op...
Senior Data Engineer (Idiomatic Python / Pydantic)
We are seeking a Senior Data Engineer with a strong command of Idiomatic Python and Pydantic to join our dynamic team in the healthcare industry. You will be working on optimizing our data architecture to support our data scientists and analysts, who will leverage the data for business insights, pre...
Data Engineer, Python & ETL
A proprietary trading firm is seeking a Data Engineer, Python & ETL to join its Data Infrastructure team, to help improve and extend the data platform. Keywords: Chicago IL Jobs, Data Engineer, Python, Linux, MS SQL Server, SQL Query Writing, Stored Procedures, Data Models, ETL, Programmer Analyst, ...