An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity.
Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support.
With a focus on driving market success and maximizing value for portfolio companies, they are seeking a skilled Senior Data Engineer to contribute to their data-driven strategies and drive innovation forward.
This role presents an exciting opportunity to collaborate with visionary entrepreneurs and make a significant impact in the world of investment.
As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data.
Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to identify and resolve data quality and performance issues, and collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and translate them into technical specification.
Additionally, you will collaborate with software and data engineers to help build a highly valuable software product and work closely with ML Engineers to deploy, monitor, and maintain ML models in production environments.
Your leadership will be instrumental in integrating ML workflows with CI / CD pipelines, ensuring consistent and seamless model versioning, testing, and rollout.
Required Skills & Experience :
- 5+ years of professional data experience
- Proficiency in Python
- Experience Dockerizing containers and working with Kubernetes
- Experience with Prefect or Airflow
- Data warehousing experience, preferably with BigQuery, Snowflake or Postgres
- in Computer Science or related field
Desired Skills & Experience :
Cloud experience, preferably with GCP
Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.
LI-GF1
Python and Kubernetes Software Engineer - Data, AI/ML & Analytics
Python and Kubernetes Specialist Engineers focused on Data, AI/ML and Analytics Solutions. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers include the world's leading public clo...
Lead Software Engineer, Back End (Go, Python, Java, AWS)
Lead Software Engineer, Back End (Go, Python, Java, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. We are seeking Back E...
Software Engineer - Python and K8s
This role is ideal for software engineers who enjoy Python, have a passion for distributed systems, and an interest in the entire Linux stack - from kernel to networking to virtualization and containers. Our mission is to reinvent the way companies manage their open source information systems - on p...
Python Data Engineer
Python Data EngineerWe are a global financial institution with offices in Chicago, NYC, and more in the United States. We are currently expanding our trading teams and need experienced data engineers/analysts to work hand-in-hand with numerous business heads / portfolio managers. You will design dat...
Lead Data Engineer (Python/Snowflake) - P3460
As part of the Clean Room engineering team, you will work with transaction, audience, and exposure data to measure and report on campaign effectiveness while ensuring that our data and 3 rd party data is treated with the highest standards of privacy compliance. As a Lead Data Engineer, you will have...
Lead Backend Python Software Engineer
This prominent educational technology company is seeking a Lead level Backend Python engineer to join their Chicago team. Develop and lead other engineers. They are looking for a strong engineer to join their team. ...
Lead Data Engineer
They also develop their data engineering standards by designing, building, automating, testing and monitoring data pipelines and establish enterprise-scale data integration procedures across the development life cycle, ensuring that engineering teams adhere to them, and that data services work effec...
Lead, Software Full Stack Engineer - Data Protection
Creating, querying & manipulating databases, APIs and integration, Front-end code (HTML/CSS, bootstrap, React JS, Angular JS) and web stack back-end technologies (PHP, Python, Java, ruby on rails etc. With more than 130 years of financial experience and over 22,000 partners, we serve the world’s mos...
Lead Azure Data Engineer
This specialty insurance company is seeking a highly skilled and experienced Lead Data Engineer to join our dynamic team. The Lead will ensure that our data engineering practices are aligned with the latest technologies and industry best practices, focusing on performance, reliability, and efficienc...
Senior Lead Software Engineer - Pricing Reference Data
As a Senior Lead Software Engineer at JPMorgan Chase within the Corporate Technology's Reference Data Engineering division, your role is crucial to an agile team dedicated to improving, developing, and delivering top-tier technology products in a secure, stable, and scalable manner. Influences peers...