An esteemed investment firm based in Chicago is on the lookout for a Lead Data Engineer to join their innovative team in a hybrid capacity.
Specializing in fostering growth for businesses across technology, healthcare, and consumer sectors, this company is renowned for its strategic approach to investment and operational support.
With a focus on driving market success and maximizing value for portfolio companies, they are seeking a skilled Senior Data Engineer to contribute to their data-driven strategies and drive innovation forward.
This role presents an exciting opportunity to collaborate with visionary entrepreneurs and make a significant impact in the world of investment.
As a Lead Data Engineer, you will play a pivotal role in creating, designing, and deploying ETL and ELT flows for consuming data from disparate sources of 3rd party data.
Your responsibilities will also include building tooling to monitor data pipelines, performing troubleshooting and debugging to identify and resolve data quality and performance issues, and collaborating with data scientists, analysts, and other stakeholders to understand their data requirements and translate them into technical specification.
Additionally, you will collaborate with software and data engineers to help build a highly valuable software product and work closely with ML Engineers to deploy, monitor, and maintain ML models in production environments.
Your leadership will be instrumental in integrating ML workflows with CI / CD pipelines, ensuring consistent and seamless model versioning, testing, and rollout.
Required Skills & Experience :
- 5+ years of professional data experience
- Proficiency in Python
- Experience Dockerizing containers and working with Kubernetes
- Experience with Prefect or Airflow
- Data warehousing experience, preferably with BigQuery, Snowflake or Postgres
- in Computer Science or related field
Desired Skills & Experience :
Cloud experience, preferably with GCP
Applicants must be currently authorized to work in the United States on a full-time basis now and in the future.
LI-GF1
Sr. Lead, Cloud Engineer, Data Platforms
Individual will specialize in data platforms, handling the design, implementation, and maintenance of data storage and processing solutions to ensure efficient data flow and accessibility, often collaborating with data engineers and analysts to support data-driven decision-making across an organizat...
Lead Data Engineer
Build curated data models which will be used by data consumers to address business questions today and in the future, ensuring the data model is extensible and flexible. Determine the best practices of what happens with the warehouse, gaining consensus with other engineers and publish data modeling ...
Lead Software Engineer, Back End (Go, Python, Java, AWS)
Lead Software Engineer, Back End (Go, Python, Java, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. We are seeking Back E...
Lead Data Warehouse Engineer
Build curated data models which will be used by data consumers to address business questions today and in the future, ensuring the data model is extensible and flexible. Determine the best practices of what happens with the warehouse, gaining consensus with other engineers and publish data modeling ...
Lead Data Engineer
Lead Data Engineer / Engineering Manager. We're a dynamic marketing startup seeking a versatile and hands-on Lead Data Engineer to drive our data operations forward. As we grow rapidly, you'll wear multiple hats, leading a small but mighty team of engineers while staying deeply involved in technical...
Lead Data Engineer
As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift an...
Lead Software Engineer, Data Platform
The Lead Software Engineer will be at the helm of a small data platform team tasked with expanding the core data delivery APIs that BAM's data analysts, data scientists, quantitative investors, and researchers depend on for exposing and accessing investment data sets. The team sits as part of Core D...
Python Developer - Data Engineer
Our Data Intelligence team is seeking a Software/Data Engineer to help build out our platform that empowers our product and data engineering teams to deliver timely and accurate data. This data acquired is utilized by various business units allowing them to make the best decisions for our bottom lin...
Lead Software Engineer, Back End (Go, Python, Java, AWS)
West Wacker Dr (35012), United States of America, Chicago, IllinoisLead Software Engineer, Back End (Go, Python, Java, AWS). Utilize programming languages like Java, Python, SQL, Node, Go, and Scala, Open Source RDBMS and NoSQL databases, Container Orchestration services including Docker and Kuberne...
Lead Data Engineer (AWS, Azure, GCP)
CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. Experience provid...