Lead Data Engineer
Location : Hybrid in Madison, WI
Schedule : Tues, Wed, Thurs onsite; Mon & Fri Remote
Duration : 6 month Contract with Possible Extension
What you will do :
- Guide and mentor engineering team(s) in all aspects of our SDLC
- Develop and maintain software to support a streaming data platform that powers an industry-leading healthcare CRM product
- Contribute towards software projects that use programming languages including Python, Scala, NodeJS, and SQL
- Work with a variety of data stores including traditional relational databases, NoSQL databases, and real-time messaging queue systems like Kafka
- Use SQL to analyze healthcare and marketing data sets
- Refactor and optimize our existing code base to improve efficiency and performance
- Respond to ad-hoc questions and assist our technical support team as necessary
- Ensure that our data pipelines are performant and scalable
- Ensure that our consumption layers and platform APIs meet the needs of end users
- Work collaboratively within a small team to design and implement creative solutions to our business needs
- Plan, refine, perform, and review work according to agile software development methodologies
What you will bring :
- Previous experience in a lead or management role with direct reports
- Solid understanding of software engineering concepts, including programming methodologies and the software development lifecycle
- 9+ years of experience writing SQL queries to analyze and report on data
- 9+ years of experience writing Native Python code
- Experience with additional scripting languages is preferred
- Experience with CI / CD pipelines including the use of git and Jenkins
- Experience with Docker, Kubernetes, and cloud-based services from providers such as Amazon Web Services
- Experience with TDD, automated testing, or writing tests to prove your code does what it’s supposed to
- Understanding of enterprise scalability needs
- Ability to set priorities and manage time effectively to complete tasks and meet deadlines
- Experience coaching and mentoring colleagues on policies, processes, and best practices
- Ability to translate ideas into technical designs and experience leading technical design sessions
Senior Data Engineer
Work with a variety of data stores including traditional relational databases, NoSQL databases, and real-time messaging queue systems like Kafka. Guide and mentor engineering team(s) in all aspects of our SDLC. Develop and maintain software to support a streaming data platform that powers an industr...
Senior Data Engineer
We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open So...
Senior Data and Graph Engineer - Energy Product Incubator
Join us!About the JobWe---re looking for an experienced senior data and graph engineer for our engineering incubator team. As a senior data engineer, you’ll be responsible for building world-class software, leveraging automation whenever possible, mixed with many opportunities to contribute to the d...
Senior Data Engineer - Principal Associate
Senior Data Engineer - Principal Associate. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming la...
Senior Data Engineer - Remote, US
The Senior Data Engineer position will report to the Manager of Data Platforms & Analytics Engineering. Ensures data reliability and quality by ingesting diverse data sources, orchestrating transformations, and maintaining robust infrastructure for optimized analytics pipelines. About You:5+ years o...
Senior Staff Engineer – Finance Data - Remote
Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...
Senior Data Engineer
As a Senior Data Engineer, you'll play a pivotal role in building and operationalizing data pipelines using DBT and Snowflake technologies within our cloud-native data platform. You'll work closely with our business units, data analysts and data scientists to design, develop, and optimize data pipel...
Cloud Data Engineer Senior Consultant
Net, C#, Qlik, Power BI, Machine Learning, Azure Data Factory, RedShift, UiPath, Cloud, RPA, AWS, Redshift, Kinesis, QuickSight, SageMaker, S3, Databricks, AWS Lake Formation, Snowflake, Python, Qlik, Athena, Data Pipeline, Glue, Star Schema, Data Modeling, SQL, SSIS, SSAS, SSRS, PySpark, Microsoft ...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Senior Underwriting Data Analyst
Senior Underwriting Data Analyst. Develop advanced data and reporting solutions utilizing intelligence applications to provide dashboards, data marts, query tools, and ad hoc reporting. Retrieve and manipulate data from multiple data sources using current tools and software, such as SAS EG, SAS VA, ...