Join to apply for the Sr. Lead Data Engineer role at Select Minds LLC
Location : Lansing, MI (Hybrid)
Duration : 1+ Year (Possible Extension)
Eligibility : Locals to Mid-Michigan Only
Interview : Onsite
We are seeking a Lead Data Engineer to lead the development, optimization, and maintenance of high-performance data solutions. This role is crucial in ensuring the stability, scalability, and integrity of mission-critical applications. You will oversee data pipeline development, automation, cloud integrations, and security compliance, all while mentoring and guiding a team of developers.
Key Responsibilities
- Lead the design, development, and optimization of scalable AWS-based data solutions.
- Develop and enhance ETL processes and data pipelines for efficient data flow.
- Implement and manage ElasticSearch for advanced data retrieval and analytics.
- Write and maintain clean, efficient Python / Scala code for data processing.
- Ensure data integrity, automation, and compliance with security best practices.
- Provide technical leadership and mentorship to other developers.
- Oversee database modeling and stored procedure development.
- Manage Git version control and contribute to CI / CD pipeline development using Azure DevOps (nice to have).
- Work within an Agile development framework, implementing Test-Driven Development (TDD) best practices.
Required Skills & Experience
12+ years in complex database system development.8+ years with Databricks, ElasticSearch, Kibana.8+ years of experience in Python / Scala programming.8+ years working with Oracle databases.5+ years in AWS Cloud-based Application Development.5+ years in ETL process and data pipeline development.5+ years working with data warehousing, data visualization, and data integrity.5+ years experience with CMM / CMMI Level 3 methodologies.5+ years in Agile methodologies, including TDD.3+ years of experience or knowledge in CI / CD pipeline development using Azure DevOps (nice to have).Seniority level
Mid-Senior levelEmployment type
Full-timeJob function
Engineering and Information TechnologyIndustries
IT Services and IT ConsultingJ-18808-Ljbffr