Senior Data Engineer

A company is looking for a Senior Data Engineer to lead the development of scalable data processing and enrichment pipelines.

Key Responsibilities

Design and implement scalable AI-powered data processing pipelines

Automate manual processes and establish monitoring and CI / CD infrastructure

Provide technical mentorship and conduct code reviews

Required Qualifications

Advanced Python programming and experience with production data processing systems

Proven experience in scaling AI / ML systems using LangChain or similar frameworks

Advanced SQL skills with PostgreSQL and familiarity with vector databases

Experience with Google Cloud Platform or another major cloud platform

Proficiency in containerization using Docker and workflow orchestration tools like Airflow