Collibra Data Lineage Automation Engineer

Job Description

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

• Jobseeker Video Testimonials
• Employee Glassdoor Reviews

If you are a Collibra Data Lineage Automation Engineer , looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator / Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning / growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title : Collibra Data Lineage Automation Engineer

Location : Onsite – 5 days / week in McLean, VA

Work Type : 1099 / C2C / W2

Work Authorization : U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra Data Lineage Automation Engineer to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI / ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

Lead the implementation of automated lineage across diverse systems :

Cloud platforms (e.g., Snowflake, AWS )

Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

NoSQL databases (e.g., MongoDB)

BI / reporting tools (e.g., Tableau, Power BI)

Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

Integrate lineage with metadata / governance platforms ( Collibra, Alation ) to ensure usability and traceability.

Apply AI / ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

Develop reusable lineage components and promote automation-first, reusable design principles.

Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

Strong AI / ML background , with experience in :

Metadata intelligence

NLP-based code parsing

Pattern detection in lineage gaps

Programming expertise in Python, Scala, or Java .

Strong SQL skills with hands-on exposure to logs / queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

Hands-on experience with commercial lineage tools (evaluation or implementation).

Background in regulated industries (finance, healthcare, insurance).

Familiarity with event-driven architectures for real-time lineage propagation.

Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

Has successfully delivered automated lineage at enterprise scale .

Operates at the intersection of data engineering, metadata management, and AI innovation .

Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at http : / / alignity.io / careers. Alignity Solutions is an Equal Opportunity Employer, M / F / V / D.

CEO Message : Click Here

Clients Testimonial : Click Here