Talent.com
Lead Data Engineer

Lead Data Engineer

MedStar HealthColumbus, OH, US
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Posting Type

Hybrid

Job Overview

Join our team as we innovate the future of data platform architecture, enabling massive scaling and data processing for ML and Gen AI projects. You'll be at the forefront of processing vast unstructured data, building high-throughput APIs, and supporting distributed compute frameworks for seamless model deployment. Ready to dive into the heart of cutting-edge tech?

Job Description and Requirements

Your role in action

  • Assist in building our next-generation data platform tooling and services to support the ingestion and processing of large volumes of documents at scale. Contribute to improving and extending our Spark-based distributed data processing pipeline.
  • Help enhance our Rust-based distributed query engine used to request large amounts of document data.
  • Create tools to automate and optimize processes across disciplines.
  • Participate in the on-call schedule to investigate and fix production issues related to our data processing pipeline or query engine.
  • Participate in code reviews for projects written by your team.
  • Focus on quality through comprehensive unit and integration testing.

Your Skills

  • 6+ years of software development experience in writing performant, commercial-grade systems and applications
  • Experience with monitoring and troubleshooting production environments
  • Proficiency in programming languages used in high volume data processing and applications like Java, Scala, and Python
  • Experience building data pipelines with distributed compute frameworks like Hadoop, Spark, or Dask
  • Knowledge of Linux / Unix systems, Docker / Kubernetes, and CI / CD including scripting in Python or other scripting languages to automate build and deployment processes
  • Knowledge of professional software engineering practices & software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Leverages best practices and past experiences to mentor and improve the productivity of the team
  • We'd particularly love it if you have :

  • Deep experience building and debugging distributed data pipelines
  • Experience with columnar databases and storage formats like Delta Lake and Parquet
  • Experience deploying and managing services on Kubernetes
  • Experience building with Rust
  • Relativity is committed to competitive, fair, and equitable compensation practices.

    This position is eligible for total compensation which includes a competitive base salary, an annual performance bonus, and long-term incentives.

    The expected salary range for this role is between $150,000 and $224,000

    The final offered salary will be based on several factors, including but not limited to the candidate's experience, skill set, qualifications, and internal pay equity. Hiring at the top end of the range would be uncommon to allow for future salary growth.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Lead Data Engineer • Columbus, OH, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    RelativityColumbus, OH, United States
    serp_jobs.job_card.full_time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Center Chief Engineer, DCEO

    Data Center Chief Engineer, DCEO

    AmazonNew Albany, OH, US
    serp_jobs.job_card.full_time
    Amazon Web Services Infrastructure Services.How would you like to be a part of Earth's most customer-centric company? You would work with teams of front-line responders who support the operations o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote Financial Analyst - AI Trainer

    Remote Financial Analyst - AI Trainer

    Data AnnotationLancaster, Ohio
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Systems Senior Engineer

    Systems Senior Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Senior Data Engineer

    Senior Data Engineer

    Cardinal HealthUSA, Ohio, Dublin
    serp_jobs.job_card.full_time
    What Data Engineering contributes to Cardinal Health.The Data & Analytics Function oversees the analytics life-cycle in order to identify, analyze and present relevant insights that drive business ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Data Engineer

    Senior Data Engineer

    OpenkyberOH, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    RESPONSIBILITIES : Kforce's client in Baltimore, MD is seeking an experienced Azure Data Engineer with solid Databricks experience to join their team on a long term contract.Gen AI ex...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Remote Finance Director - AI Trainer

    Remote Finance Director - AI Trainer

    Data AnnotationLancaster, Ohio
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Sr Associate Data Engineer

    Sr Associate Data Engineer

    RXC RxC Acquisition CompanyColumbus, OH, United States
    serp_jobs.job_card.full_time +1
    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data & Analytics Architect / Engineer (Columbus)

    Data & Analytics Architect / Engineer (Columbus)

    Martineau Recruiting TechnologyColumbus, Ohio Metropolitan Area, US
    serp_jobs.job_card.part_time
    Our client is a leader in the Mechanical Construction + Construction Services industry, bringing talented Mechanical, Electric and Plumbing resources to large-scale construction projects (i.They're...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Career Mentors, LLCColumbus, OH, US
    serp_jobs.job_card.full_time
    Columbus, OH (Onsite – 5 Days a Week).W2 Only (Local Candidates Preferred).PAM (Privileged Access Management).Privileged Access Management (PAM) group in Columbus, OH. This role requires a highly mo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    AndHealthColumbus, OH, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Engineer Full Time - Exempt Onsite, Columbus, OH AndHealth is on a mission to radically improve access and outcomes for the most challenging chronic health conditions with the goal of m...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Mechanical Design Principal Engineer

    Mechanical Design Principal Engineer

    American Honda Motor Co., Inc.Raymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Mechanical Design Engineer

    Senior Mechanical Design Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    New Model Engineer

    New Model Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Mechanical Design Senior Principal Engineer

    Mechanical Design Senior Principal Engineer

    American Honda Motor Co., Inc.Raymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Remote Financial Planner - AI Trainer

    Remote Financial Planner - AI Trainer

    Data AnnotationLancaster, Ohio
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data & Analytics Architect / Engineer

    Data & Analytics Architect / Engineer

    Martineau Recruiting TechnologyColumbus, OH, US
    serp_jobs.job_card.full_time
    Our client is a leader in the Mechanical Construction + Construction Services industry, bringing talented Mechanical, Electric and Plumbing resources to large-scale construction projects (i.They...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Development Research Principal Engineer

    Development Research Principal Engineer

    Honda Dev. and Mfg. of Am.,LLCRaymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Remote Senior Financial Analyst - AI Trainer

    Remote Senior Financial Analyst - AI Trainer

    Data AnnotationLancaster, Ohio
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time +1
    We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    ReaDublin, OH, US
    serp_jobs.job_card.full_time
    F;tax, accounting, and business consulting.F; We have a ‘People First’ culture and we focus on our employees’ well-being and professional development. With over 400 professionals a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days