Talent.com
Databricks Engineer - Commercial Insurance - Fulltime
Databricks Engineer - Commercial Insurance - FulltimeAcunor Infotech • Columbus, OH, US
Databricks Engineer - Commercial Insurance - Fulltime

Databricks Engineer - Commercial Insurance - Fulltime

Acunor Infotech • Columbus, OH, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

ob Title : Data Engineer (Databricks Azure)

Client : One of our Consulting Clients (Global Analytics & Digital Transformation Firm)

Location : Columbus, OH (Remote / Hybrid)

Duration : Full-Time

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in Databricks and Azure Cloud to join a decision analytics and data engineering team within one of our global consulting clients. The role involves building, optimizing, and maintaining large-scale data pipelines that fuel enterprise analytics, reporting, and AI-driven insights-primarily supporting clients in the insurance and financial services domains

Key Responsibilities

Data Pipeline Development & Optimization

  • Design, build, and enhance ETL / ELT data pipelines using Azure Data Factory Databricks (PySpark, SQL, Python) , and related services.
  • Develop and manage Delta Live Tables Autoloader , and Unity Catalog within the Databricks ecosystem for structured, incremental data processing.
  • Implement data ingestion, transformation, and validation frameworks that ensure high performance, scalability, and reliability.
  • Monitor data pipelines, troubleshoot issues, and ensure optimal system performance and SLA adherence.

Data Modeling & Architecture

  • Collaborate with business analysts and reporting teams to define logical and physical data models supporting analytical and operational needs.
  • Implement data warehousing and lakehouse solutions using Azure Data Lake and Delta Lake
  • Optimize data structures for query performance, cost efficiency, and reusability.
  • Data Quality, Governance & Automation

  • Design and implement robust data quality checks and validation mechanisms to maintain integrity across sources and transformations.
  • Automate repetitive processes using scripts, parameterized pipelines, and reusable frameworks.
  • Conduct periodic audits and compliance checks aligned with governance policies.
  • Contribute to metadata management, documentation, and lineage tracking.
  • Required Skills & Experience

  • 7 12 years of experience in Data Engineering with proven expertise in Databricks and Azure Cloud ecosystems.
  • Strong hands-on experience in PySpark Python , and SQL for data transformation, validation, and performance tuning.
  • Solid understanding of Delta Lake architecture ETL / ELT frameworks , and data warehousing principles.
  • Proficiency with Azure services including Data Factory (ADF) Data Lake (ADLS) , and Databricks Notebooks
  • Experience with Delta Live Tables Unity Catalog , and Autoloader for batch and streaming data processing.
  • Strong background in data modeling performance optimization , and automation scripting
  • Familiarity with Agile methodologies and DevOps-based deployment practices (Git, CI / CD preferred).
  • Strong analytical, communication, and problem-solving skills to collaborate effectively across diverse teams.
  • Preferred : Exposure to insurance, healthcare, or financial services data ecosystems.
  • Nice to Have

  • Experience in data migration projects (on-prem to cloud or multi-cloud).
  • Familiarity with Delta Sharing Databricks SQL Warehouses , or MLflow for advanced use cases.
  • Experience with data cataloging, lineage, or quality frameworks such as Purview Collibra , or Great Expectations
  • Exposure to BI / reporting tools like Power BI or Tableau for end-to-end integration understanding.
  • J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Commercial Insurance • Columbus, OH, US

    Job_description.internal_linking.related_jobs
    Lead Software Engineer - Data Platform

    Lead Software Engineer - Data Platform

    Relativity • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Domain - a foundational component of our platform-into...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer - W2

    Senior Data Engineer - W2

    Talent Portus • OH, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    Job Description - w2 Position Senior Data Engineer serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Cloud Platform Engineer

    Cloud Platform Engineer

    JumpMind, LLC • Columbus, OH, US
    serp_jobs.job_card.full_time
    This is a hands-on engineering role focused on.Kubernetes orchestration, AWS infrastructure automation, and platform enablement. You will work closely with development, DevOps, and SRE teams to crea...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Purple Drive • COLUMBUS, Ohio, USA
    serp_jobs.job_card.full_time
    Data Engineer 5 years' experience with data management, best practices and software development.Experience in Data Warehousing, data integration and data cleansing.Dev...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    AndHealth • Columbus, OH, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Engineer Full Time - Exempt Onsite, Columbus, OH AndHealth is on a mission to radically improve access and outcomes for the most challenging chronic health conditions with the goal of m...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Data Engineer Location : OH (Onsite – 5 Days a Week)

    Career Mentors, LLC • Columbus, OH, US
    serp_jobs.job_card.full_time
    Columbus, OH (Onsite – 5 Days a Week).W2 Only (Local Candidates Preferred).PAM (Privileged Access Management).Privileged Access Management (PAM) group in Columbus, OH. This role requires a highly mo...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sales Engineer

    Sales Engineer

    Manpower • Dublin, OH, US
    serp_jobs.job_card.full_time
    Our client is seeking a Sales Engineer to join their team.The ideal candidate will combine technical understanding of gas purification systems with strong relationship-building skills to drive grow...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    New Model Engineer

    New Model Engineer

    Honda Dev. and Mfg. of Am.,LLC • Raymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Mechanical Development Chief Engineer

    Mechanical Development Chief Engineer

    Honda Dev. and Mfg. of Am.,LLC • Raymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams that w...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    B2B Sales Representative

    B2B Sales Representative

    Rogers Agency • Lancaster, OH, US
    serp_jobs.job_card.full_time
    If you're exploring sales careers, you already know it's the perfect industry to make a difference and get ahead.You can sell just about anywhere. the key is knowing how to spot the right o...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer - Data Platform

    Senior Software Engineer - Data Platform

    Relativity • Columbus, OH, United States
    serp_jobs.job_card.full_time
    Join our team as we reimagine and modernize the core of Relativity's data architecture.You'll play a pivotal role in transforming the Document Data Model (DDM)-a foundational component of our platf...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Protection Engineer

    Data Protection Engineer

    Cardinal Health • USA, Ohio, Dublin
    serp_jobs.job_card.full_time
    What Information Security and Risk contributes to Cardinal Health.Information Technology oversees the effective development, delivery, and operation of computing and information services.This funct...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Sr Databricks Platform Engineer

    Sr Databricks Platform Engineer

    RXC RxC Acquisition Company • Columbus, OH, United States
    serp_jobs.job_card.full_time
    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare.We are known for delivering insights, products, and services that make quality care more accessibl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data & Analytics Architect / Engineer

    Data & Analytics Architect / Engineer

    Martineau Recruiting Technology • Columbus, OH, US
    serp_jobs.job_card.full_time
    Our client is a leader in the Mechanical Construction + Construction Services industry, bringing talented Mechanical, Electric and Plumbing resources to large-scale construction projects (i.They...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Direct Sales Agent Specialist (2877)

    Direct Sales Agent Specialist (2877)

    Direct Auto • London, OH, US
    serp_jobs.job_card.full_time
    National General is a part of The Allstate Corporation, which means we have the same innovative drive that keeps us a step ahead of our customers’ evolving needs. We offer home, auto and accid...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data & Analytics Architect / Engineer (Columbus)

    Data & Analytics Architect / Engineer (Columbus)

    Martineau Recruiting Technology • Columbus, Ohio Metropolitan Area, United States
    serp_jobs.job_card.full_time
    Our client is a leader in the Mechanical Construction + Construction Services industry, bringing talented Mechanical, Electric and Plumbing resources to large-scale construction projects (i.They're...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Cardinal Health • USA, Ohio, Columbus
    serp_jobs.job_card.full_time
    What Data Engineering contributes to Cardinal Health.The Data & Analytics Function oversees the analytics life-cycle in order to identify, analyze and present relevant insights that drive business ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days
    Senior Developer - Data Engineer (Temp-to-Hire)

    Senior Developer - Data Engineer (Temp-to-Hire)

    Blue Star Partners LLC • Columbus, OH, US
    serp_jobs.job_card.full_time
    Senior Developer – Data Engineer.Hybrid in Columbus, Ohio – 2 days onsite, 3 days remote.The Senior Developer – Data Engineer will be responsible for designing and implementing ro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Project Engineer - Data Center MEP Integration - OH

    Project Engineer - Data Center MEP Integration - OH

    TEKsystems • New Albany, OH, United States
    serp_jobs.job_card.temporary
    Pay Rate : Flexible based on prior experience.Must have 7+ years of experience with Data Center development or construction management. Strong background with QA / QC and managing projects in a Data Ce...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Electronic Design Senior Engineer

    Electronic Design Senior Engineer

    American Honda Motor Co., Inc. • Raymond, OH, US
    serp_jobs.job_card.full_time
    What Makes a Honda, is Who makes a Honda.Honda has a clear vision for the future, and it’s a joyful one.We are looking for individuals with the skills, courage, persistence, and dreams t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted