Talent.com
serp_jobs.error_messages.no_longer_accepting
Data Engineer - Databricks (Public Trust) (Richmond)

Data Engineer - Databricks (Public Trust) (Richmond)

ICFRichmond, VA, US
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.part_time
job_description.job_card.job_description

Senior Databricks Sme

Our Digital Modernization and Experience (DMX) Group is growing, and we are looking for a motivated, experienced Senior Databricks SME who is passionate about turning complex data into actionable solutions that improve public systems and services. This role supports an enterprise initiative focused on platform infrastructure and analytics modernization for a federal customer.

You'll be joining a cross-functional team of full stack developers, data engineers, and data analysts working within a modular, cloud-native platform supporting the emergency management sector. Your work will help ensure disaster management and mitigation decision-makers have access to accurate, timely, and meaningful data and data products to drive effective service delivery and measurable mission outcomes.

If you thrive in a collaborative environment, enjoy working independently to solve real-world challenges through data, we want to hear from you.

Job Location : This position is fully remote with up to 10% travel to the DC Metropolitan area for client meetings. This person must be able to interview in person in Raleigh / Durham, NC, Reston, Virginia; Atlanta, GA.

What You'll Be Doing :

  • Enable secure, scalable, and efficient data exchange between federal client and external data sharing partners using Databricks Delta Sharing.
  • Support the design and development of data pipelines and ETL routines in Azure Cloud environment for many source system types including RDBMS, API, and unstructured data using CDC, incremental, and batch loading techniques.
  • Conduct data profiling, transformation, and quality assurance on structured, semi-structured, and unstructured data.
  • Identify underlying issues and translate them into technical requirements.
  • Assist in building and optimizing data lakes, feature stores, and data warehouse structures to support analytics and machine learning.
  • Prepare, structure, and validate data for data science and MLOps workflows, ensuring it meets the quality and format requirements for modeling.
  • Help monitor and maintain the flow of data across BI dashboards, analytics environments, and machine learning pipelines.
  • Engage directly with clients and stakeholders to understand data needs and translate them into scalable solutions.
  • Collaborate with UX designers, business analysts, developers, and end users to define data and reporting requirements.
  • Work with external data partners to determine their data product needs and work within the databricks platform to enable rapid prototyping and extensible use cases.
  • Meet with government employees at executive levels, platform stakeholders, and vendor partners.
  • Work within Agile teams to support iterative development, backlog grooming, and sprint-based delivery.
  • Provide mentorship to junior resources.

What You Must Have :

  • Bachelor's degree in computer science, Information Systems, Data Analytics, or a related discipline.
  • Minimum 5+ years in data engineering, data security practices, data platforms, and analytics
  • 3+ years Databricks Platform Expertise SME Level Proficiency including :
  • Databricks, Delta Lake, and Delta Sharing
  • Deep experience with distributed computing using Apache Spark
  • Knowledge of Spark runtime internals and optimization
  • Ability to design and deploy performant end-to-end data architectures
  • 4+ years of ETL Pipeline Development building robust, scalable data pipelines
  • Candidate must be able to obtain and maintain a Public Trust
  • Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S.
  • Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years
  • Technologies You'll Use :

  • Databricks on Azure for data engineering and ML pipeline support.
  • SQL, Python, Spark, Tableau.
  • Git, Jira, CI / CD tools (e.g., Jenkins, CodeBuild).
  • Jira, Confluence, SharePoint.
  • Mural, Miro, or other collaboration / whiteboarding tools.
  • What We'd Like You To Have :

  • Databricks certifications - Professional or specialty certifications
  • Hands-on experience with Azure services such as Synapse, Data Factory, or Databricks.
  • Familiarity with data visualization tools such as Tableau, Power BI, or similar.
  • Machine Learning and Analytical Skills including :
  • MLOps - Working knowledge of ML deployment and operations
  • Data Science Methodologies - Statistical analysis, modeling, and interpretation
  • Big Data Technologies - Experience beyond Spark with distributed systems
  • Experience with deployment pipelines, including Git-based version control and CI / CD pipelines and DevOps practices using Terraform for IaC.
  • Emergency management domain knowledge a plus
  • Advanced proficiency in data engineering and analytics using Python, Expert-level SQL skills for data manipulation and analysis and experience with Scala, preferred but not required (Python expertise can substitute)
  • Proven experience breaking down complex ideas into manageable components
  • Demonstrable experience developing rapid POCs and Prototypes
  • History of staying current with evolving data technologies and methodologies
  • Professional Skills :

  • Strong analytical thinking, attention to detail, and willingness to learn new tools and technologies.
  • Consulting experience with ability to work directly with clients, executive level stakeholders and manage conflicts.
  • Why You'll Love Working Here :

  • Generous vacation and retirement plans.
  • Comprehensive health benefits.
  • Flexible work environment.
  • Ongoing training and development opportunities.
  • Inclusive and collaborative culture.
  • Meaningful work that impacts communities.
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Richmond, VA, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Capital OnePetersburg, VA, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Database Architect 4

    Database Architect 4

    QuantaleapRichmond, VA, VA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Database Architect 4 Location : Richmond, VA (Hybrid) Need candidate withi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Enterprise Data Modeler

    Enterprise Data Modeler

    Sunrise SystemsRichmond, Virginia, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Enterprise Data Modeler.Duration : 6 month s contract with possible Extension.Client s Information Technology Division is seeking a senior Data modeler to develop Data models for Data Ass...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Cloud Engineer 4

    Cloud Engineer 4

    QuantaleapNorth Chesterfield, VA, US
    serp_jobs.job_card.full_time
    Role : Cloud Engineer 4 .Location : North Chesterfield, VA (Remote) Need candidate within 2hrs drivable ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineering

    Senior Manager, Data Engineering

    Capital OnePetersburg, VA, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineering.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Director, Data Engineering - Marketing Data Platform

    Director, Data Engineering - Marketing Data Platform

    MediabistroPetersburg, VA, United States
    serp_jobs.job_card.full_time +1
    Director, Data Engineering - Marketing Data Platform.Capital One is seeking a Director of Data Engineering to work in our Marketing and Messaging. Capital One's Marketing and Messaging team within E...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Devops Engineer

    Devops Engineer

    Akaasa TechnologiesRichmond, VA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Hybrid 3 days onsite a week Location : Richmond, VA This contractor does need to report to the office on a Hybrid model and we are...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    GenworthRichmond, VA, US
    serp_jobs.job_card.full_time
    At Genworth, we empower families to navigate the aging journey with confidence.We are compassionate, experienced allies for those navigating care with guidance, products, and services that meet fam...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Capital OnePetersburg, VA, United States
    serp_jobs.job_card.full_time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,. At Capital One, you'll be part of a big group of makers, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineering (People Leader)

    Senior Manager, Data Engineering (People Leader)

    Capital OneRichmond, VA, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineering (People Leader).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer (Enterprise Platform Technology)

    Lead Data Engineer (Enterprise Platform Technology)

    Capital OneRichmond, VA, United States
    serp_jobs.job_card.full_time +1
    Lead Data Engineer (Enterprise Platform Technology).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Ca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer (Python, Scala, AWS)

    Senior Data Engineer (Python, Scala, AWS)

    Capital OneRichmond, VA, United States
    serp_jobs.job_card.full_time +1
    Senior Data Engineer (Python, Scala, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Artificial Intelligence Engineer - Agentic Data Engineer

    Artificial Intelligence Engineer - Agentic Data Engineer

    Cyber ResourceRichmond, VA, Virginia, USA
    serp_jobs.job_card.full_time
    Engagement Type Contract Short Description serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    AWS Data Engineer

    AWS Data Engineer

    Appex InnovationRichmond, VA, us
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    We are hiring for AWS Data Engineer for our client based in Richmond, VA.Skills Required : Python, AWS, PySpark.Location : Richmond, VA, (Onsite). Candidates must be available for in-person interviews...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Director, Data Engineering - Marketing Data Platform Job at Capital One in Richm

    Director, Data Engineering - Marketing Data Platform Job at Capital One in Richm

    MediabistroRichmond, VA, United States
    serp_jobs.job_card.full_time +1
    Director, Data Engineering - Marketing Data Platform.Capital One is seeking a Director of Data Engineering to work in our Marketing and Messaging. Capital One's Marketing and Messaging team within E...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Analyst

    Data Analyst

    Two95 International Inc.Glen Allen, VA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Develops, tests and maintains code using software development methodology and appropriate technologies for the system being used. Works closely with Business Analysts to develop detail systems desig...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Principal Data Engineer- Data Governance / Data Quality

    Principal Data Engineer- Data Governance / Data Quality

    CarMaxRichmond, VA, US
    serp_jobs.job_card.full_time
    Broad Street, Richmond, Virginia, 23220.CarMax, the way your career should be! .At CarMax, we are industry disruptors with an unrivaled amount of automotive consumer data.Working on many different ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer (AWS, Python, PYspark)

    Data Engineer (AWS, Python, PYspark)

    Cliff Services IncRichmond, VA, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Title : Data Engineer (AWS, Python, PySpark) Location : Richmond, VA or Dallas, TX (Hybrid) Duration : Long Term Contract Rate : $50 / hr on C2C Interv...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Risk Director-Enterprise Data

    Risk Director-Enterprise Data

    Capital OneRichmond, VA, US
    serp_jobs.job_card.full_time +1
    Enterprise Services Risk professionals are highly motivated with excellent project management and communication skills.They have a high level of exposure across lines of business and operating divi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Applications Engineer - Data Center Power (Electrical) Solutions

    Applications Engineer - Data Center Power (Electrical) Solutions

    Hyper Solutions IncHenrico, VA, United States
    serp_jobs.job_card.full_time
    Imagine joining an industry leader to further your professional career in Power Applications Engineering in the Electrical, Technology and Manufacturing space with expanding multi-million-dollar c...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30