Talent.com
Data Engineer 1 / 2 / 3 or Sr

Data Engineer 1 / 2 / 3 or Sr

Berkshire Hathaway EnergyUrbandale, IA, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

This is a multi-level posting. Candidates may be considered for any of the posted levels 14 / 15 / 16 / 17, depending on their level of experience and depth of expertise.

As a Data Engineer, you will design, build, and maintain scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with cross-functional teams to ensure data is accessible, reliable, and secure across the organization.

Responsibilities

Primary Job Duties and Responsibilities (Essential Job Functions)

Design and Develop Scalable Data Pipelines

  • Design and implement scalable data ingestion and transformation frameworks using Azure services enabling structured, semi-structured, and unstructured data to be efficiently processed and integrated into enterprise data platforms
  • Build and maintain robust ETL / ELT pipelines using Azure Data Factory and Azure Databricks.
  • Integrate data from diverse sources including on-premises systems, cloud storage, APIs, and streaming platforms.

Databricks Development and Optimization

  • Develop and optimize notebooks and workflows in Azure Databricks using PySpark, SQL.
  • Implement Delta Lake for efficient data storage, versioning, and ACID transactions.
  • Leverage Databricks features such as Unity Catalog and job orchestration.
  • Data Modeling and Architecture

  • Design and implement data models (star / snowflake schemas) for analytics and reporting.
  • Collaborate with architects to define data lakehouse architecture and best practices.
  • Hands-on experience implementing and optimizing data solutions using the Medallion Architecture (Bronze, Silver, Gold layers) for scalable and structured data processing
  • Data Quality and Governance

  • Implement data validation, profiling, and cleansing routines.
  • Ensure compliance with data governance policies, including data lineage and metadata management.
  • Performance Tuning and Monitoring

  • Monitor and optimize performance of Spark jobs and data pipelines.
  • Troubleshoot and resolve issues related to data latency, job failures, and resource utilization.
  • Collaboration and Stakeholder Engagement

  • Work closely with data scientists, analysts, and business units to understand data requirements.
  • Translate business needs into technical solutions that are scalable and maintainable.
  • Security and Compliance

  • Implement role-based access control (RBAC), encryption, and secure data handling practices.
  • Ensure compliance with industry regulations (e.g., NERC CIP, GDPR, HIPAA if applicable).
  • Documentation and Best Practices

  • Maintain clear documentation of data flows, architecture, and operational procedures.
  • Promote best practices in code versioning, testing, and CI / CD for data engineering.
  • Qualifications

    Bachelor's degree in information systems, computer science or related technical field or equivalent work experience. (Typically four years of additional related, progressive work experience would be needed for candidates applying for this position who do not possess a bachelor's degree.)

    A minimum of two years additional direct related technical experience in IT operations or data engineering experience with foundational knowledge of database structures, principles, and practices. is required for the level 1.

    A minimum of three or more years additional direct related technical experience in data engineering, data integration, or database administration, with hands-on experience in Azure data services and pipeline development is required for the level 2 and 3.

    Six or more years of experience with advanced knowledge of data architecture, cloud platforms (especially Azure), and enterprise data solutions is required for the sr level.

    Proficiency in data engineering tools and platforms, especially Azure Data Factory and Azure Databricks.

    Strong understanding of data modeling, ETL / ELT processes, and performance tuning of enterprise-level applications.

    Expert-level knowledge of data-related technologies from architecture to administration, including design, development, optimization, and licensing.

    Proven experience working in the utility industry is required

    Effective oral and written communication skills, with the ability to collaborate across teams and mentor junior engineers.

    Strong analytical and problem-solving abilities.

    Ability to prioritize and manage multiple tasks and projects concurrently.

    Employees must be able to perform the essential functions of the position, with or without an accommodation.

    All qualified applicants will receive consideration for employment without regard to race, color, religion or religious creed, age, national origin, ancestry, citizenship status (except as required by law), gender (including gender identity and expression), sex (including pregnancy), sexual orientation, genetic information, physical or mental disability, veteran or military status, familial or parental status, marital status or any other category protected by applicable local, state or U.S. federal law.

    About Us

    MidAmerican Energy Company, a Midwest utility, provides regulated electric and natural gas service to more than 1.6 million customers in Illinois, Iowa, Nebraska and South Dakota. The company owns and operates a portfolio of power-generating assets, approximately 61% of which is wind generation.

    About the Team

    MidAmerican Energy Company is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or religious creed, age, national origin, ancestry, citizenship status (except as required by law), gender (including gender identity and expression), sex (including pregnancy), sexual orientation, genetic information, physical or mental disability, veteran or military status, familial or parental status, marital status or any other category protected by applicable local, state or U.S. federal law. Employees must be able to perform the essential functions of the position, with or without an accommodation.

    serp_jobs.job_alerts.create_a_job

    Sr Data Engineer • Urbandale, IA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer

    Data Engineer

    METADes Moines, IA, United States
    serp_jobs.job_card.full_time
    Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    GCP Data Engineer - Senior Manager

    GCP Data Engineer - Senior Manager

    PwCDes Moines, IA, United States
    serp_jobs.job_card.full_time
    At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in tra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Regional Clinical Services Director - RN - Iowa

    Regional Clinical Services Director - RN - Iowa

    Good SamaritanCarlisle, IA, United States
    serp_jobs.job_card.full_time +1
    Join our not-for-profit organization that has provided over 100 years of housing and services to seniors with a commitment to quality care and service in a Christian environment.Must reside in Iowa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Restaurant Delivery - Start Earning Quickly

    Restaurant Delivery - Start Earning Quickly

    DoorDashBoone, IA, United States
    serp_jobs.job_card.full_time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Restaurant Delivery - Onboarding / Onboard

    Restaurant Delivery - Onboarding / Onboard

    DoorDashBoone, IA, United States
    serp_jobs.job_card.full_time +1
    DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day. As a Dasher, you’ll stay busy with a variety o...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    AI Data Engineer - Senior Manager

    AI Data Engineer - Senior Manager

    PwCDes Moines, IA, United States
    serp_jobs.job_card.full_time
    At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping clients optimise operational efficiency.These individuals ana...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer - PERM FTE POSITION

    Data Engineer - PERM FTE POSITION

    Robert HalfDes Moines, IA, US
    serp_jobs.job_card.full_time +1
    F31F; DATA ENGINEER – Build Smarter, Drive Impact 🌟 INTERVIEWS THIS WEEK!.Location : Des Moines, IA (On-site Hybrid with flexibility) CANNOT BE 100% REMOTE. Type : Full-Time Direct hire ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Sr Data Engineer

    Sr Data Engineer

    CVS HealthDes Moines, IA, United States
    serp_jobs.job_card.full_time
    At CVS Health, we're building a world of health around every consumer and surrounding ourselves with dedicated colleagues who are passionate about transforming health care.As the nation's leading h...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_hour
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior, Data Engineer

    Senior, Data Engineer

    CarringtonDes Moines, IA, United States
    serp_jobs.job_card.full_time
    Come join our amazing team and work remote from home!.Under direct supervision, responsible for assisting in the efforts to design, develop, and maintain databases and data integration (ETL) system...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer, Analytics

    Data Engineer, Analytics

    METADes Moines, IA, United States
    serp_jobs.job_card.full_time
    Meta), formerly known as Facebook Inc.When Facebook launched in 2004, it changed the way people connect.Apps and services like Messenger, Instagram, and WhatsApp further empowered billions around t...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer

    Data Engineer

    Zoom CorporationDes Moines, IA, United States
    serp_jobs.job_card.full_time
    What you can expectThis role will be part of the Finance team and will be collaborating closely with other data analysts, data scientists and data engineers. The Finance team works cross functionall...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Diesel Fleet Tech - Earn Up to $32 / Hour - $5,000 Sign-On + Benefits

    Diesel Fleet Tech - Earn Up to $32 / Hour - $5,000 Sign-On + Benefits

    SyscoPerry, IA, US
    serp_jobs.job_card.full_time
    Sysco is Now Hiring Diesel Fleet Technicians in Ankeny, IA!.Earn $26 - $32 per Hour • Plus a $600 Annual Boot & Tool Allowance. Up To $5,000 Sign-On Bonus for New Hires.We offer our colleagues th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Sr Data Engineer (MFT - IBM Sterling)

    Sr Data Engineer (MFT - IBM Sterling)

    The Hertz CorporationDes Moines, IA, United States
    serp_jobs.job_card.full_time
    The IBM Sterling Senior MFT Engineer will have expertise in Sterling B2B Integrator, Sterling File Gateway, Sterling Secure Proxy, Control Center and Connect Direct. This position requires an expert...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Engineer

    Senior Data Engineer

    SHI GmbHDes Moines, IA, United States
    serp_jobs.job_card.full_time
    Since 1989, SHI International Corp.We've grown every year since, and today we're proud to be a $15 billion global provider of IT solutions and services. Over 17,000 organizations worldwide rely on S...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Stelter CompanyDes Moines, IA, United States
    serp_jobs.job_card.full_time
    The Data Engineer turns data into information, insight and business decisions by designing, building and maintaining data integrations, visualizations and dashboards that support Stelter's marketin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Quick Earnings : Earn At Least $1175 For Your First 104 Trips, Guaranteed.

    Quick Earnings : Earn At Least $1175 For Your First 104 Trips, Guaranteed.

    UberZearing, IA, United States
    serp_jobs.job_card.full_time +1
    Earn at least $1175 driving with Uber when you complete your first 104 trips in 30 days.Driving is an easy way to boost your income while maintaining the flexibility your schedule requires (gig, pa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Databricks Data Engineer - Senior - Consulting - Location Open

    Databricks Data Engineer - Senior - Consulting - Location Open

    EYDes Moines, IA, United States
    serp_jobs.job_card.full_time
    At EY, we're all in to shape your future with confidence.We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Sr. Software Engineer, Data Integration Engineering

    Sr. Software Engineer, Data Integration Engineering

    EvolentDes Moines, IA, United States
    serp_jobs.job_card.full_time
    Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. Working across specialties and primary care, we seek to connect...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours