Talent.com
Data Engineer

Data Engineer

QodePittsburgh, PA, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

Job Summary :

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities :

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications :

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI / CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.
  • Preferred Qualifications :

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • Pittsburgh, PA, US

    Job_description.internal_linking.related_jobs
    Data Engineer

    Data Engineer

    Two95 International Inc.Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Type : 6 months (contract to hire).Big Data technology stacks (Apache Nifi, Spark, Kafka, HBase, Hadoop / HDFS, Hive, Drill, Pig, etc. Big Data technology stacks (Hortonworks, Cloudera, etc.Agile...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Data Engineer - IDELIC

    Data Engineer - IDELIC

    Innovation Works, Inc.Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    ABOUT IDELIC Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr Data Engineer

    Sr Data Engineer

    Techstra SolutionsPittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    The main function of a data engineer is to develop and implement data solutions for data platforms.Coordinate the collection, normalization and analysis of datasets across multiple data platforms.A...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Manager, Data Engineering - Intl India (Pittsburgh)

    Manager, Data Engineering - Intl India (Pittsburgh)

    Insight GlobalPittsburgh, PA, United States
    serp_jobs.job_card.full_time
    We are seeking a dynamic and experienced Lead Data Engineer to mentor and guide a team of data engineers working on cloud-based technology products and initiatives. This role involves close collabor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Software Engineer II (Data Services Team) - IDELIC

    Software Engineer II (Data Services Team) - IDELIC

    Innovation Works, Inc.Pittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    ABOUT IDELIC Idelic uses cutting-edge technology and beautifully designed interfaces to help predict and prevent trucking accidents and reduce driver turnover to ensure drivers get home safely each...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Structural Engineer

    Structural Engineer

    JobotCanonsburg, PA, US
    serp_jobs.job_card.full_time
    Structural Engineer needed for global engineering, procurement, and construction (EPC) contractor!.This Jobot Job is hosted by : Jaclyn D'Amore. Are you a fit? Easy Apply now by clicking the &quo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    Data IdeologyPittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services en...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Backend Engineer

    Backend Engineer

    Musing AIPittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Job Summary As a Backend Engineer, you will design and build our cloud-native backend.You will focus on the hands-on implementation of scalable, secure, and intelligent Python-based services...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Lead AI Engineer

    Lead AI Engineer

    Free Market HealthPittsburgh, Pennsylvania, United States, 15222
    serp_jobs.job_card.full_time
    Founded in 2019 and headquartered in Pittsburgh, PA, Free Market Health supports forward-thinking payers and specialty pharmacies of all sizes who need to operate in a complex and opaque market.We ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Data Engineer

    Sr. Data Engineer

    Data IdeologyPittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services en...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Sales Engineer

    Sales Engineer

    DQE CommunicationsPittsburgh, PA, US
    serp_jobs.job_card.full_time
    DQE Communications, headquartered in Pittsburgh, Pennsylvania, is a fiber-optic Internet and data network access provider for businesses and carriers in Pennsylvania, West Virginia, and Ohio.DQE wa...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Cloud Engineer (Azure OR GCP) (Pittsburgh)

    Cloud Engineer (Azure OR GCP) (Pittsburgh)

    VeracityPittsburgh, PA, United States
    serp_jobs.job_card.full_time
    Cloud Engineer (Azure OR GCP) Only fulltime NYC / Pittsburg, PA / Remote.Job Description : Requirements : Bachelor's degree in Computer Science, Engineering, or related field.Cloud Developer or similar...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Travel CT Tech - $3004.62 / Week

    Travel CT Tech - $3004.62 / Week

    Pulse Healthcare ServicesMount Pleasant, PA, US
    serp_jobs.job_card.full_time
    Pulse Healthcare Services is seeking an experienced CT Tech for an exciting Travel Allied job in Mount Pleasant, PA.Shift : 4x10 hr nights Start Date : 10 / 27 / 2025 Duration : 13 weeks Pay : $3004.About ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    AI Engineer

    AI Engineer

    Free Market HealthPittsburgh, Pennsylvania, United States, 15222
    serp_jobs.job_card.full_time
    Founded in 2019 and headquartered in Pittsburgh, PA, Free Market Health supports forward-thinking payers and specialty pharmacies of all sizes who need to operate in a complex and opaque market.We ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Cloud Engineer (Hybrid)

    Senior Cloud Engineer (Hybrid)

    Dollar Bank, FSBPittsburgh, PA, United States
    serp_jobs.job_card.full_time
    Bachelor's degree in computer science, Information Systems, or other related field, or commensurate experience.Cloud platforms like Amazon Web Services, or Microsoft Azure.Scripting via languages l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Data Engineer

    Senior Data Engineer

    Lever Demo - IS OpportunitiesCalifornia, Pennsylvania, United States, 15419
    serp_jobs.job_card.full_time
    PLEASE READ : these jobs are testing jobs of Lever's testing environment - please do not apply for this job.Lever was founded ten years ago to tackle the most strategic challenge that companies face...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Data Engineer (Snowflake)

    Sr. Data Engineer (Snowflake)

    Data IdeologyPittsburgh, PA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Data Ideology At DI, we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services en...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Data Engineer

    Data Engineer

    GoviniPittsburgh, Pennsylvania, United States, 15201
    serp_jobs.job_card.full_time
    Govini transforms Defense Acquisition from an outdated manual process to a software-driven strategic advantage for the United States. Our flagship product, Ark, supports Supply Chain, Science and Te...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Software Engineer Principal (Data Product Domain Lead - Retail) (Pittsburgh)

    Software Engineer Principal (Data Product Domain Lead - Retail) (Pittsburgh)

    PNCPittsburgh, PA, United States
    serp_jobs.job_card.full_time +1
    Software Engineer Principal (Data Product Domain Lead - Retail).At PNC, our people are our greatest differentiator and competitive advantage in the markets we serve. We are all united in delivering ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior Civil Engineer

    Senior Civil Engineer

    JobotCanonsburg, PA, US
    serp_jobs.job_card.permanent
    Senior Civil Engineer needed for global engineering, procurement, and construction (EPC) contractor!.This Jobot Job is hosted by : Jaclyn D'Amore. Are you a fit? Easy Apply now by clicking the &q...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30