Talent.com
Senior Big Data Engineer (Python/PySpark)
Senior Big Data Engineer (Python/PySpark)System One • Strongsville, OH, US
serp_jobs.error_messages.no_longer_accepting
Senior Big Data Engineer (Python / PySpark)

Senior Big Data Engineer (Python / PySpark)

System One • Strongsville, OH, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

Position Title : Senior Big Data Engineer (Python / PySpark)

Locations / Flex : Pittsburgh PA - Two PNC Plaza or Cleveland OH - Strongsville Technology Center. The hiring team is not sourcing outside these hubs at this time. Working arrangement is Hybrid : 3 days in office, 2 remote. Acceptable time zones : EST. Working days : Mon–Fri, 40 hours. Working hours (flexible) : 8 : 00 a.m. – 5 : 00 p.m. EST.

Responsibilities

  • Interact with the business to understand evolving requirements and adapt accordingly.
  • Understand business requirements and tech stack involved; guide the team toward an integral solution approach.
  • Demonstrate dedication and strong communication skills; participate in Agile ceremonies.
  • Hands-on experience with object-oriented programming, including its limitations.
  • Familiarity with cross-platform development.
  • Manage database storage and retrieval on data lake platforms; extensive experience in handling.
  • Extensive Unix / FTP / file handling.
  • Strong hands-on experience with SQL databases.

Must Have Technical Skills

  • Deep understanding of multi-process architecture and the threading limitations of Python.
  • PySpark data engineering skills.
  • Experience using libraries like Pandas, NumPy and MatPlotLib; experience with file-based systems (CSV / Parquet).
  • Extensive knowledge in understanding data and creating data pipelines.
  • Hands-on experience designing and implementing APIs.
  • Hands-on experience building microservices using FastAPI or related technologies.
  • Experience writing unit tests and ensuring code coverage.
  • Experience with Agile methodology / JIRA / Confluence.
  • Experience in version control using Git.
  • Flex Skills / Nice to Have

  • Added advantage if you have worked on Big Data, PySpark libraries.
  • Education / Certifications

    Bachelors Preferred

    Python or Spark certifications are a plus

    Role Differentiator

    Conversion possibility and growth opportunities are strong, with ongoing work and energizing new opportunities. The role supports the bank in a critical area and contributes to overall success.

    Skills

  • Deep understanding of multi-process architecture and Python threading limitations.
  • Experience in version control using Git.
  • Experience with Pandas, NumPy and MatPlotLib; file-based systems (CSV / Parquet).
  • Experience with Agile methodology / JIRA / Confluence.
  • Experience writing unit tests and ensuring code coverage.
  • Understanding data and creating data pipelines.
  • Hands-on experience building microservices using FastAPI or related technologies.
  • PySpark data engineering skills.
  • How to Apply

    Share your resume with Ariz Khan at ariz.khan@systemone.com. Also connect on LinkedIn : Ariz J. Khan.

    Ref : #404-IT Pittsburgh

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Senior Data Engineer • Strongsville, OH, US

    Job_description.internal_linking.related_jobs
    Big Data Lead

    Big Data Lead

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Big Data Lead.Key Responsibilities Oversee and manage data processes using Azure, Databricks, ADF, and Pyspark / Python Understand design and source to target mapping (S...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Software Data Engineer

    Software Data Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Software Data Engineer.Key Responsibilities Build and maintain data platforms for data integration, ensuring data access, security, and governance Source, compile, and...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Machine Learning Engineer to join their Safety In-Vehicle Experience team.Key Responsibilities Design, optimize, and deploy computer vision and multimodal ML mod...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Golang Engineer

    Senior Golang Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Golang Engineer.Key Responsibilities Develop innovative digital products for enterprise clients Work with large data sets and implement code across various data...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Qode • Cleveland, OH, US
    serp_jobs.job_card.full_time
    We are seeking a skilled and motivated.Data Engineer with strong expertise in PySpark, SQL.You will be responsible for designing, building, and maintaining scalable data pipelines and processing sy...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Analytics Engineer

    Data Analytics Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Analytics Engineer to work with operational and customer stakeholders on data acquisition, processing, and analysis. Key Responsibilities Collaborate with data engi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer - Analytics and AI Platforms.Key Responsibilities Build and manage ELT / ETL processes from various data sources into Microsoft Fabric Lakehouse / Warehouse ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Cloud Data Engineer.Key Responsibilities Design and build scalable ETL pipelines in Databricks using PySpark and Spark SQL Migrate legacy ETL processes to cloud...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Analytics Engineer - GTM.Key Responsibilities Design and build core data models to enhance analysis efficiency and provide reliable insights Create intuitive, v...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Python Engineer

    Senior Python Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Python Engineer to join their remote team.Key Responsibilities Architect, develop, and maintain Python-based applications and services Collaborate with cross-fu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior AI Engineer

    Senior AI Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AI Engineer (Python and AI Programming) - Level III.Key Responsibilities : Develop scalable, production-grade AI / ML models using Python and relevant frameworks B...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer to support data initiatives and optimize data delivery architecture.Key Responsibilities Update, analyze, and enhance products through direct inter...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer - Databricks

    Data Engineer - Databricks

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Technical Consultant specializing in Databricks.Key Responsibilities Design, develop, and maintain ETL / ELT pipelines and Databricks notebooks for data ingestion, transf...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer.Key Responsibilities Collaborate with Agile teams to design, develop, test, implement, and support technical solutions Utilize programming languages...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Consultant II, Data Analytics

    Senior Consultant II, Data Analytics

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Property Analysis, Reports Automation & Dashboard-Senior Consultant II.Key Responsibilities Gather, clean, and analyze complex data to understand business results and t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Professional Data Engineer

    Professional Data Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer who will be responsible for building operational reporting solutions and integrating data sources for data-driven decision-making.Key Responsibilities Col...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Databricks Data Engineer

    Databricks Data Engineer

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Portfolio Data Engineer

    Senior Portfolio Data Engineer

    VirtualVocations • Cleveland, Ohio, United States
    serp_jobs.job_card.full_time
    Portfolio Data Engineer to join their Data Engineering team.Key Responsibilities Write code and design pipeline architecture for data ingestion and analysis Build and enhance pipelines to improv...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Software Engineer - Data

    Senior Software Engineer - Data

    VirtualVocations • Akron, Ohio, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Software Engineer (React / React Native) - Data.Key Responsibilities Design and maintain event-driven pipelines and manage Snowflake administration Collaborate wi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted