Talent.com
Senior AWS Data Engineer
Senior AWS Data EngineerAccord Technologies Inc • Rock Hill, SC, US
serp_jobs.error_messages.no_longer_accepting
Senior AWS Data Engineer

Senior AWS Data Engineer

Accord Technologies Inc • Rock Hill, SC, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

Fort Mills, SC (Hybrid 3 days a week). Position type : W2 contract.

Job Summary

Contribute to building state-of-the-art data platforms in AWS, leveraging Python and Spark. This role is ideal for an experienced data engineer looking to step into a leadership position while remaining hands-on with cutting-edge technologies. You will design, implement, and optimize ETL workflows using Python and Spark, contributing to our robust data Lakehouse architecture on AWS. Success in this role requires technical expertise, strong problem-solving skills, and the ability to collaborate effectively within an agile team.

Responsibilities

  • Provide guidance on best practices in design, development, and implementation, ensuring solutions meet business requirements and technical standards.
  • Work closely with architects, Product Owners, and development team members to decompose solutions into Epics, leading design and planning of these components.
  • Drive the migration of existing data processing workflows to the Lakehouse architecture, leveraging Iceberg capabilities.
  • Communicate complex technical information clearly, tailoring messages to the appropriate audience to ensure alignment.

Must Have Tech Skills

  • Demonstrable experience as a senior data engineer.
  • Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.
  • Experience implementing data pipelines using AWS EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena.
  • Experience with data services in a Lakehouse architecture.
  • Key Skills

  • Deep technical knowledge of data engineering solutions and practices. Implementation of data pipelines using AWS data services and Lakehouse capabilities.
  • Highly proficient in Python and Spark; familiarity with a variety of development technologies to adapt solutions to project-specific needs.
  • Skilled in decomposing solutions into components (Epics, stories) to streamline development.
  • Proficient in creating clear, comprehensive documentation to support knowledge sharing and compliance.
  • Proficient in quality assurance practices, including code reviews, automated testing, and data validation.
  • Experience leveraging automation tools and CI / CD pipelines to streamline development, testing, and deployment.
  • Educational Background

  • Bachelor's degree in computer science, Software Engineering, or related field required.
  • Must Have

  • Financial Services expertise, working with Equity and Fixed Income asset classes and a working knowledge of Indices.
  • Nice To Have Tech Skills

  • Experience in solution architecture and technical design for scalable, reliable data architectures.
  • Master's degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous.
  • Seniority

  • Mid-Senior level
  • Employment Type

  • Contract
  • Job Function

  • Information Technology
  • Notes : This posting has been streamlined to remove boilerplate content not relevant to the role. EEO and compliance information should be provided as required by law.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Senior Data Engineer • Rock Hill, SC, US

    Job_description.internal_linking.related_jobs
    Senior AWS DevOps Engineer

    Senior AWS DevOps Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AWS DevOps Engineer.Key Responsibilities Collaborate with development teams to design and optimize cloud solutions on AWS Automate infrastructure provisioning a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer / Senior Data Engineer

    Data Engineer / Senior Data Engineer

    Arcadia • Concord, NC, US
    serp_jobs.job_card.full_time
    Arcadia is dedicated to happier, healthier days for all.We transform diverse data into a unified fabric for health.Our platform delivers actionable insights for our customers to advance care and re...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    CPI Security • Charlotte, NC, US
    serp_jobs.job_card.full_time
    CPI Security, a national leader in residential and commercial security solutions, is seeking a Senior Data Engineer to join us on our data transformational journey. This is an exciting, hands-on opp...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Engineer (SQL, AI Search, and Observability).Key Responsibilities : Build cloud foundational components in the Azure cloud Monitor, scale, and maintain produ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Databricks Data Engineer

    Databricks Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Databricks Data Engineer to join their data engineering and analytics team.Key Responsibilities Design and develop scalable data pipelines using Apache Spark on Databri...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Expand and maintain the data platform in collaboration with other engineers and data scientists Improve product tele...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Contact Government Services, LLC • Charlotte, NC, US
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer to support data initiatives and optimize data delivery architecture.Key Responsibilities Update, analyze, and enhance products through direct inter...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AWS DevSecOps Engineer

    AWS DevSecOps Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for an AWS DevSecOps Engineer to secure applications and optimize cloud solutions.Key Responsibilities Collaborate with DevSecOps Engineers to understand and migrate existing...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech Consulting • Charlotte, NC, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Cloud Data Engineer

    Senior Cloud Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Cloud Data Engineer.Key Responsibilities Design and build scalable ETL pipelines in Databricks using PySpark and Spark SQL Migrate legacy ETL processes to cloud...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for an AWS Cloud Engineer.Key Responsibilities Design and implement scalable, secure, and cost-effective cloud infrastructure solutions on AWS Develop and maintain Terraform...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Analytics Engineer - GTM.Key Responsibilities Design and build core data models to enhance analysis efficiency and provide reliable insights Create intuitive, v...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer.Key Responsibilities Collaborate with Agile teams to design, develop, test, implement, and support technical solutions Utilize programming languages...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech Consulting • Charlotte, NC, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Portfolio Data Engineer

    Senior Portfolio Data Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    Portfolio Data Engineer to join their Data Engineering team.Key Responsibilities Write code and design pipeline architecture for data ingestion and analysis Build and enhance pipelines to improv...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    AWS DevOps Engineer

    AWS DevOps Engineer

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for an AWS DevOps Engineer - Tech Lead.Key Responsibilities Collaborate with development teams to design and optimize cloud solutions on AWS Automate infrastructure provisio...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer - Databricks

    Data Engineer - Databricks

    VirtualVocations • Charlotte, North Carolina, United States
    serp_jobs.job_card.full_time
    A company is looking for a Technical Consultant specializing in Databricks.Key Responsibilities Design, develop, and maintain ETL / ELT pipelines and Databricks notebooks for data ingestion, transf...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new