Talent.com
Data Engineer (Python / PySpark / AWS)

Data Engineer (Python / PySpark / AWS)

Infinitive IncAshburn, VA, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

  • Candidates must be local to the Washington D.C. metro area.

About Infinitive :

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. . We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our clients data infrastructure. Your expertise in Python, PySpark, ETL processes, CI / CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients.

Responsibilities :

Data Architecture and Design :

  • Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions.
  • Develop data models and schema designs to optimize data storage and retrieval.
  • ETL Development :

  • Implement ETL processes to extract, transform, and load data from various sources.
  • Ensure data quality, integrity, and consistency throughout the ETL pipeline.
  • Python and PySpark Development :

  • Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts.
  • Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices.
  • Data Integration :

  • Integrate data from different systems and sources to provide a unified view for analytical purposes.
  • Collaborate with data scientists and analysts to implement solutions that meet their data integration needs.
  • Streaming and Batch Workflows :

  • Design and implement streaming workflows using PySpark Streaming or other relevant technologies.
  • Develop batch processing workflows for large-scale data processing and analysis.
  • CI / CD Implementation :

  • Implement and maintain continuous integration and continuous deployment (CI / CD) pipelines using Jenkins or GitHub Actions.
  • Automate testing, code deployment, and monitoring processes to ensure the reliability of data pipelines.
  • Qualifications :

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and expertise in PySpark for both batch and streaming data processing.
  • Hands-on experience with ETL tools and processes.
  • Familiarity with CI / CD tools such as Jenkins or GitHub Actions.
  • Solid understanding of data modeling, database design, and data warehousing concepts.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Preferred Skills :

  • Knowledge of cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience with version control systems (e.g., Git).
  • Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Understanding of data security and privacy best practices.
  • Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa. Infinitive is an Equal Opportunity Employer.

    Powered by JazzHR

    y32jmDQPg7

    serp_jobs.job_alerts.create_a_job

    Data Engineer • Ashburn, VA, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsRockville, Maryland, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (Python / Databricks) Contractor.Key Responsibilities Design, develop, and deploy enhancements to existing Python-based batch ETL scripts Utilize Databrick...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsAlexandria, Virginia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer / Lead Analyst to contribute to the development and optimization of data products in a healthcare environment. Key Responsibilities Design, build, and mainta...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingReston, VA, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingReston, VA, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    IntelliTech LLCArlington, VA, US
    serp_jobs.job_card.temporary
    IntelliTech is seeking experienced Data Engineers to join our team.As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our client's data infrastructure an...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsAlexandria, Virginia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer (Python / PySpark / AWS)

    Senior Data Engineer (Python / PySpark / AWS)

    Infinitive IncAshburn, VA, US
    serp_jobs.job_card.full_time
    Candidates must be local to the Washington D.Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AWS Data Engineer with Sage maker

    AWS Data Engineer with Sage maker

    iSoftTek Solutions IncReston, VA, US
    serp_jobs.job_card.full_time
    Role : AWS Data Engineer with Sage maker.Location : Reston, VA (Day 1 onsite – 5 days in a week).We are seeking a motivated Senior Data Engineer with strong AWS and data platform experience to...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Sr. Python Data Engineer

    Sr. Python Data Engineer

    US Tech Solutions, Inc.McLean, VA, US
    serp_jobs.job_card.full_time
    Duration : 6 Month Job Description : The Senior Developer will be part of the Enterprise Risk Business Technology Office. This role will be responsible for supporting our organization’s data-driven in...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    ASCENDINGFairfax, VA, US
    serp_jobs.job_card.full_time
    Cloud Migrations, custom web app development, data analytics / big data and DevOps.We are currently looking for an.The ideal candidate will also have a willingness to learn and work with a variety of...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsWashington, District of Columbia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer.Key Responsibilities : Ensure accurate data flow from creation to presentation layers Enhance the Data Engineering stack through containerization, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    BI Lead Data Analytics Engineer

    BI Lead Data Analytics Engineer

    VirtualVocationsAlexandria, Virginia, United States
    serp_jobs.job_card.full_time
    A company is looking for a BI Lead - Data Analytics Engineer.Key Responsibilities Architect and build a centralized data lake to unify various data types Develop pipelines for advanced multi-tou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Discovery Engineer

    Senior Data Discovery Engineer

    VirtualVocationsRockville, Maryland, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsAlexandria, Virginia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Engineer - Data Engineer

    Engineer - Data Engineer

    Progression IncChantilly, DC, US
    serp_jobs.job_card.full_time
    Data Engineer Arlington, VA $95,000 / yr - $140,000 / yr + benefits MUST : Active Secret clearance required 5+ years overall professional experience in IT and Data management 3 years of experience as a ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsRockville, Maryland, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Java Big Data Engineer

    Java Big Data Engineer

    VirtualVocationsRockville, Maryland, United States
    serp_jobs.job_card.full_time
    A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer (AI Platforms)

    Data Engineer (AI Platforms)

    VirtualVocationsWashington, District of Columbia, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (AI Platforms) to contribute to building and optimizing data solutions for AI applications. Key Responsibilities Design, build, and optimize scalable data ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30