Talent.com
Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

Capital OnePlano, TX, US
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.job_card.part_time
job_description.job_card.job_description

Overview

Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One.

What You\'ll Do :

  • Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies
  • Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems
  • Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake
  • Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community
  • Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment
  • Perform unit tests and conduct reviews with other team members to ensure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Basic Qualifications :

  • Bachelor\'s Degree
  • At least 6 years of experience in application development (Internship experience does not apply)
  • At least 2 years of experience in big data technologies
  • At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)
  • Preferred Qualifications :

  • Master\'s Degree
  • 9+ years of experience in application development including Python, SQL, Scala, or Java
  • 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)
  • 5+ years experience with Distributed data / computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)
  • 4+ year experience working on real-time data and streaming applications
  • 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
  • 4+ years of data warehousing experience (Redshift or Snowflake)
  • 4+ years of experience with UNIX / Linux including basic commands and shell scripting
  • 2+ years of experience with Agile engineering practices
  • Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.

    The minimum and maximum full-time annual salaries for this role are listed below, by location. Salaries for part-time roles will be prorated based upon hours worked.

    Cambridge, MA : $225,400 - $257,200 for Sr. Lead Data Engineer

    McLean, VA : $225,400 - $257,200 for Sr. Lead Data Engineer

    Plano, TX : $204,900 - $233,800 for Sr. Lead Data Engineer

    Richmond, VA : $204,900 - $233,800 for Sr. Lead Data Engineer

    Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate\'s offer letter.

    This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and / or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.

    Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.

    This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability / vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries.

    If you require an accommodation during the application process, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com

    Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.

    Capital One Financial is made up of several different entities. Positions posted in Canada, the United Kingdom, or the Philippines reflect the respective Capital One entities in those regions.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Data Engineer Python • Plano, TX, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Big Data Lead

    Big Data Lead

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Big Data Lead.Key Responsibilities Design and maintain robust data integration pipelines for ETL / ELT processes Utilize SQL and scripting for data transformation and pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for an Azure Developer-Data Engineer.Key Responsibilities Design, develop, and deploy scalable Azure-based data ingestion, transformation, and curation pipelines Implement d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Infrastructure Engineer

    Senior Data Infrastructure Engineer

    VirtualVocationsPlano, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Infrastructure Engineer to enhance its core data infrastructure and support advanced applications. Key Responsibilities Own and maintain data pipeline archit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Lead Machine Learning Engineer

    Senior Lead Machine Learning Engineer

    VirtualVocationsDallas, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Lead Machine Learning Engineer to lead the design and delivery of AI-powered intelligence systems. Responsibilities Design and implement infrastructure for agenti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Databricks Architect

    Senior Databricks Architect

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Lead Consultant (Databricks Architect).Key Responsibilities Serve as the technical lead for project teams, ensuring high-quality execution and alignment with bes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Enhance and improve the performance and reliability of existing Data Platform Services Design and build self-service...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Lead Python Software Engineer

    Lead Python Software Engineer

    Motion RecruitmentAddison, TX, US
    serp_jobs.job_card.full_time
    Our Dallas-based Saas client is seeking a Lead Python Software Engineer to join their growing engineering team in Addison, TX. This full-time, hybrid role supports their enterprise-scale analytics p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior AWS DevOps Engineer

    Senior AWS DevOps Engineer

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AWS DevOps Engineer.Key Responsibilities Collaborate with development teams to design, implement, and optimize cloud solutions on AWS Automate infrastructure pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Management Engineer

    Senior Data Management Engineer

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Management Engineer.Key Responsibilities Utilize expertise in Data Lineage, Cataloging, and Reconciliation technologies to enhance customer operations Coll...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer to lead the development of scalable data processing and enrichment pipelines. Key Responsibilities Design and implement scalable AI-powered data pro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsPlano, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to architect and scale their data platform and analytics stack.Key Responsibilities Refine and evolve the AWS data platform to enhance analytical cap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Python Engineer

    Senior Python Engineer

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Python Engineer to join their team in a remote capacity.Key Responsibilities Design, build, and iterate on web-based applications for alternatives-data professio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    VirtualVocationsDallas, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Analytics Engineer.Key Responsibilities Design and implement advanced data models and analytics solutions Develop and optimize scalable data pipelines and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Elasticsearch Engineer

    Senior Elasticsearch Engineer

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    Key Responsibilities Design and architect Elasticsearch ecosystems, including cluster sizing Manage data through indices, templates, data streams, and data lifecycle / backup policies Troubleshoo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    VirtualVocationsGarland, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Software Engineer - AI / ML, GenAI.Key Responsibilities Design, build, and deploy AI / ML models and solutions using Python and other scripting languages Develop and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data and ML Engineer

    Lead Data and ML Engineer

    VirtualVocationsGarland, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data / ML Engineer to build scalable, cost-efficient systems for transforming ad data into reliable intelligence. Key Responsibilities Design, build, and maintain sca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsGarland, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Engineer with extensive experience in high-transaction e-commerce environments. Key Responsibilities Develop and maintain ETL / ELT pipelines in Python and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Insights Engineer

    Senior Data Insights Engineer

    VirtualVocationsDallas, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Insights Engineer.Key Responsibilities Design, develop, and maintain scalable data models for reporting and analytics Develop and maintain dashboards using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day