Talent.com
Lead Data Engineer - AWS

Lead Data Engineer - AWS

Tiger AnalyticsDallas, TX, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on AWS cloud infrastructure. You will work closely with cross-functional teams to support data analytics, machine learning, and business intelligence initiatives. The ideal candidate will have strong experience with AWS services, Databricks, and Apache Airflow.

Key Responsibilities :

  • Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.
  • Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics and reporting requirements.
  • Build and maintain orchestration workflows using Apache Airflow to automate data pipeline execution, scheduling, and monitoring.
  • Lead the migration of legacy data systems to modern cloud-based architectures.
  • Develop and maintain CI / CD pipelines for data workflows.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.
  • Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.

Requirements

  • 10+ years of experience building and deploying large-scale data processing pipelines in a production environment.
  • Hands-on experience in designing and building data pipelines on AWS cloud infrastructure.
  • Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.
  • Lead the design, development, and optimization of large-scale data pipelines and data lakehouse architectures using Databricks
  • Architect and implement batch and real-time streaming solutions leveraging Apache Spark on Databricks
  • Hands-on experience with Apache Airflow for orchestrating and scheduling data pipelines.
  • Solid understanding of data modeling, database design principles, and SQL and Spark SQL.
  • Experience with version control systems (e.g., Git) and CI / CD pipelines.
  • Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
  • Strong problem-solving skills and attention to detail.
  • Benefits

    This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

    Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity / expression, pregnancy,

    national origin, ancestry, marital status, protected veteran status, disability

    status, or any other basis as protected by federal, state, or local law.

    serp_jobs.job_alerts.create_a_job

    Data Engineer Aws • Dallas, TX, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Senior Lead Data Engineer (Python, EMR, Databricks, AWS)

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Senior Lead Data Engineer (Python, EMR, Databricks, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,....serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer (Python, SQL, AWS)

    Lead Data Engineer (Python, SQL, AWS)

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Lead Data Engineer (Python, SQL, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Lead Data Engineer

    Senior Lead Data Engineer

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,. At Capital One, you'll be part of a big group of makers, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    AWS Data Engineer

    AWS Data Engineer

    Select Minds LLCDallas, TX, US
    serp_jobs.job_card.full_time
    Dallas, TX (Hybrid 3 days per week in-office).Locals & Non-Locals Can Apply.Strong AWS Services, Python / PySpark, Advanced SQL. Resume, LinkedIn URL, Work Authorization, Location Details.Our este...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Select Minds LLCDallas, TX, US
    serp_jobs.job_card.full_time
    Dallas, TX (Hybrid 3 days onsite).Locals & Non-Locals Can Apply.We are looking for an experienced AWS Data Engineer with strong expertise in ETL, cloud migration, and large-scale data engineeri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer - AWS

    Data Engineer - AWS

    Inizio PartnersDallas, TX, United States
    serp_jobs.job_card.full_time
    About the job Data Engineer - AWS.We are expanding our Data Engineering toolset and need an experienced AWS, Python and SQL Data Engineer. This role will be required to design and implement our new ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,. At Capital One, you'll be part of a big group of makers, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    H R PUNDITS INC75007, TX, US
    serp_jobs.job_card.full_time
    Onsite / Remote : Day 1 Onsite at customer location.Job Functions / Responsibilities.Candidate must have Battery Electric Vehicle related experience. Build and document automated data pipelines from a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Azure Data Engineer.Key Responsibilities Designs and develops data solutions using Microsoft Azure technologies to meet business needs Manages IT controls and pro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer (Java, Python, Spark, AWS)

    Lead Data Engineer (Java, Python, Spark, AWS)

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Lead Data Engineer (Java, Python, Spark, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer (Python, SQL, AWS) - FS Data

    Senior Data Engineer (Python, SQL, AWS) - FS Data

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Senior Data Engineer (Python, SQL, AWS) - FS Data.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsPlano, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to design, build, and manage enterprise-grade data pipelines.Key Responsibilities Design, develop, and optimize metadata-driven data pipelines in Fab...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer (Python, SQL, AWS) - FS Data

    Lead Data Engineer (Python, SQL, AWS) - FS Data

    Capital OnePlano, TX, United States
    serp_jobs.job_card.full_time +1
    Lead Data Engineer (Python, SQL, AWS) - FS Data.Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    ProtagonaDallas, TX, United States
    serp_jobs.job_card.full_time
    As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS.Client engag...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Purple DriveDallas, TX, United States
    serp_jobs.job_card.full_time
    We are seeking a highly skilled.The ideal candidate should have hands-on experience with.AWS leveraging EMR, EKS, and Databricks. Implement Infrastructure as Code (IaC) using.Develop scalable soluti...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    QodeDallas, TX, US
    serp_jobs.job_card.full_time
    Pittsburgh, PA / Dallas, TX / Cleveland,OH.PNC Bank is seeking a highly skilled.The ideal candidate will have strong expertise in building and optimizing scalable data pipelines using Hadoop and PySp...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Senior Data Engineer (Python, SQL, AWS)

    Senior Data Engineer (Python, SQL, AWS)

    Capital OnePLANO, Texas, United States
    serp_jobs.job_card.full_time +1
    Senior Data Engineer (Python, SQL, AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, y...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer - AWS

    Lead Data Engineer - AWS

    Tiger AnalyticsDallas, TX, United States
    serp_jobs.job_card.full_time
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AWS Data Engineer - Fully Remote - US Only

    AWS Data Engineer - Fully Remote - US Only

    ScalepexPlano, TX, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    Scalepex is a dynamic services firm specializing in providing solutions for premium brands like Nike, Pepsi, Toyota, Virgin and Walgreens. Our mission is to connect prominent market leaders with top...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30