Talent.com
Lead Data Engineer - AWS

Lead Data Engineer - AWS

Tiger AnalyticsDallas, TX, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
  • serp_jobs.filters.remote
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines on AWS cloud infrastructure. You will work closely with cross-functional teams to support data analytics, machine learning, and business intelligence initiatives. The ideal candidate will have strong experience with AWS services, Databricks, and Apache Airflow.

Key Responsibilities :

  • Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.
  • Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics and reporting requirements.
  • Build and maintain orchestration workflows using Apache Airflow to automate data pipeline execution, scheduling, and monitoring.
  • Lead the migration of legacy data systems to modern cloud-based architectures.
  • Develop and maintain CI / CD pipelines for data workflows.
  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver scalable data solutions.
  • Optimize data pipelines for performance, reliability, and cost-effectiveness, leveraging AWS best practices and cloud-native technologies.

Requirements

  • 10+ years of experience building and deploying large-scale data processing pipelines in a production environment.
  • Hands-on experience in designing and building data pipelines on AWS cloud infrastructure.
  • Strong proficiency in AWS services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc.
  • Lead the design, development, and optimization of large-scale data pipelines and data lakehouse architectures using Databricks
  • Architect and implement batch and real-time streaming solutions leveraging Apache Spark on Databricks
  • Hands-on experience with Apache Airflow for orchestrating and scheduling data pipelines.
  • Solid understanding of data modeling, database design principles, and SQL and Spark SQL.
  • Experience with version control systems (e.g., Git) and CI / CD pipelines.
  • Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
  • Strong problem-solving skills and attention to detail.
  • Benefits

    This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

    Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity / expression, pregnancy,

    national origin, ancestry, marital status, protected veteran status, disability

    status, or any other basis as protected by federal, state, or local law.

    serp_jobs.job_alerts.create_a_job

    Lead Data Engineer • Dallas, TX, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Engineer (AI Platforms)

    Data Engineer (AI Platforms)

    VirtualVocationsGarland, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (AI Platforms) to contribute to building and optimizing data solutions for AI applications. Key Responsibilities Design, build, and optimize scalable data ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Java Big Data Engineer

    Java Big Data Engineer

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Java / Big Data Engineer.Key Responsibilities Develop and manage API services on AWS using Java, Scala, or Kotlin Implement and optimize AWS services including Pyspark, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (Python / Databricks) Contractor.Key Responsibilities Design, develop, and deploy enhancements to existing Python-based batch ETL scripts Utilize Databrick...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    AWS Data Engineer

    AWS Data Engineer

    Select Minds LLCDallas, TX, US
    serp_jobs.job_card.full_time
    Dallas, TX (Hybrid 3 days per week in-office).Locals & Non-Locals Can Apply.Strong AWS Services, Python / PySpark, Advanced SQL. Resume, LinkedIn URL, Work Authorization, Location Details.Our este...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    Select Minds LLCDallas, TX, US
    serp_jobs.job_card.full_time
    Dallas, TX (Hybrid 3 days onsite).Locals & Non-Locals Can Apply.We are looking for an experienced AWS Data Engineer with strong expertise in ETL, cloud migration, and large-scale data engineeri...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Cloud Data Engineer

    Cloud Data Engineer

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Engineer to design and implement data pipeline services for Azure cloud-based data solutions. Key Responsibilities Maintain and operate legacy ETL processes a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III.Key Responsibilities Drive cloud solutions utilizing Azure DevOps and Data Bricks Lead data stewardship workgroups and champion metadata and data qua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior AWS DevOps Engineer

    Senior AWS DevOps Engineer

    VirtualVocationsArlington, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AWS DevOps Engineer.Key Responsibilities Collaborate with development teams to design, implement, and optimize cloud solutions on AWS Automate infrastructure pr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    DevSecOps Engineer (AWS)

    DevSecOps Engineer (AWS)

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a DevSecOps Engineer (AWS) to design and develop solutions for complex application and integration challenges in a cloud environment. Key Responsibilities Design and devel...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Analytics Engineer

    Analytics Engineer

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for an Analytics Engineer to design and maintain product data pipelines.Key Responsibilities Design, build, and optimize scalable data models using SQL, dbt, and cloud-based ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsCarrollton, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer, DEVX.Key Responsibilities Integrate diverse data sources and vendor products for analytical and operational use Automate ETL deployment tasks to enhance...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    H R PUNDITS INC75007, TX, US
    serp_jobs.job_card.full_time
    Onsite / Remote : Day 1 Onsite at customer location.Job Functions / Responsibilities.Candidate must have Battery Electric Vehicle related experience. Build and document automated data pipelines from a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsGrand Prairie, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II to develop and operationalize data pipelines for improved health outcomes.Key Responsibilities Design and implement standardized data management proced...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    BI Lead Data Analytics Engineer

    BI Lead Data Analytics Engineer

    VirtualVocationsGarland, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a BI Lead - Data Analytics Engineer.Key Responsibilities Architect and build a centralized data lake to unify various data types Develop pipelines for advanced multi-tou...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    VirtualVocationsPlano, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for an AWS Cloud Engineer.Key Responsibilities Innovate, develop, maintain, and optimize infrastructure within the AWS Cloud ecosystem Provision and manage infrastructure us...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer.Key Responsibilities : Ensure accurate data flow from creation to presentation layers Enhance the Data Engineering stack through containerization, ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer - AWS

    Lead Data Engineer - AWS

    Tiger AnalyticsDallas, TX, US
    serp_jobs.job_card.full_time
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    ProtagonaDallas, TX, US
    serp_jobs.job_card.full_time
    As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS.Client engag...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Discovery Engineer

    Senior Data Discovery Engineer

    VirtualVocationsMesquite, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Engineer - Data Discovery.Key Responsibilities Design, architect, and deploy data discovery and inventory platform Administer tools and processes to implement P...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsIrving, Texas, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to lead the development and operationalization of data pipelines for improved health outcomes. Key Responsibilities Lead the design and implementation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30