Talent.com
Lead Data Engineer (AWS)

Lead Data Engineer (AWS)

Global Applications SolutionJersey City, New Jersey, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Responsibilities :

  • Lead the design, development, and implementation of data solutions using AWS and Snowflake.
  • Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
  • Develop and maintain data pipelines, ensuring data quality, integrity, and security.
  • Optimize data storage and retrieval processes to support data warehousing and analytics.
  • Provide technical leadership and mentorship to junior data engineers.
  • Work closely with stakeholders to gather requirements and deliver data-driven insights.
  • Ensure compliance with industry standards and best practices in data engineering.
  • Utilize knowledge of insurance, particularly claims and loss, to enhance data solutions.

Must have :

  • 8+ years of relevant experience in Data Engineering and delivery.
  • 8+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
  • Strong experience with SQL, python and Pyspark
  • Good understanding of Data ingestion and data processing frameworks
  • Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
  • Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
  • Should be able to do coding, debugging, performance tuning, and deploy the apps to the Production environment.
  • Experience working in Agile Methodology
  • Good to have :

  • Have experience in DevOps tools (Jenkins, GIT, etc.) and practices, continuous integration, and delivery (CI / CD) pipelines.
  • Worked on cloud implementations, data migration, Data Vault 2.0, etc.
  • Requirements :

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer, with a focus on AWS and Snowflake.
  • Strong understanding of data warehousing concepts and best practices.
  • Excellent communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Experience in the insurance industry, preferably with knowledge of claims and loss processes.
  • Proficiency in SQL, Python, and other relevant programming languages.
  • Strong problem-solving skills and attention to detail.
  • Ability to work independently and as part of a team in a fast-paced environment.
  • Preferred Qualifications :

  • Experience with data modeling and ETL processes.
  • Familiarity with data governance and data security practices.
  • Certification in AWS or Snowflake is a plus.
  • serp_jobs.job_alerts.create_a_job

    Lead Data Engineer • Jersey City, New Jersey, United States

    Job_description.internal_linking.related_jobs
    Data and Analytics Engineer

    Data and Analytics Engineer

    ResonanceNew York, NY, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Resonance is transforming the fashion industry by building a more sustainable and valuable ecosystem for designers, brands, manufacturers, consumers, and the planet. Our AI-powered operating system,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Lead Data Engineer / Data Architect

    Lead Data Engineer / Data Architect

    Lorven technologiesNew York City, NY, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    Job Title : Lead Data Engineer / Data Architect Location : New York City, NY; (Onsite 5 days / week) ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsBrooklyn, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for an Azure Developer-Data Engineer.Key Responsibilities Design, develop, and deploy scalable Azure-based data ingestion, transformation, and curation pipelines Implement d...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsStaten Island, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Azure Data Engineer

    Azure Data Engineer

    QED NationalUSA, New York, New York
    serp_jobs.job_card.full_time
    Hybrid (2-3 days onsite per week).This long-term contract role offers the opportunity to work in a hybrid environment while contributing to cutting-edge data solutions that drive analytics, busines...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Lead Data and ML Engineer

    Lead Data and ML Engineer

    VirtualVocationsStaten Island, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data / ML Engineer to build scalable, cost-efficient systems for transforming ad data into reliable intelligence. Key Responsibilities Design, build, and maintain sca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    STRONG POINT CONSULTING INC.Union City, NJ, US
    serp_jobs.job_card.full_time
    Job Description : We are looking for Data Engineer supporting the development and maintenance of Enterprise Data Hub within the insurance domain. The ideal candidate will have strong experience in AW...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Data Engineer

    Senior Data Engineer

    OpenkyberNY, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Our client - a major utility firm based out of Westchester County, NY - has an immediate need for Senior Data Engineer.The particulars of the position are as follows. Job Functions & Responsibil...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Senior Data Engineer - Data & Analytics

    Senior Data Engineer - Data & Analytics

    PROGYNYNew York, NY, United States
    serp_jobs.job_card.full_time
    Thank you for considering Progyny!.Data is the lifeblood of healthcare, and Progyny as a company depends on the accurate, timely, and secure management of data to achieve our company mission at the...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Senior Data Engineer

    Senior Data Engineer

    Tiger AnalyticsJersey City, NJ, US
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several F...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    VirtualVocationsYonkers, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data Engineer to architect and scale their data platform and analytics stack.Key Responsibilities Refine and evolve the AWS data platform to enhance analytical cap...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    VirtualVocationsJamaica, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Analytics Engineer.Key Responsibilities Design and implement advanced data models and analytics solutions Develop and optimize scalable data pipelines and ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Apptad-Sr. Cloud Data Platform Engineer

    Apptad-Sr. Cloud Data Platform Engineer

    Apptad IncNYC, NY, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Cloud Data Platform Engineer Job Location : Iselin, NJ / New York City, NY (Hybrid 3 days onsite in a week) Job duration : Contract &...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Platform Engineer.Key Responsibilities Enhance and improve the performance and reliability of existing Data Platform Services Design and build self-service...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Cloud Data Platform Engineer

    Sr. Cloud Data Platform Engineer

    VeeRteq Solutions Inc.Iselin, NJ, United States
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Cloud Platform Data Engineer Location : Iselin, NJ / New York, NY Job Description : Skills : <...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    C++ Market Data Engineer (USA)

    C++ Market Data Engineer (USA)

    Trexquant InvestmentStamford, CT, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Trexquant is a growing systematic fund at the forefront of quantitative finance, with a core team of highly accomplished researchers and engineers. To keep pace with our expanding global trading ope...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Data Insights Engineer

    Senior Data Insights Engineer

    VirtualVocationsBrooklyn, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Insights Engineer.Key Responsibilities Design, develop, and maintain scalable data models for reporting and analytics Develop and maintain dashboards using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours