Talent.com
Data Engineer

Data Engineer

ForhyreNew York, NY, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

We are looking for a passionate certified Data Engineer. The successful candidate will turn data into information, information into insight and insight into business decisions.

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Primary skillset : Python / Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing, ETL

Secondary : Databricks

Nice to have : Informatica / ETL.

Responsibilities

  • Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
  • Understand the full end to end development activities from design to go live for ETL development and Azure platform

Recommend and execute improvements

  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes / standards, business technology architecture for development, release management and deployment process
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
  • Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
  • Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
  • Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms / servers / applications / systems.
  • Requirements

  • Proven working experience as a data engineer
  • Bachelor degree or equivalent in Computer Science
  • Skilled in Python object-oriented programming
  • Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECS
  • Skilled in AWS Database products such as Neptune, RDS, Redshift, or Aurora
  • Skilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems Manager
  • Skilled in Amazon Web Services (AWS) offerings, development, and networking platforms
  • Skilled in SQL
  • Skilled in Jenkins
  • Skilled in JSON
  • Skilled in discovering patterns in large data sets with the use of relevant software such as Oracle Data Mining or Informatica
  • Skilled in cloud technologies and cloud computing
  • Experience using software and computer systems' architectural principles to integrate enterprise computer applications such as xMatters, AWS Application Integration, or WebSphere
  • Determining causes of operating errors and taking corrective action
  • Experience in the process of analyzing data to identify trends or relationships to inform conclusions about the data
  • Skilled in creating and managing databases with the use of relevant software such as MySQL, Hadoop, or MongoDB
  • Programming including coding, debugging, and using relevant programming languages
  • Communication including communicating in writing or verbally, copywriting, planning and distributing communication, etc.
  • Ability to frame ideas as systems and analyzing the inputs, outputs, and process
  • Experience helping an organization to plan and manage change in effort to meet strategic objectives
  • Adept at managing project plans, resources, and people to ensure successful project completion
  • Working with people with different functional expertise respectfully and cooperatively to work toward a common goal
  • serp_jobs.job_alerts.create_a_job

    Data Engineer • New York, NY, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Microsoft Fabric Data Engineer

    Microsoft Fabric Data Engineer

    5 Star RecruitmentNewark, NJ, US
    serp_jobs.job_card.full_time
    Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse. Ensure scalability, performance, and cost-effectiveness.Data Integ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Interactive BrokersGreenwich, CT, US
    serp_jobs.job_card.full_time
    Interactive Brokers Group, Inc.Nasdaq : IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineering Specialist (Hybrid)

    Data Engineering Specialist (Hybrid)

    Selective InsuranceShort Hills, NJ, United States
    serp_jobs.job_card.temporary
    At Selective, we don't just insure uniquely, we employ uniqueness.Selective's unique position as both a leading insurance group and an employer of choice is recognized in a wide variety of awards a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Enterprise Data Manager

    Enterprise Data Manager

    KyoceraFairfield, NJ, US
    serp_jobs.job_card.full_time
    When you join Kyocera Document Solutions America, Inc.Philosophy of "doing what is right as a human being".Through this philosophy, our employees are passionate about providing best in class custom...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Microsoft Fabric Data Engineer

    Microsoft Fabric Data Engineer

    Fortis HayesNewark, NJ, US
    serp_jobs.job_card.full_time
    Microsoft Fabric Data Engineer - 6 month Hybrid full-time role.Our client is seeking a highly experienced Microsoft Fabric Data Engineer to design, build, and optimize our enterprise data and analy...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Tiger AnalyticsJersey City, NJ, US
    serp_jobs.job_card.full_time
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several F...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Database Development

    Database Development

    TradeJobsWorkForce10040 New York, NY, US
    serp_jobs.job_card.full_time
    Database Development Job Duties : Database Developers are responsible for data gathering before development of ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    2025 Fall Data Science Internship

    2025 Fall Data Science Internship

    Zwilling J A Henckels LLCPleasantville, NY, US
    serp_jobs.job_card.full_time +1
    The ZWILLING Internship Program will offer students an unmatched, behind-the-scenes look and learning experience within the cookware and cutlery industry. At ZWILLING, we believe in making meals mea...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Reserving Data & Applications Lead

    Reserving Data & Applications Lead

    Axis CapitalRed Bank, NJ, United States
    serp_jobs.job_card.full_time
    This is your opportunity to join AXIS Capital - a trusted.We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders.We also ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Interactive BrokersGreenwich, CT, US
    serp_jobs.job_card.full_time
    Interactive Brokers Group, Inc.Nasdaq : IBKR) is a global financial services company headquartered in Greenwich, CT, USA, with offices in over 15 countries. We have been at the forefront of financial...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Microsoft Fabric Data Engineer

    Microsoft Fabric Data Engineer

    GlobalchannelmanagementNewark, NJ, US
    serp_jobs.job_card.full_time
    Microsoft Fabric Data Engineer needs 7+ years of experience in Microsoft Azure.Microsoft Fabric Data Engineer requires : . Azure data and analytics solutions.Expertise in Azure services such as Azure ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Database Specialist

    Database Specialist

    TradeJobsWorkForce10705 Yonkers, NY, US
    serp_jobs.job_card.full_time
    Database Specialist Job Duties : Plans database upgrades by maintaining , evaluating, and improving a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    SynapOneBronx, NY, United States
    serp_jobs.job_card.full_time
    Job Title : Data Engineering Contractor.Join our dynamic team of talented engineers with a proven track record in constructing data. We are on a mission to fuel Unite Us' ongoing expansion and.This p...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    Data Engineer - Gen Ai - Edison, NJ

    Data Engineer - Gen Ai - Edison, NJ

    QTechEdison, NJ, United States
    serp_jobs.job_card.temporary
    serp_jobs.filters_job_card.quick_apply
    Job Title : Data Engineer Gen AI Location : Edison, NJ Domain : IT Services Duration : Long Term Contract Looking for W2 Candidat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    SoHo DragonNew York, NY, US
    serp_jobs.job_card.full_time
    Location : New York City(Hybrid 3x in office).Employment Type : Contract-to-hire.The data engineer is responsible for designing, building, and maintaining the systems and infrastructure needed for data...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Big Data Engineer

    Big Data Engineer

    ThrotleRed Bank, NJ, US
    serp_jobs.job_card.full_time
    Please consider joining our technology team at Throtle as a Big Data Developer.In this role, you will be part of the team that is responsible for transforming and maintaining several billion record...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Scientist

    Data Scientist

    New York Blood CenterRye, NY, United States
    serp_jobs.job_card.full_time
    New York Blood Center Enterprises (NYBCe).NYBCe is one of the largest nonprofit blood centers, spanning 17+ states and serving 75 million people. NYBCe operates Blood Bank of Delmarva, Community Blo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    ingenium.agencyNew York, NY, US
    serp_jobs.job_card.full_time
    Senior Data Engineer $150k - $170k.We are a leading cloud-based mobile patient intake and registration system.Our platform allows patients to complete their paperwork from the comfort of their own ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30