Talent.com
Sr. DATA ENGINEER WITH ETL
Sr. DATA ENGINEER WITH ETLKanak Elite Services Inc • Nyc, NY, United States
Sr. DATA ENGINEER WITH ETL

Sr. DATA ENGINEER WITH ETL

Kanak Elite Services Inc • Nyc, NY, United States
job_description.job_card.variable_hours_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.temporary
  • serp_jobs.filters_job_card.quick_apply
job_description.job_card.job_description

Hello There,

Wish you a Happy Wednesday,

My name is Yashmita, and I am a Technical Recruiter at Kanak IT Services LLC. I am reaching out to you regarding the following job opportunity. If you are interested, kindly reply to this email yashmita@kanakits.com with your updated resume.

POSITION : SR. SOFTWARE ENGINEER - ETL DEVELOPER (PYSPARK)

LOCATION : NYC, NY

Make sure the template is filled out and the resume is under 4 pages.

KEYS ARE :

  • PYTHON : DEEP EXPERTISE IN TYPICAL DATA ENGINEERING USES NOT SWE USES
  • ABILITY TO BUILD / DESIGN SCALABLE PIPELINE SOLUTIONS TO INCLUDE INGESTION AND MODELING
  • ADVANCED SQL
  • AIRFLOW OR SIMILAR SCHEDULING TOOL
  • HADOOP OR SIMILAR

Description & Requirements

The Risk Engineering team is looking for an experienced engineer to join our growing and diverse group. We build tools that help the company discover, classify, and keep track of data-especially sensitive and personal information. Our work helps protect this data, supports privacy regulations like GDPR and CCPA, and makes it easier for teams across the company to understand and use data responsibly. In addition to enabling data protection and privacy, we are also building data inventory and risk analytics capabilities that provide deep visibility into data and support informed, risk-aware decisions. We focus on building reliable systems that bring transparency and trust to how data is managed.

A key objective of this role is for you to help to build and support enterprise level data analytics programs leveraging traditional warehouse technologies, Pyspark, MPP databases and Hadoop.

We'll trust you to :

  • Join a fast-paced team of dedicated engineers who are committed to building risk analytics to drive enterprise-wide data governance and privacy.
  • Shape the strategic and technological direction of the team
  • Empower your career growth through exposure to cutting-edge tools, processes, and challenges
  • Work closely with engineering and risk partners to deliver enterprise-scale impact
  • Translate business needs into robust engineering solutions
  • In order to be successful :

  • You should have a working knowledge of industry standard Data Infrastructure (e.g. Warehouse, BI, Analytics, Big-Data, etc.) tools with the goal of providing end users with analytics at the speed of thought.
  • You should be proficient at developing, architecting, standardizing and supporting technology platforms using Industry leading ETL solutions.
  • You should thrive in building scalable and high throughput systems
  • You should have experience with agile BI & ETL practices to assist with the interim Data preparation for Data Discovery & self-service needs.
  • You must have strong communication, presentation, problem-solving, and trouble-shooting skills.
  • You should be highly motivated to drive innovations company-wide.
  • You'll need to have :

  • 5+ years of experience in designing and developing ETL pipelines leveraging pyspark / python.
  • Experience on python database libraries like SQLAlchemy, psycopg2 .etc
  • Strong understanding of data warehousing methodologies, ETL processing and dimensional data modeling.
  • Advanced SQL capabilities are required. Knowledge of database design techniques and experience working with extremely large data volumes is a plus.
  • Demonstrated experience and ability to work with business users to gather requirements and manage scope.
  • Experience in workflow tools such as oozie or Airflow or Tidal
  • Experience working in a big data environment with technologies such as Greenplum, Hadoop and HIVE
  • BA, BS, MS, PhD in Computer Science, Engineering or related technology field
  • We'd love to see :

  • Experience with large database and DW Implementation (20+ TBs)
  • Understanding of VLDB performance aspects, such as table partitioning, sharding, table distribution and optimization techniques
  • Knowledge of reporting tools such as Qlik Sense, Tableau, Cognos
  • AGENCY INTAKE FORM (Candidates needs to fill the below form)

  • What are they currently working on? Comments and the below.
  • What type of development have they been working with? If mixture, provide % breakdown.
  • Embedded

  • System / Machine / Kernel level
  • Application (Backend)
  • Application (Middle)
  • Application (Front-end)
  • Programming Languages
  • What language are they currently using?

  • Preferred / Strongest Programming language?
  • Other languages & technologies that candidate feels confident in?
  • Are they focused on new development or maintenance?
  • How much exposure to databases do they have? Which databases are they working with and at what level?
  • What's motivating them to make a move?
  • Are they interested working on something finance related?
  • Are they active on the market now? Any other interviews scheduled or offers?
  • What are they specifically looking to work on? (More details than difficult problems...)
  • serp_jobs.job_alerts.create_a_job

    Sr Data Engineer • Nyc, NY, United States

    Job_description.internal_linking.related_jobs
    Data Engineer

    Data Engineer

    Spectraforce Technologies • Newark, NJ, United States
    serp_jobs.job_card.full_time
    Please update the job description andor attach a rolespecific job description below.Prepares data for analytical or operational uses. Builds data pipelines to pull information from different source ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior Data Engineer

    Senior Data Engineer

    New York Blood Center • Rye, NY, United States
    serp_jobs.job_card.full_time
    NYBC is part of New York Blood Center Enterprises (NYBCe), which spans 17+ states and delivers one million blood products to 400+ U. NYBCe additionally delivers cellular therapies, specialty pharmac...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Plum Inc • New York, NY, US
    serp_jobs.job_card.full_time
    PLUM is a fintech company empowering financial institutions to grow their business through a cutting-edge suite of AI-driven software, purpose-built for lenders and their partners across the financ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Leopard • New York, NY, US
    serp_jobs.job_card.full_time
    Leopard is an early-stage B2B Insurtech startup on a mission to reinvent how life insurance and annuities are built, distributed, and experienced. AI-native life insurance platform - from the capabi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Argonaut Management Services, Inc • New York, NY, United States
    serp_jobs.job_card.full_time
    Argo Group International Holdings, Inc.American National, US based specialty P&C companies, (together known as BP&C, Inc. Brookfield Wealth Solutions, Ltd.BWS"), a New York and Toronto-listed public...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    IPG Mediabrands • New York, NY, United States
    serp_jobs.job_card.full_time
    KINESSO is the technology-driven performance marketing agency that sits at the very heart of IPG Mediabrands, providing actionable growth for both our agency partners and clients.We turn 'action' i...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Sr. Data Engineer

    Sr. Data Engineer

    Contact Government Services, LLC • New York, NY, US
    serp_jobs.job_card.full_time
    Employment Type : Full-Time, Mid-level.Department : Business Intelligence.CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence pl...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Forhyre • New York, NY, US
    serp_jobs.job_card.full_time
    We are looking for a passionate certified Data Engineer.The successful candidate will turn data into information, information into insight and insight into business decisions.Data analyst responsib...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    SynapOne • Bronx, NY, United States
    serp_jobs.job_card.full_time
    Job Title : Data Engineering Contractor.Join our dynamic team of talented engineers with a proven track record in constructing data. We are on a mission to fuel Unite Us' ongoing expansion and.This p...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Integration Data Engineer

    Integration Data Engineer

    Shulman Fleming & Partners • Iselin, NJ, US
    serp_jobs.job_card.full_time
    MUST be local to Iselin, NJ, Hybrid Schedule at least 3 days onsite.We are seeking an Integration Data engineer with a background in SQL and data warehousing for enterprise level systems.The ideal ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Analytics Engineer

    Senior Data Analytics Engineer

    Garner Health • New York, NY, US
    serp_jobs.job_card.full_time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Data Analyst (Englewood Cliffs)

    Data Analyst (Englewood Cliffs)

    EPITEC • Englewood Cliffs, NJ, US
    serp_jobs.job_card.part_time
    Top skills : Analytical, problem-solver.Proficient in Alteryx (data ETL) and Tableau (dashboards).KEY RESPONSIBILITES / REQUIREMENTS : . The Retail Data Analyst in the CE Retail team enables data-driven ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer with Data Integration

    Data Engineer with Data Integration

    Computer Task Group, Inc • New York, NY, US
    serp_jobs.job_card.full_time
    CTG is seeking a Data Engineer with expertise in data integration to design and implement ETL solutions, ensuring smooth data flow from operational and external sources into the business intelligen...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Sr. Data Engineer (On-Site)

    Sr. Data Engineer (On-Site)

    Equinox • New York, NY, US
    serp_jobs.job_card.full_time
    Equinox Group is a high growth collective of the world's most influential, experiential, and differentiated lifestyle brands. We restlessly seek what is next for maximizing life - and boldly gro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Planned Parenthood Federation of America • New York, NY, US
    serp_jobs.job_card.full_time
    Planned Parenthood organizations serve all people with care and compassion, with respect, and without judgment, striving to create equitable access to health care. Through health centers, programs i...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    BDG • New York, NY, US
    serp_jobs.job_card.full_time
    Bustle Digital Group (BDG) is looking for a talented.You will work alongside the Director of Data Engineering to build, optimize, and scale our data infrastructure, supporting the development of da...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Data Analytics Engineer II

    Data Analytics Engineer II

    Garner Health • New York, NY, US
    serp_jobs.job_card.full_time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    Garner Health • New York, NY, US
    serp_jobs.job_card.full_time
    Healthcare quality is declining and soaring costs are crushing American families and businesses.At Garner, we've developed a revolutionary approach to evaluating doctor performance and a unique...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted