Search jobs > New York, NY > Data engineer

PySpark Data Engineer (Onsite NYC)

Oakridge Staffing
New York, NY, United States
Full-time

Global hospitality company is looking for an experienced PySpark Data Engineer for their Midtown NYC headquarters.

Responsibilities :

  • Lead the in-house development of ETL / ELT data pipelines and data science projects.
  • Create and own data products, such as a recommendation engine or predictive model.
  • Provide key insights and analyses to senior stakeholders and executives.
  • Work with the Data Engineering team to design and develop data models.

Qualifications And Requirements

  • 5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.
  • Strong hands-on experience with programming in Python.
  • Expertise in SQL and analytical data modeling.
  • Hands-on experience in pipeline orchestration tools, like Apache Airflow.
  • Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.
  • Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.
  • Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)
  • 20 days ago
Related jobs
Oakridge Staffing
New York, New York

Work with the Data Engineering team to design and develop data models. Lead the in-house development of ETL/ELT data pipelines and data science projects. Create and own data products, such as a recommendation engine or predictive model. AWS big data pipelines using Apache Spark. ...

Matlen Silver
New York, New York

Avaya/BMC Remedy Engineer - W2 Contract - Hybrid onsite in NYC, NJ or Charlotte NC. The ideal candidate will be a strong contributor and a self-starter who can analyze data and drive to logical outcomes while constantly challenging the status quo. Analyze technical data processing routines and drive...

Aircall
New York, New York

As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure. Experience with data tooling, data governance, business intelligence and data privacy is a plus. We are looking for a passionate and experienced data engineer to join our team a...

Matlen Silver
New York, New York

Microsoft Teams Engineer - W2 Contract only - Hybrid onsite in NYC, CLT or NJ (3 days per week onsite in office). We are looking for experienced Microsoft Teams engineer to join our team. This job is responsible for implementing the engineering approach to transition the Bank from legacy Skype for B...

Lorven Technologies
New York, New York

Job Location: NYC, NY - Onsite. Experience as a Data Architect and subject matter expert for customer experience & marketing data solutions. Job Tilte: Adobe Experience Platform Engineer. Knowledge of Customer Data Platform. ...

Averity
New York, New York

How would you like to be a Full-Stack Data Engineer at a NYC hedge fund that continually outperforms the market and has doubled its AUM in under 2 years!. As our new Full-Stack Data Engineer, you will join a senior engineer with decades of experience in our space and a risk analyst who will be your ...

Lorven Technologies
New York, New York

Job Location: NYC, NY (Onsite). Job Title: QA Automation Engineer. ...

The Developer Link
New York, New York

The Developer Link has partnered with a growing early stage startup in NYC that is searching for a Backend Leaning Senior Full Stack Engineer to join the team. Strong Data skills (migrating, updating data models). Backend Leaning Full Stack Engineer. Ability to collaborate between BE & FE Engineers....

Lorven Technologies
New York, New York

Location: NYC, NY (100% Onsite/F2F Interview). Job Title: Active Directory Engineer. ...

Rokt
New York, New York

Our bespoke platform handles millions of transactions per day and considers billions of data points which give engineers the opportunity to build technology at scale, collaborate across teams and gain exposure to a wide range of technology. The Rokt engineering team builds best-in-class ecommerce te...