Search jobs > New York, NY > Data engineer

Data Engineer

Rockstar New York
New York
Permanent
Full-time

At Rockstar Games, we create world-class entertainment experiences.

A career at Rockstar Games is about being part of a team working on some of the most creatively rewarding and ambitious projects to be found in any entertainment medium.

You would be welcomed to a dedicated and inclusive environment where you can learn, and collaborate with some of the most talented people in the industry.

Rockstar is seeking a Data Engineer to join a team focused on building a cutting-edge game analytics platform and tools to better understand our players and enhance their experience in our games.

This is a full-time permanent position based out of Rockstar’s unique game development studio in New York, NY.

The ideal candidate will be skilled in developing complex ingestion and transformation processes with an emphasis on reliability and performance.

In collaboration with other data engineers, machine learning engineers, and software engineers, the candidate will empower the team of analysts and data scientists to deliver data driven insights and applications to company stakeholders.

WHAT WE DO

  • The Rockstar Analytics team provide insights and actionable results to a wide variety of stakeholders across the organization in support of their decision making.
  • We are currently adding team members to multiple verticals including; Machine Learning and Game Data Pipeline.

RESPONSIBILITIES

  • Implement and maintain real-time and batch Data Models.
  • Deliver real-time and non-real-time data models to analysts and data scientists who create insights and analytics applications for our stakeholders.
  • Implement and support streaming technologies such as Kafka, Spark, Cassandra & AzureML.
  • Assist in the development of deployment automation and operational support strategies.
  • Assist in the development of a big data platform in Hadoop using pipeline technologies such as Spark, Airflow, and more to support a variety of requirements and applications.
  • Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Snowflake while collaborating with analysts and data scientist in the creation of efficient data models.
  • Maintain and extend our CI / CD processes and documentation.

QUALIFICATIONS

  • 2+ years of experience with the Hadoop ecosystem (HDFS, Spark, Oozie, Impala, etc.) and big data ecosystems (Kafka, Cassandra, etc.).
  • 2+ years of experience with the Azure ecosystem (Azure ML, Azure Data Factory)
  • Expert in at least one SQL language such as T-SQL or PL / SQL.
  • Experience developing and managing data warehouses on a terabyte or petabyte scale.
  • Strong experience in massively parallel processing & columnar databases.
  • Experience building Real-Time and / or Near-Real-Time ML pipelines.
  • Experience with Python, Scala, or Java.
  • Experience with shell scripting.
  • Experience working in a Linux environment.

SKILLS

  • Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.
  • Ability to manage numerous projects concurrently and strategically, prioritizing when necessary.
  • Good communication skills.
  • Dynamic team player.
  • A passion for technology.

PLUSES

Please note that these are desirable skills and are not required to apply for the position.

  • Experience with Python based libraries such as Scikit-Learn
  • Experience with Databricks
  • Experience with Spark-ML, Jupyter Notebook, AzureML.
  • Experience in Lambda architecture.
  • Experience with CI / CD.
  • Familiar with Restful APIs.
  • Experience with Artifact Repositories.
  • Knowledge of the video game industry.
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Queens, New York

A company is looking for a Game Data Engineer to join their analytics team. ...

Promoted
Faire
New York, New York

Are you passionate about using data to shape the future of Faire's product features for small and medium businesses (SMBs)? If so, we want to talk to you! We're looking for a Senior Data Engineer with a deep expertise in designing and building data systems and a dedication to applying software devel...

Promoted
VirtualVocations
Queens, New York

A company is looking for a Principal Data Engineer to drive the design, development, and implementation of data infrastructure and solutions. ...

Promoted
Entertainment Data Oracle (EDO)
New York, New York

As a Product Engineer at EDO, you will write software that presents our world-class data to our clients. EDO's investment-grade data align advertising investments to business results - with detailed competitive, category, historical, and predictive intelligence. You will partner with our Media Analy...

Capital One
Brooklyn, New York

We are seeking Data Engineers who are passionate about marrying data with emerging technologies. Plano 3 (31063), United States of America, Plano, TexasSenior Lead Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced...

Benchmark IT - Technology Talent
New York, New York

Our direct client, a fast-growing FinTech firm, is seeking a highly motivated Data Integration Engineer to help lead the development of their APIs and clients' system integrations. Implement and maintain APIs and data models to ensure efficient data integration. This role requires a deep understandi...

Capital One
Bronx, New York

We are seeking Data Engineers who are passionate about marrying data with emerging technologies. Center 2 (19050), United States of America, McLean, VirginiaSenior Data EngineerDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced...

Ampcus
New York, New York

Engineers should have intermediate experience - years. Data competencies at the team level needed:. Kafka: data movement / stream processing. ...

Capital One
New York, New York

Team Info:We are building a platform to enable engineers and data analysts to quickly deploy real time streaming data transformation jobs within the Capital One data ecosystem. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. This will remove the need ...

Open Systems Technologies
New York, New York

The Data Engineer is responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection. At least five years' experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other area...