Search jobs > San Francisco, CA > Temporary > Data engineer

Data Engineer

Shiftcodeanalytics
San Francisco, California, US
Temporary

Interview : F2F interview

Check all associated application documentation thoroughly before clicking on the apply button at the bottom of this description.

Visa : USC, GC, GC EAD, H4, L2

This is hybrid from day -1. Must be local.

Description

It is with Client Loyalty. They are building out a scoring engine for their merchants, very similar to Rewards for issuers.

Position : Data Engineer (2)

Location : Downtown San Francisco - Three days in office. T / Th mandatory.

Duration : 12 Month Contract

Responsibilities :

  • Experience dealing with large volumes of data, from various sources, both structured and unstructured.
  • Ability to triage and talk through performance / scaling issues of dealing with data at scale.
  • Good understanding of how data will be read (file formats, partitioning, bucketing).
  • Extensive experience writing testable jobs using Spark (or equivalent) framework.
  • Programming & Scripting Languages : Java EE, Scala, Spark, SQL, Bash.
  • Software Architectures (micro-services, event driven, peer-to-peer).
  • Application Security.
  • Asynchronous Pub-Sub and Point to Point Messaging Systems.
  • Streaming within the Hadoop ecosystem is a plus.

J-18808-Ljbffr

2 days ago
Related jobs
Promoted
Cruise
San Francisco, California

As an engineer on this team, you will be responsible for building and supporting a petabyte-scale data platform in the cloud and providing powerful foundations for Cruise’s ML Data Platform tools, frameworks, and services. Responsibilities include ensuring scalable, transparent, and reliable data in...

Promoted
City and County of San Francisco
San Francisco, California

We are looking for a curious and resourceful Data Engineer to show the power of data in bringing transparency and accountability to services, while keeping equity and ethical use of data at the forefront. As the Data Engineer, you will be the technical lead on the program, working with stakeholders ...

Promoted
Google
San Francisco, California

You will help prospective and existing customers and partners understand the power of Google Cloud, develop creative cloud solutions and architectures to solve their business challenges, engage in proofs of concepts, and troubleshoot any technical questions and roadblocks related to database migrati...

Promoted
Amazon
San Francisco, California

Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases). Build proper data quality detection tools to identify data issues in the data transformation stages and fix the problems to meet pipelines / table health S...

Disney Entertainment & ESPN Technology
San Francisco, California

As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...

Guidewire
San Mateo, California

Prior experience of building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive. Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques. Design cloud-native data platform and analytics SaaS services. Own scalability, availability, and data secu...

Disney Entertainment & ESPN Technology
San Francisco, California

As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...

Unreal Gigs
San Francisco, California
Remote

Architect and implement data storage solutions, including relational databases, NoSQL databases, data warehouses, and data lakes, ensuring optimal performance, reliability, and scalability. Collaborate with cross-functional teams, including data engineers, data scientists, and business analysts, to ...

SS&C
San Francisco, California

The Senior Data Engineer is a member of a team responsible for creating a leading cloud platform with the latest big data, cloud native and machine learning technologies; building and implementing models in a production environment for a revenue-driving products; creating and maintaining overall opt...

Crunchyroll
San Francisco, California

As a Staff Site Reliability Engineer for the Data Engineering team, you will be responsible for maintaining and enhancing the reliability of our data infrastructure. You will collaborate closely with data engineers, and software engineers to develop and drive 100% automation, best practices for deep...