Search jobs > San Francisco, CA > Senior engineer data

Senior Core Data Engineer

SA TECHNOLOGIES
San Francisco, California, US
Full-time

SA Technologies Inc. (www.satincorp.com) is a market leader and one of the fastest growing IT consulting firms with operations in US, Canada, Mexico & India.

SAT is an Oracle Gold Partner, SAP Services Partner & IBM Certified enterprise.

A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully.

All SA Technologies requirements are Direct Client Requirements from IT Hiring Managers. We guarantee you the best rate for your skills and performance.

Job Description

Position : Senior Core Data Engineer

Location : SFO, CA

Duration : 12 Months

Responsibilities :

  • Solid Java programmer with production-level hands-on experience on Hadoop MapReduce and HBase or Cassandra database.
  • Ingest large amounts of raw data (web logs, web pages, data feeds, etc.).
  • Run Hadoop MapReduce jobs to parse and process data (simple reporting, machine learning, etc.).
  • Load outcomes to NoSQL database (HBase / Cassandra) and serve them to other applications (live website traffic, other internal tools, etc.).

Technologies that are a must :

  • Programming language Java
  • Batch processing Hadoop MapReduce
  • Restful web services Spring Boot, Jackson

Technologies that would get our attention :

  • Programming languages : Python, Scala, Shell scripting
  • Batch Processing : Cascading / Scalding, Apache Spark
  • Stream processing AKKA, Samza, Spark Streaming
  • NoSQL MongoDB, Riak, etc.
  • Code / Build / Deployment hg, svn, sbt, bamboo, etc.

Additional Information

All your information will be kept confidential according to EEO guidelines.

J-18808-Ljbffr

5 days ago
Related jobs
Promoted
Atlassian
San Francisco, California

We're hiring a Senior Technical Program Manager for Core Data Platform, reporting to our Head of Technical Program Management within our TPM team. You are a TPM with a background in Core Data and related Infrastructure. As a cloud service provider, we build resilience into our systems to ensure serv...

Promoted
Rippling
San Francisco, California

Build custom data pipelines to ingest data from third party data sources for our marketing and data science teams using Airflow and AWS resources. We are looking for an experienced data engineer to join our engineering team in our Revenue Operations org. As a senior member of the team, you will be l...

Promoted
Tubi Tv
San Francisco, California

With such a large catalog of content, data and machine learning are fundamental to Tubi's success, and Tubi's Data Platform is the cornerstone of all data and ML use. In this Lead Data Engineering role, you will be expected to be a hands-on leader, leading by example as you and your team build out r...

Promoted
Tbwa Chiat/Day Inc
San Francisco, California

Senior Software Engineer, Core Product TeamEngineering at Substack. Software Engineers at Substack are responsible for the core product platform, from frontend UI and testing, to APIs, low-level services, and database operations. With the support of the engineering team, develop the core Substack pr...

Promoted
Faire
San Francisco, California

Our experienced data scientists and machine learning engineers are developing solutions related to discovery, ranking, search, recommendations, ads, logistics, underwriting, and more - all with the goal of helping local retail thrive. At Faire, we're using the power of tech, data, and machine learni...

Promoted
EPAM Systems
San Francisco, California

We are hiring a Senior Big Data Engineer who will support a critical digital transformation project for one of EPAM’s top clients. Experience with integration of data from multiple data sources. Select and integrate any Big Data tools and frameworks required to provide requested capabilities. Define...

Promoted
TRM Labs
San Francisco, California

As a Senior Software Engineer on the Data Platform team, you will collaborate with an experienced team of data scientists, engineers, and product managers to build highly available and scalable data infrastructure for TRM's products and services. Full Time] Senior Software Engineer - Data Platform a...

Promoted
Trunk.io
San Francisco, California

Engineering teams that can stay focused on designing, implementing, and delivering software will build magical, high-quality projects - and they will be happier doing it. We're going after every engineering team on the planet - we're starting with smaller teams, but there are literally hundreds of t...

Promoted
Volleygames
San Francisco, California

Senior Software Engineer, Core Technology. We have multiple positions open for Senior Software Engineers on teams responsible for Shared Services (things like Auth, social graph features, and speech recognition), the backend team for the Faceoff mobile game (responsible for game logic and user manag...

Unreal Gigs
San Francisco, California
Remote

As a Senior Big Data Engineer, you'll play a pivotal role in designing, building, and maintaining our big data infrastructure and pipelines. Design, architect, and implement scalable and efficient big data infrastructure, including data lakes, data warehouses, and streaming data platforms, leveragin...