Search jobs > San Francisco, CA > Senior engineer data

Senior Core Data Engineer

SA TECHNOLOGIES
San Francisco, California, US
Full-time

SA Technologies Inc. (www.satincorp.com) is a market leader and one of the fastest growing IT consulting firms with operations in US, Canada, Mexico & India.

SAT is an Oracle Gold Partner, SAP Services Partner & IBM Certified enterprise.

A variety of soft skills and experience may be required for the following role Please ensure you check the overview below carefully.

All SA Technologies requirements are Direct Client Requirements from IT Hiring Managers. We guarantee you the best rate for your skills and performance.

Job Description

Position : Senior Core Data Engineer

Location : SFO, CA

Duration : 12 Months

Responsibilities :

  • Solid Java programmer with production-level hands-on experience on Hadoop MapReduce and HBase or Cassandra database.
  • Ingest large amounts of raw data (web logs, web pages, data feeds, etc.).
  • Run Hadoop MapReduce jobs to parse and process data (simple reporting, machine learning, etc.).
  • Load outcomes to NoSQL database (HBase / Cassandra) and serve them to other applications (live website traffic, other internal tools, etc.).

Technologies that are a must :

  • Programming language Java
  • Batch processing Hadoop MapReduce
  • Restful web services Spring Boot, Jackson

Technologies that would get our attention :

  • Programming languages : Python, Scala, Shell scripting
  • Batch Processing : Cascading / Scalding, Apache Spark
  • Stream processing AKKA, Samza, Spark Streaming
  • NoSQL MongoDB, Riak, etc.
  • Code / Build / Deployment hg, svn, sbt, bamboo, etc.

Additional Information

All your information will be kept confidential according to EEO guidelines.

J-18808-Ljbffr

6 days ago
Related jobs
Promoted
Scale AI, Inc.
San Francisco, California

As a Senior Data Engineer at Scale, you will spearhead building the company's analytical and business-intelligence infrastructure. Scale's customers process millions of tasks through our APIs, and we're looking for a talented Data Engineer to build scalable solutions to support this growth. You will...

Promoted
Lyft
San Francisco, California

We are seeking a Software Engineer to join our Map Data team, responsible for constructing and maintaining Lyftmap. This involves processing a vast volume of ride data, road network data, and real-time events to facilitate timely and precise access to essential information. We are looking for an eng...

Promoted
Forward
San Francisco, California

We are scaling our engineering team and looking for world-class engineers with experience and expertise in building scalable software solutions for real-world problems. As an early member of our engineering team, you’ll have a key role in building the future of healthcare from first principles. Forw...

Promoted
Discord
San Francisco, California

We're looking for a highly motivated, mission-focused Senior Engineer to join our Core Product team. You’ll be working with highly experienced engineering peers and cross functional partners while reporting to the Engineering Manager of Core Product. Core Product is responsible for improving the cor...

Promoted
Vouch
San Francisco, California

ETL workflows as a data analytics engineer, data engineer, or data analyst. We’re looking for someone who lives and breathes data and gets excited about data warehouses, building infrastructure to manage fast-changing data sets, and maintaining data quality. Full Time] Senior Data Analytics Engineer...

Snowflake
San Mateo, California

We are seeking talented Senior Software Engineers who are technical leaders in the big data open source community to join us to define the strategy, engage and deliver innovation into the open source community, and bring Snowflake to millions of big data professionals. Our customers want to bring mo...

Sentry
San Francisco, California

As a Senior Data Engineer in our Data and Analytics organization, you'll be a key player at the intersection of technology and business strategy. Data Engineer or similar, working with large data sets and cloud infrastructure. Leveraging your expertise, you'll design and implement robust data pipeli...

OpenAI
San Francisco, California

The ChatGPT Core Experiences team supports the OpenAI mission by innovating and evolving the Core UX design, technical architecture, and essential features of the Web, iOS, and Android ChatGPT client experiences. We are looking for a senior Android engineer to lead the development of new features an...

GEICO
San Francisco, California
Remote

Advanced experience developing new and enhancing existing data processing (data ingestion, data transformation, data storage, data management, data quality) components. Data processing/data transformation using ETL/ELT tools such as DBT (Data Build Tool), or Databricks. Senior Staff Engineer – Finan...

Guidewire
San Mateo, California

Prior experience of building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive. Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques. Design cloud-native data platform and analytics SaaS services. Own scalability, availability, and data secu...