Client looking for 8+ Years of experience. Title : Data Engineer Duration : Contract Location : Sunnyvale, CA (Onsite) *Locals Required* Job Description : Mandatory Areas
- Hadoop- 8+ Yrs of Exp
- Spark - 8+ Yrs of Exp-
- Scala - 8+ Yrs of Exp
- GCP - 5+ Yrs of Exp
- ETL Process / Data Pipeline experience 8+ Yrs of Exp Responsibilities : As a Senior Data Engineer, you will
- Design and develop big data applications using the latest open source technologies.
- Desired working in offshore model and Managed outcome
- Develop logical and physical data models for big data platforms.
- Automate workflows using Apache Airflow.
- Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
- Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
- Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
- Mentor junior engineers on the team
- Lead daily standups and design reviews
- Groom and prioritize backlog using JIRA
- Act as the point of contact for your assigned business domain Requirements : GCP Experience
- 2+ years of recent GCP experience
- Experience building data pipelines in GCP
- GCP Dataproc, GCS & BIGQuery experience
- 5+ years of hands-on experience with developing data warehouse solutions and data products.
- 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required
- 2+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
- Experience with programming languages : Python, Java, Scala, etc.
- Experience with scripting languages : Perl, Shell, etc.
- Practice working with, processing, and managing large data sets (multi TB / PB scale).
- Exposure to test driven development and automated testing frameworks.
- Background in Scrum / Agile development methodologies.
- Capable of delivering on multiple competing priorities with little supervision.
- Excellent verbal and written communication skills.
- Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following :
- Gitflow
- Atlassian products BitBucket, JIRA, Confluence etc.
- Continuous Integration tools such as Bamboo, Jenkins, or TFS Powered by JazzHR
Staff Data Security Engineer
A company is looking for a Staff Data Security Engineer to enhance its platform security. ...
Sales Engineer
Prophecy enables all data users and makes them productive by helping develop, deploy, and observe data pipelines on cloud data platforms. Fortune 500 enterprises - including the largest institutions in banking, insurance, healthcare & life sciences, and technology - rely on Prophecy Data Transfo...
Staff Security Engineer - Nutanix Data Lens
For business owners, NDL helps reduce data blindness and gives a comprehensive view of data on data complying with security and compliance standards. Nutanix Data Lens, a new product offering, is a cloud–based data management, security and compliance solution for Nutanix unified storage – Files and ...
Data Engineer III
We are seeking Battery Modeling & Algorithm Engineer (Data Engineer III) or a very important client. DescriptionIn this position you will be expected to use a combination of advanced mathematics, machine learning, electrical engineering, and control engineering knowledge to:·Develop advanced battery...
Data Center Engineer
Knowledge of Telecom Central Offices, Data Center, Collocations and Remote Hut environments, to include engineering principles regarding power and other infrastructure. Knowledge of Telecom Central Offices, Data Center, Collocations and Remote Hut environments, to include engineering principles rega...
Software Engineer Intern (Data Management Suite-Globalization) - 2025 Summer/Fall (BS/MS)
The team is building products that cover the whole lifecycle of data pipeline, including data ingestion & integration, data development, data catalog, data security and data governance. Data engineers and data scientists could greatly boost their productivity with these products. Responsibilities:Th...
Senior Data Center Test Automation Engineer
The NVIDIA Datacenter System group is looking for a Data Center Software Development Engineer with an interest in automation, test and framework development, managing builds, driving integration, and supporting validation. Collaborating across system engineering, characterization and validation engi...
AIML - Sr Machine Learning Engineer, Data & Machine Learning Innovation
The Data and Machine Learning Innovation (DMLI) team is looking for a passionate Machine Learning Engineer to explore new methods, challenge existing metrics or protocols, and develop new insightful practices that will change how we understand data and overcome real-world ML challenges. Our work may...
Job Posting Title Senior Data Management Project Engineer
Hitachi Energy is seeking a Senior Data Management Engineer for its San Jose, CA location. Design, develop, test, integrate and document Data Management applications for electricity market and related work for customer projects, while following best engineering and software development practices. Fo...
Senior, Data Scientist - Machine Learning Engineer
The Senior Data Scientistwill lead our development efforts on deploying Machine Learning models in production environment, our other research data scientist experiment. You are experienced in ETL practices and basic data engineering. We believe all digital advertising can be targeted and accountable...