Client looking for 8+ Years of experience.
Make sure to read the full description below, and please apply immediately if you are confident you meet all the requirements.
Title : Data Engineer
Duration : Contract
Location : Sunnyvale, CA (Onsite)
Locals Required*
Job Description : Mandatory Areas
Mandatory Areas
- Hadoop - 8+ Yrs of Exp
- Spark - 8+ Yrs of Exp
- Scala - 8+ Yrs of Exp
- GCP - 5+ Yrs of Exp
- ETL Process / Data Pipeline experience - 8+ Yrs of Exp
Responsibilities :
As a Senior Data Engineer, you will :
- Design and develop big data applications using the latest open source technologies.
- Work in an offshore model and manage outcomes.
- Develop logical and physical data models for big data platforms.
- Automate workflows using Apache Airflow.
- Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
- Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
- Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
- Mentor junior engineers on the team.
- Lead daily standups and design reviews.
- Groom and prioritize backlog using JIRA.
- Act as the point of contact for your assigned business domain.
Requirements :
- GCP Experience :
- 2+ years of recent GCP experience.
- Experience building data pipelines in GCP.
- GCP Dataproc, GCS & BIGQuery experience.
5+ years of hands-on experience with developing data warehouse solutions and data products.5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution.
2+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.Experience with programming languages : Python, Java, Scala, etc.
Experience with scripting languages : Perl, Shell, etc.Practice working with, processing, and managing large data sets (multi TB / PB scale).
Exposure to test driven development and automated testing frameworks.Background in Scrum / Agile development methodologies.
Capable of delivering on multiple competing priorities with little supervision.Excellent verbal and written communication skills.
Bachelor's Degree in computer science or equivalent experience.
The most successful candidates will also have experience in the following :
- Gitflow
- Atlassian products BitBucket, JIRA, Confluence etc.
- Continuous Integration tools such as Bamboo, Jenkins, or TFS.
J-18808-Ljbffr
Cybersecurity Data Management Engineer
A company is looking for a Cybersecurity Data Management Engineer to safeguard its critical infrastructure and enhance cybersecurity strategies. ...
Data Engineer, Financial Crimes - USDS
The perfect candidate will leverage strong data infrastructure and architecture skills to design and maintain efficient scalable data systems, strong operational skills to drive efficiency and speed, and apply strategic vision and project management expertise to ensure timely execution of complex da...
Data Engineer People Analytics
A company is looking for a Data Engineer, People Analytics for a 6-month contract. ...
Staff Software Engineer - Distributed Data Systems
As a software engineer on the Runtime team at Databricks, you will be building the next generation distributed data storage and processing systems that can outperform specialized SQL query engines in relational query performance, yet provide the expressiveness and programming abstractions to support...
Senior SRE Software Engineer - Storage and Data Services
Site Reliability Engineering (SRE) is an engineering discipline that involves designing, building, and maintaining large-scale production systems with high efficiency and availability. It encompasses various areas, including software and systems engineering practices, storage, data management, and s...
AI Data Engineer - Customer Intelligence
As a Customer Intelligence AI Data Engineer, you will be responsible for the development of our internal tooling infrastructure for AI use cases, supporting current ML/data pipelines and researching customer insights. This position is ideal for a data engineer or machine learning engineer with a str...
Sr. Frontend Engineer - Graph Data Visualisation (Remote)
We are looking for engineers who love working with lots of data and have graph visualization experience. You'll be joining the UI Framework Engineering team to work on CrowdStrike’s Graph visualization platform and build engaging experiences to visualize & navigate data. Collaborate with fellow ...
Staff Data Engineer
As a Data Engineer, you'll play a crucial role in our Data & Analytics team, tasked with crafting and implementing integrations using state-of-the-art Cloud technologies. Have basic level of expertise in the areas of data governance, data quality, MDM, information management, metadata management...
Data Infrastructure Engineer
As a Data Infrastructure Engineer, you will design, implement, and optimize a scalable infrastructure to prepare the data that powers our AI training. Join Us as a Data Infrastructure Engineer. About the Role: Data Infrastructure Engineer. You will collaborate closely with the data research team and...
Data Migration Engineer
As a Data Migration Engineer, you will be working with a team of game designers, engineers, live operations, and producers to deliver new exciting content and features to a passionate fan base. Manage the roll out of new code or server data to live products. Responsible for data migration to the Sto...