Search jobs > Sunnyvale, CA > Data engineer

Data Engineer (Python, Pyspark, Java)

Diverse Lynx
Sunnyvale, CA, United States
Full-time

Description

Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services.

Responsibilities

Design, implement, optimize, and maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java

Collaborate with data analysts, and engineering teams to gather requirements, and build data pipelines / services

Work closely with operation teams to support the operation of data deliverables

Ensure data integrity and quality through rigorous validation and testing procedures.

Key Qualifications

Proficiency in building data pipelines with Python and Java

Proficiency in large scale data processing technologies such as Spark, Kafka and Flink

Familiarity with RDBMS and solid experience with SQL for data manipulation and reporting

Experience building scalable solutions in cloud computing environment such as AWS EKS and S3

Experience in data analytics with strong analytical and problem-solving skills

Good to have HDFS knowledge.

Strong communication skills, team collaboration skills, and managing multiple tasks effectively

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination.

All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role.

We promote and support a diverse workforce across all levels in the company.

10 hours ago
Related jobs
Promoted
VirtualVocations
Fremont, California

A company is looking for a Data Engineer specializing in PySpark and AWS. ...

Diverse Lynx
Sunnyvale, California

Design, implement, optimize, and maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java. Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. Collaborate with data analysts, and engineering teams to gathe...

Canonical - Jobs
San Jose, California

Python and Kubernetes Specialist Engineers focused on Data, AI/ML and Analytics Solutions. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. As a software engineer on the team, you'll collabora...

People Integra LLC
Sunnyvale, California

Experience/Skills Required:Bachelor's degree in Computer Science, Information Technology, or related field and 5 years experience in computer programming, software development or related 3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data ...

E-Solutions
California, United States

We need Python developers who are heavy on the data engineering side, and developers who have used Python for complex data scenarios such as data migrations, matching, merging and collation. Role: Data Engineer with Python, FHIR & JSON. Developers should have used Python to build and manage data pip...

People Integra LLC
Sunnyvale, California

Additonal Information:What are the top 3 skills needed/required?Java, Scala, Python What skills and/or experience would separate the top candidate? Digital Marketing or E-Commerce exposure What makes a candidate profile stand out to you?Digital Marketing or E-Commerce exposure What will this person&...

BlueRose Technologies
Fremont, California

Must have Skills : Azure, ADLS, Databricks, Data Factory, ADF, Synapse, Python, SQL. Extensive experience providing practical direction within azure native services , implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Synapse/DW /Azure SQL DB, Fabric. Han...

Blue Ribbon Global Technologies
Sunnyvale, California

The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Build the infrastructure required for optimal extraction, transformation, a...

Curate Partners
San Jose, California
Remote

Strong programming experience in languages such as Java, Python, JavaScript, etc. Knowledge of Data Modeling / Data Visualization tools. ...

Oracle
Santa Clara, California

This position combines systems engineering, automation engineering, and network operations. Proficiency in any one modern language such as Java, Python, Ruby, Go. We offer unique opportunities for smart, hands-on engineers with the expertise and passion to solve difficult problems in distributed, hi...