Search jobs > Austin, TX > Data engineer python

Data Engineer Python PySpark Java

Purple Drive
Austin, USA
Full-time

Description

Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services.

Responsibilities

Design implement optimize and maintain data pipelines and reports using Python SQL Java Spark PySpark Java

Collaborate with data analysts and engineering teams to gather requirements and build data pipelines / services

Work closely with operation teams to support the operation of data deliverables

Ensure data integrity and quality through rigorous validation and testing procedures.

Key Qualifications

Proficiency in building data pipelines with Python and Java

Proficiency in large scale data processing technologies such as Spark Kafka and Flink

Familiarity with RDBMS and solid experience with SQL for data manipulation and reporting

Experience building scalable solutions in cloud computing environment such as AWS EKS and S3

Experience in data analytics with strong analytical and problemsolving skills

Good to have HDFS knowledge.

Strong communication skills team collaboration skills and managing multiple tasks effectively

5 days ago
Related jobs
Purple Drive
Austin, Texas

Design implement optimize and maintain data pipelines andreports using Python SQL Java Spark PySpark Java. Looking for a Data Engineer who has a passion for buildingscalable and high performing data pipelines and data services. Collaborate with data analysts and engineering teams togather requiremen...

Diverse Lynx
Austin, Texas

Data Engineer (Python,Java, SQL,Spark, PySpark, Java Spark). Design, implement, optimize, and maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java. Looking for a Data Engineer who has a passion for building scalable and high performing data pipelines and data services. C...

Syntricate Technologies Inc
Austin, Texas

Design, implement, optimize, and maintain data pipelines and reports using Python, SQL, Java, Spark, PySpark, Java Collaborate with data analysts, and engineering teams to gather requirements, and build data pipelines/services Work closely with operation teams to support the operation of data delive...

Intone Networks
Austin, Texas

Role: Python Data Engineer + GCPLocation: Austin TX (100% Onsite from Day 1)FTE Only Job Description:10+ Years experience with strong focus on Python coding and software development. Develop programs for ETL/data processing in Python. Hands-on extensive experience with Python language and librarie...

Hard Rock Digital
TX, United States

We're seeking a Staff Data Engineer to join our rapidly expanding data engineering team. You'll work with massively distributed datasets, architect and implement big data infrastructure, and apply your passion for data and sports to drive our success. Design, develop, and maintain scalable data pipe...

Delta System and Software Inc.
TX, United States

Cloud Engineer - Java or Python/API/Kafka/AWS</b></p> </td> </tr> <tr> <td style="border:solid windowtext 1. Need heavy Kafka experience</b></li> <li><b>Strong AWS lambda/cloud native</b></li> <li><b>Java/Go/Python...

Lorven Technologies
Austin, Texas

Snowflake, Python, Tableau, Big data processing, Python, Pyspark, ETL, Hadoop. Position: Data Engineer with Snowflake, Python and Tableau. Data Engineer with Snowflake, Python and Tableau. They will be building ETL's , Snowflake structures, Tableau reports and may be automation opportunities using P...

Curate Partners
Austin, Texas
Remote

Strong programming experience in languages such as Java, Python, JavaScript, etc. Knowledge of Data Modeling / Data Visualization tools. ...

Promoted
Raytheon
Lakeway, Texas

Typically requires a Bachelor’s degree in Science, Technology, Engineering or Mathematics (STEM) and 5 years of relevant software engineering experience. As a Senior Software Engineer, you have the opportunity to directly impact the world around you and contribute to classified programs and technolo...

Promoted
Apple
Austin, Texas

Apple's AML team is looking for a talented and enthusiastic Software Engineer to join the team building AI and ML models and applications serving an inference platform. In this role, you will get exposure to the intersection of software engineering, ML and AI, MLOps, and cloud-native development. Yo...