Data Engineer Data Engineer

JOB TITLE : Data Engineer

LOCATION : Pleasanton, CA

DURATION : 6 Month Contract

PAY RANGE : $47-57 / hour

TOP SKILLS :

3+ years of industry experience in Data Engineering

3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes

COMPANY :

Our client is a leading provider of enterprise cloud applications for finance and human resources.

About the Role

As a Data Engineer, you will play a critical role in helping define and grow processes, methods, and outcomes for using data engineering to build robust data sources and pipelines for deriving actionable user experience insights.

You will play a pivotal role of working with a cross functional group of leaders and individuals in evolving scalable data solutions.

You will work closely with data scientists and data analysts to build a firm foundation of accessible data that is leveraged to make improvements to existing products.

Our ideal candidate is an experienced data engineer who is passionate about data and has a track record of building rich, durable data pipelines that meet the business needs.

You have the curiosity and self-motivation to continuously learn new techniques and tools to enhance our data structures and data processing.

You are a strong communicator, collaborator, and cross functional partner.

Areas of responsibility include :

Build test and implement Data Engineering ETL, Data Integrations, Data Governance, Data Quality

Build reusable Data Engineering assets and frameworks

Identify opportunities to use existing data from multiple sources to inform data governance and strategy

Work closely with Data Scientists, Product Managers, and Data Strategy leads to understand ETL / Data Integration and Engineering requirements, design, test and implement appropriate data engineering solutions.

Pipeline complex data from a variety of sources using diverse set of tools and techniques.

Enable the development of key UX metrics to provide actionable insights to improve the user experience.

Basic Qualifications include :

Bachelor’s degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field.

3+ years of industry experience in Data Engineering

3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes

The ideal candidate will have proven experience on building modern data pipelines - Ingestion, Profiling, Integration, Summarization / Aggregation, Logging, DAG

You have strong experience building Data Quality frameworks and performing Exploratory Data Analysis (EDA)

You have proven hands-on experience with cloud-based data warehousing / data lake platforms such as AWS S3, GitRepo, Lambda

Other Qualifications :

Master’s degree or PhD in Statistics, Economics, Psychology, Applied Math, Physics, Computer Science or other related field.

2+ years of industry experience in data engineering focused on enhancing products and driving innovation.

Ability to communicate impact of data enhancements and influence teams and leaders.

Creative thinker able to apply first-principles reasoning to solve complex problems.

IND123