Data Engineer
Job Description : Bachelor's degree or higher or combination of relevant education, experience, and training in Computer Science.
6+ years experience in Data Engineering.
4+ years of experience working with Python specifically related to data processing with proficiency in Python Libraries - Pandas, NumPy, PySpark, PyOdbc, PyMsSQL, Requests, Boto3, SimpleSalesforce, Json.
3+ years of experience in Data Warehouse technologies - Databricks and Snowflake.
Strong Data Engineering Fundamentals (ETL, Modelling, Lineage, Governance, Partitioning & Optimization, Migration).
Strong Databricks-specific skills (Apache Spark, DB SQL, Delta Lake, Delta Share, Notebooks, Workflows, RBAC, Unity Catalog, Encryption & Compliance).
Strong SQL (SQL, performance, Stored Procedures, Triggers, schema design) skills and knowledge of one of more RDBMS and NoSQL DBs like MSSQL / MySQL and DynamoDB / MongoDB / Redis.
Cloud Platform Expertise : AWS and / or Azure.
Experience in one or more ETL tools like Apache Airflow / AWS Glue / Azure Data Factory / Talend / Alteryx.
Excellent knowledge of coding and architectural design patterns.
Passion for troubleshooting, investigation and performing root-cause analysis.
Excellent written and verbal communication skills.
Ability to multitask in a high energy environment.
Agile methodologies and knowledge of Git, Jenkins, GitLab, Azure DevOps and tools like Jira / Confluence.
Nice to have :
Tools like - Collibra, Hackolade.
Migration Strategy and Tooling
Data Migration Tools : Experience with migration tools and frameworks or custom-built solutions to automate moving data from Snowflake to Databricks.
Testing and Validation : Ensuring data consistency and validation post-migration with testing strategies like checksums, row counts, and query performance benchmarks
Comments for Suppliers : Preferred Beaverton WHQ - Please note if local
If Remote, must work PST hours - please confirm in notes willingness to work PST hours
Will be working with 2 lead engineers, one FTE engineer and 4 other ETWs
Data Engineer
The Data Engineer will play a key role in developing a plan for a connected EPH data ecosystem, including connecting NPAIHB’s ArcGIS Online environment to tribes’ Esri Enterprise environments, connecting GIS data to environmental services data, and connecting EPH data to NPAIHB’s Data Hub, a newly c...
Data Engineer (L5) - Growth Insights and Foundations
You possess a strong data intuition and know how to apply your analytical skills and data engineering fundamentals to support building high quality data products. The Growth Insights and Foundations Data Engineering team ensures the availability of critical data to enhance "in-the-moment" experience...
Azure/Snowflake Data Warehouse Engineer
Proven experience (5+ years) in data engineering, with a focus on data warehousing, ETL, and data modeling. We are seeking a skilled Senior Cloud-Based Data Engineer to join our dynamic technical team that supports the Investment Management line of business and the transformation initiatives current...
Staff Software Engineer - Data Infrastructure/Data Products
The Data Infrastructure team is looking to hire a Staff software Engineer who is excited to solve large scale batch and streaming data challenges. Our community of users generates over B analytics events per day, each of which is ingested by the Data Infrastructure team into a data warehouse that se...
Data Engineer
Building data architectures, and data pipelines to collectively bring together data. Experience in data engineering and cloud data processing services (Azure Cloud Platform). Experience building and optimizing 'big data' data pipelines, architectures, and data sets. Performance/security-oriented dat...
Senior Data Engineer, NoSQL, TCGplayer
Members of this team partner with other teams to define appropriate datastore infrastructure for applications, create efficient and scalable database and data flow designs, resolve scaling or performance challenges as they arise in existing systems, and generally support effective datastore usage in...
Software Engineer (L5), Data Analytics & GenAI Tools
Within the Infrastructure Engineering organization, our Data Platform exists to maximize the value of data throughout Netflix by improving the productivity and innovation of Netflix engineers, data scientists, machine learning practitioners, and business users. The mission of the Data Platform’s Gen...
Senior Big Data Engineer
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Align with security, da...
Senior Data Engineer
Background in data analysis or data science to support cross-functional data needs. We are seeking a Senior Data Engineer to join our team. Create tooling that will allow the data team to easily access data from multiple complex warehouses. Python for data engineering tasks and automation. ...
Senior Data Engineer
We are looking for an experienced and innovative Senior Data Engineer to extend the data warehouse and build streaming and batch data products that will revolutionize cyber security. Maintain and extend the data warehouse to serve data insights to various stakeholders. Support existing production pr...