Data Engineer
Job Description : Bachelor's degree or higher or combination of relevant education, experience, and training in Computer Science.
6+ years experience in Data Engineering.
4+ years of experience working with Python specifically related to data processing with proficiency in Python Libraries - Pandas, NumPy, PySpark, PyOdbc, PyMsSQL, Requests, Boto3, SimpleSalesforce, Json.
3+ years of experience in Data Warehouse technologies - Databricks and Snowflake.
Strong Data Engineering Fundamentals (ETL, Modelling, Lineage, Governance, Partitioning & Optimization, Migration).
Strong Databricks-specific skills (Apache Spark, DB SQL, Delta Lake, Delta Share, Notebooks, Workflows, RBAC, Unity Catalog, Encryption & Compliance).
Strong SQL (SQL, performance, Stored Procedures, Triggers, schema design) skills and knowledge of one of more RDBMS and NoSQL DBs like MSSQL / MySQL and DynamoDB / MongoDB / Redis.
Cloud Platform Expertise : AWS and / or Azure.
Experience in one or more ETL tools like Apache Airflow / AWS Glue / Azure Data Factory / Talend / Alteryx.
Excellent knowledge of coding and architectural design patterns.
Passion for troubleshooting, investigation and performing root-cause analysis.
Excellent written and verbal communication skills.
Ability to multitask in a high energy environment.
Agile methodologies and knowledge of Git, Jenkins, GitLab, Azure DevOps and tools like Jira / Confluence.
Nice to have :
Tools like - Collibra, Hackolade.
Migration Strategy and Tooling
Data Migration Tools : Experience with migration tools and frameworks or custom-built solutions to automate moving data from Snowflake to Databricks.
Testing and Validation : Ensuring data consistency and validation post-migration with testing strategies like checksums, row counts, and query performance benchmarks
Comments for Suppliers : Preferred Beaverton WHQ - Please note if local
If Remote, must work PST hours - please confirm in notes willingness to work PST hours
Will be working with 2 lead engineers, one FTE engineer and 4 other ETWs
Senior Software Engineer – Cloud Data Pipeline
As part of a high performing global team, the right candidate will play a significant role as Calix Cloud Data Engineer involved in architecture design, implementation, technical leadership in data ingestion, extraction, and transformation domain. Candidate should have hands on experience implementi...
Staff Data Infrastructure Engineer
Data Infrastructure Engineer or related roles like Platform Engineer, SRE, DevOps or Backend Engineer. Staff Data Infrastructure Engineer. Staff Data Infrastructure Engineer. Staff Data Infrastructure Engineer. ...
Junior Data Engineer
Web Analyst, Marketing Analyst, Data Analyst, Support Engineer, Data Engineer, or similar roles in the Marketing Area. Data visualization skills (Google Data Studio, Superset, Tableau). Improvado gathers, organizes, and untangles marketing data to deliver instant insights through BI and AI, helping ...
Senior Data Engineer
Implement best practices for end-to-end data pipe management on various data lakes, warehouses and relational databases. Enable processes for monitoring, exception management across end to end data pipe build to ensure integrity and reliability of data engineering solutions . Senior Data Engineer or...
Master Data Quality and Optimization Engineer
Implement and oversee data quality tools and technologies to automate data quality checks and enhance data management capabilities. Proven experience (5+ years) in data quality management, master data management, or data governance roles. We are seeking a proactive and detail-oriented Master Data Qu...
Azure/Snowflake Data Warehouse Engineer
Proven experience (5+ years) in data engineering, with a focus on data warehousing, ETL, and data modeling. We are seeking a skilled Senior Cloud-Based Data Engineer to join our dynamic technical team that supports the Investment Management line of business and the transformation initiatives current...
Data Engineer (L5) - Growth Insights and Foundations
You possess a strong data intuition and know how to apply your analytical skills and data engineering fundamentals to support building high quality data products. The Growth Insights and Foundations Data Engineering team ensures the availability of critical data to enhance "in-the-moment" experience...
Ceph/OpenShift Data Foundations Support Engineer
The Red Hat Ceph team is looking for experienced, enterprise-level engineers with a background in Ceph, OpenShift Data Foundations and/or software-defined storage (SDS) technologies to join us as a Senior Technical Support Engineer in North America. As a Senior Technical Support Engineer you’ll work...
Senior Electrical Engineer- Mission Critical Data Center Program Lead
Senior Electrical Engineer- Mission Critical Data Center Program Lead. Our mission is to engineer and commission “green buildings and data center campuses that work. Strong background in electrical engineering and designing data centers including ancillary power [EM1] distribution systems including ...
Data Engineer (L5) - Growth
You possess a strong data intuition and apply your analytical and data engineering skills to translate business problems into scalable engineering solutions. The Growth Data Engineering team is responsible for data that is critical in driving customer acquisition and optimizing the signup experience...