About The Role
We are seeking a Data Engineer to join our team and leverage their expertise in Snowflake, dbt, and data transformation tools to build and maintain scalable data pipelines.
You will be responsible for extracting, transforming, and loading (ETL) data from Microsoft SQL Server (MSSQL) into our Snowflake data warehouse, ensuring clean, reliable data for analysis and reporting.
Responsibilities
- Design, develop, and maintain data pipelines using Snowflake, dbt, or Coalesce.
- Write and optimize SQL queries within dbt for efficient data transformation in Snowflake.
- Utilize Coalesce or similar data transformation tools to migrate data from MSSQL to Snowflake.
- Cleanse, validate, and transform data to ensure accuracy and consistency.
- Design and implement data models in dbt to transform raw data into analytical-ready datasets.
- Automate data pipelines and ensure their reliability and scalability.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions.
- Develop and implement unit tests for data pipelines and data models.
- Monitor and troubleshoot data pipelines for any issues.
- Document data pipelines and models for future reference.
Qualifications
- Bachelor's degree in Computer Science, Data Science, Statistics, or a related field
- Minimum 2+ years of experience as a Data Engineer or similar role.
- Proven experience with Snowflake, including writing SQL queries and leveraging its functionalities.
- Expertise in dbt, including model development, testing, and deployment.
- Experience with data transformation tools like dbt, Coalesce, or Hevo Data.
- Strong understanding of data warehousing concepts and best practices.
- Experience with ETL / ELT processes.
- Excellent SQL programming skills (T-SQL and Snowflake SQL).
- Experience with version control systems (e.g., Git).
- Familiarity with data quality concepts and techniques.
- Excellent communication and collaboration skills.
Bonus Points
- Experience with cloud platforms (e.g., AWS, Azure).
- Experience with data orchestration tools (e.g., Airflow, Luigi).
- Experience with data governance and security practices.
Senior Software Engineer ML Data Pipeline
A company is looking for a Senior Software Engineer, ML Data Pipeline. Key Responsibilities:Collaborate with perception experts and roboticists to scale solutions for L3 driving systemsArchitect and implement state-of-the-art solutions in machine learning domainsDevelop cloud services for data manag...
Cyber Risk Data Privacy Solution Engineer/Senior Consultant
Data Privacy Senior Consultant. Passionate about making a real difference in the world of data privacy? Eager to transform and fortify the privacy strategies of some of the globe's most dynamic organizations using cutting-edge technology? Imagine doing so while simultaneously boosting your career in...
Senior Software Engineer Data - Remote
A company is looking for a Senior Software Engineer, Data - RemoteKey Responsibilities:Build a cutting-edge Cloud Native platform on top of the public cloudImprove the metrics pipeline and build algorithms for autoscaling statisticsWork on autoscale and Kubernetes operator for seamless Vertical and ...
Data Protection Engineering Senior Engineer
Our rapidly evolving IT department is in search of a Data Protection (Backup) Senior Engineer with excellent time management skills and a consistent track record of setting and reaching team goals! We're looking for a candidate with Data Protection Engineering experience who can assist with and lead...
Senior Clinical Data Engineer
A national provider of critical health services supporting thousands of physicians and tens of thousands of patients is looking for a Senior Data Engineer to build and mature ETL & data pipelines for clinical, health, and insurance data. ETL/Data Pipelines Data Cleaning/Quality Control Data Serializ...
Senior Mechanical Design Engineer (Data Center HVAC)
Senior Mechanical Design Engineer (Data Center HVAC). The Senior Mechanical Design Engineer mentors junior engineers. Effectively interacts with other internal and external teams, including the design engineering, site engineering, construction management and regional operations teams, onsite suppor...
Senior Data Engineer - Artificial Intelligence
Incorporate core data management competencies including data governance, data security and data quality. Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Senior Data Engineer you will accelerate growth and transfor...
Senior Data Engineer - VP
Experience with Data Modeling, Master Data Management, Data Governance, Data Cataloging, Data Replication. The Senior Data Engineer is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. Experience with developing an...
Senior Data Engineer
Senior Data Engineer (Irving, Tx). Design and Developmethods to connect & collect data from different data sources. Work closely withdata Scientists to ensure the source data is aggregated and cleansed. Analyze andunderstanddata sources & APIs. ...
Senior Data Engineer - Hybrid
Expertise with relational databases, data transformation/manipulation. ...