We are hiring a Cloud Data Engineer to work nearly 100% remotely but must live in the Phoenix metro area as they will require 1 day on-site per month or 1 day every other month for team meetings or architecture sessions.
We are seeking an experienced Senior Cloud Data Engineer with a strong emphasis on Azure data services to join our dynamic, cross-functional team.
In this role, you will collaborate closely with application and business teams as part of the data team center of excellence.
Your primary focus will be on leveraging Azure technologies such as Azure Data Factory, Databricks, Synapse, and Azure Data Lake to design, develop, and maintain scalable data solutions that drive business insights and support application development.
Key Responsibilities :
1. Develop and Maintain Cloud-Based Data Solutions
- Design, build, and optimize data pipelines using Azure Data Factory , Azure Data Lake , Databricks , and Synapse Analytics to meet business and application requirements.
- Implement data processing workflows that ensure data is accurate, timely, and accessible for analytics and reporting.
2. Collaborate with Cross-Functional Teams
- Work closely with development teams to support data-related development, troubleshooting, and analysis tasks.
- Provide guidance on best practices for data architecture, security, and governance within the Azure ecosystem.
3. Optimize and Automate Data Processes
- Automate data ingestion, transformation, and storage processes using Azure Functions and other Azure tools.
- Continuously improve data workflows and infrastructure for efficiency, scalability, and performance.
4. Ensure Data Security and Compliance
- Implement and enforce data security policies, ensuring compliance with industry standards and regulations.
- Manage data retention, access, and destruction policies within Azure environments to safeguard sensitive information.
5. Mentor and Guide Team Members
- Mentor developers and product owners on cloud data engineering best practices, particularly within the Azure ecosystem.
- Stay updated on the latest Azure certifications and technologies, and help the team adopt new tools and methodologies.
6. Monitor and Troubleshoot Data Systems
- Monitor the performance and reliability of cloud-based data systems, making adjustments as needed to ensure optimal performance.
- Support after-hours and on-call duties as required, providing expertise in resolving critical data issues.
Technical Proficiencies :
- 5+ years of experience in cloud data engineering, with a focus on Azure data services.
- Strong knowledge of Azure Data Factory , Databricks , Synapse Analytics , and Azure Data Lake .
- Experience with Azure SQL , Data Studio , and Azure Functions .
- Proficiency in T-SQL and familiarity with database design principles.
- Experience with data modeling, performance tuning, and release management in cloud environments.
- Knowledge of Azure certifications such as Azure Data Fundamentals (DP-900) , Azure Developer Associate (AZ-204) , and Azure Data Engineer Associate (DP-203) is highly desirable.
Preferred Skills :
- Experience with non-relational databases and big data technologies.
- Strong understanding of data governance, security, and compliance in cloud environments.
- Familiarity with C# and .Net programming is a plus.
- Ability to work effectively in an agile development environment, with strong problem-solving and communication skills.