Senior Data Engineer

Are you an experienced Data Engineer on the Azure platform? Take2 Consulting is looking for a Senior Data Consultant to come join the team with one of our clients here in the Tampa Bay Area.

This role is 100% remote, but will operate on EST. If you have great communciation and people skills, as well as the technical background listed in the summary below, apply now!

The Senior Data Engineer is responsible for designing and implementing Big Data and BI solutions using the Microsoft Azure platform.

This role is 80% hands-on development and 20% architecting Big Data and BI solutions. The Senior Data Engineer is expected to evangelize and educate others on engineering design and development standards.

Senior Data Engineer is expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical leads, project managers, product owners, and resource managers.

The ideal candidate will have 10+ years of hands-on experience in designing, implementing, and delivering into production, large-scale near real-time data warehouses.

Essential Functions

• Design, develop and tune data warehouses and data pipelines within Azure
• Design and develop ML model execution pipelines using Azure Databricks
• Evangelize engineering design and development standards
• Act as a key contributor to the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
• Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations
• Produce efficient and elegant code that meets business requirements
• Author unit tests that adhere to code coverage guidelines
• Proactively communicate progress, issues, and risks to stakeholders
• Accurately estimate assignments
• Create and maintain technical documentation
• Mentor less experienced engineers
• Contribute to the growth and maturity of the Software Engineering Group
• Performs other related duties as directed

Required Skills & Competencies

• 10 years of hands-on experience designing complex data models for both OLTP and OLAP systems
• 10 years of hands-on experience designing and implementing large-scale data warehouse solutions.
• 5 years of experience in designing, developing, and tuning modern Azure data warehouses including in-depth knowledge of slowly changing dimensions and advanced performance tuning techniques
• 5 years of hands-on experience designing and implementing large-scale Azure data pipelines including Change Data Capture (CDC) solutions for structured, semi-structured, and unstructured data in batch and real-time environments
• 5 years of experience working with data governance
• 3 years of hands-on experience in Azure data services
• 3-5 years of hands-on experience with Azure Databricks, Unity Catalog, and Data Lakehouse
• 3 years of hands-on experience with Python (preferred)
• Broad experience in Microsoft SQL technologies
• Broad multi-tenant data architecture and implementation experience across different data stores, messaging systems, and data processing engines
• Experience with data integration through APIs, Web Services, SOAP, and / or REST service
• Experience using Azure DevOps and CI / CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
• Knowledge of SOA and Micros Services Application Architecture
• Ability to work in a fast-paced, collaborative team environment
• Excellent written and verbal communication skills and ability to express ideas clearly and concisely

Desired Attributes

• Strong team player with the ability to collaborate with all levels of the organization
• Possess a drive towards forward progress and delivering results while taking responsibility
• Multi-tasker with the ability to set and manage priorities
• Proactively and transparently communicate challenges and successes to product leadership
• Exhibit attention to detail
• Flexibility and willingness to help in other areas as priorities shift
• Ability to effectively operate with minimal supervision, but knowing how to keep leadership in the loop

Education or Prior Work Experience

• Bachelor's degree in CS or related field, master’s degree preferred
• 10+ years of experience with designing and developing complex data architecture solutions
• 5+ years of design and development experience with Microsoft Azure data architecture and related solutions
• 3 years of hands-on experience with Python (preferred)
5 days ago