Talent.com
Lead Azure Data Engineer

Lead Azure Data Engineer

Ryan Specialty GroupUSA, Illinois, Chicago
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Position Summary

The Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst, Data Analyst, IT Teams and key stake holders. This role will lead projects and coach junior staff on build and optimize data pipelines, integrating data from various sources, ETL (Extract, Transform, Load) processes and ensuring data quality and consistency. The Lead will ensure that our data engineering practices are aligned with the latest technologies and industry best practices, focusing on performance, reliability, and efficiency.

What will your job entail?

Job Responsibilities :

  • Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives.
  • Mentor less experienced data engineers and team members, fostering a collaborative and innovative work environment.
  • Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure.
  • Manage and enhance complex SSIS packages for data integration and ETL processes, along with SSRS reports for business intelligence.
  • Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory, implementing both batch and real-time data integration processes.
  • Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments.
  • Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage, optimizing for query performance and cost-efficiency.
  • Integrate and configure Profisee Master Data Management tools within Azure, focusing on data governance and quality.
  • Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms.
  • Implement data cataloging, classification, and lineage using Azure Purview, developing data governance policies, and ensuring compliance.
  • Enhance and support Tableau reporting solutions, developing complex dashboards, and integrating with Azure data services.
  • Drive automation and process optimization using Azure services and scripting and implement CI / CD pipelines using Azure DevOps.
  • Lead SQL Server database optimization and performance tuning efforts.
  • Lead, Coach and Mentor junior staff on projects.

Work Experience and Education :

  • Bachelor's degree required, Master's degree preferred; Computer science, Information Technology or Engineering is preferred. Any other related discipline or commensurate work experience considered.
  • 12+ years of experience in Data Engineering with a Bachelor's degree, or 8 years of experience with a Master's degree is preferred.
  • Subject Matter Expert in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services.
  • Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance with Azure Purview.
  • Proven experience in Tableau and BI Reporting, and strong skills in Automation and Process
  • Licenses & Certifications :

  • Advanced Data Analytics Certifications (ADAC), SAS Statistical Business Analyst Professional Certification (SBAPC), or Cloudera Certified Professional (CCP) Data Engineer a plus.
  • Skills :

    Technical / Functional Skills :

  • Big Data Analytics
  • Leadership
  • Data Governance
  • Data Modeling
  • Data Processing
  • Data Warehousing
  • Database Management
  • Knowledge of ETL processes
  • Machine Learning
  • Predictive Analysis
  • Programming Languages
  • Behavioral Skills :

  • Critical Thinker
  • Communication
  • Relationship Building
  • Effective Communication
  • Time Management
  • Problem Solving
  • Attention to Detail
  • Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time
  • Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.

    How We Support Our Teammates

    Ryan Specialty seeks to offer our employees a comprehensive and best-in-class benefits package that helps them - and their family members - achieve their physical, financial, and emotional well-being goals. In addition to paid time off for company holidays, vacation, sick and personal days, Ryan offers paid parental leave, mental health services and more.

    The target salary range for this position is $140,000.00 - $175,000.00 annually.

    The wage range for this role considers many factors, such as training, transferable skills, work experience, licensure and certification, business needs, and market demands. The pay range is subject to change and may be modified in the future. Full-time roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards, visit our website https : / / benefits.ryansg.com / .

    We provide individuals with disabilities reasonable accommodations to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at HR@Ryansg.com

    The above is intended to describe this job's general requirements. It is not to be construed as an exhaustive statement of duties, responsibilities, or physical requirements. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

    serp_jobs.job_alerts.create_a_job

    Azure Data Engineer • USA, Illinois, Chicago

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    KenexaiChicago, IL, US
    serp_jobs.job_card.full_time
    Kenexai delivers smart, data-driven solutions that empower businesses across industries.Our mission is to combine deep, domain-specific expertise with cutting-edge technology to drive meaningful im...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer - Lead

    Data Engineer - Lead

    Omni InclusiveChicago, IL, United States
    serp_jobs.job_card.full_time
    Need solid hands-on candidates.Coding test will be part of evaluation.WS Cloud formation irflow or equivalent orchestration Informatica / Any ETL tool -.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingChicago, IL, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Lead Snowflake Data Engineer

    Lead Snowflake Data Engineer

    Omni InclusiveRosemont, IL, United States
    serp_jobs.job_card.full_time
    We are looking for a hands-on Lead Data Engineer to join our team! In this role, you will be responsible for leading the team of data engineers (Onsite / Offshore) to build new data pipelines (loadin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Insight GlobalChicago, IL, United States
    serp_jobs.job_card.full_time
    Insight Global is seeking a Lead Data Engineer for a contract to hire opportunity at one of our trading and commodities clients based in Chicago, IL. This role ideally sits local to the Chicago, IL ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Analytics Engineer

    Lead Analytics Engineer

    Hopscotch Primary CareChicago, IL, US
    serp_jobs.job_card.full_time
    At Hopscotch Primary Care, we believe great healthcare should be accessible to all people across all communities.Today, almost 20% of Americans live in a rural community, yet only 11% of physicians...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Lead Data Engineer (Python / AWS)

    Senior Lead Data Engineer (Python / AWS)

    Capital OneChicago, IL, US
    serp_jobs.job_card.full_time +1
    Senior Lead Data Engineer (Python / AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, yo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingChicago, IL, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Engineer - Snowflake

    Data Engineer - Snowflake

    Tiger AnalyticsChicago, IL, US
    serp_jobs.job_card.full_time
    Tiger Analytics is a fast-growing advanced analytics consulting firm.Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Omni InclusiveChicago, IL, United States
    serp_jobs.job_card.full_time
    Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL / ELT.Snowflake SQL - advanced SQL expertise.CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.Pyt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer AWS Azure GCP

    Data Engineer AWS Azure GCP

    CapTech ConsultingChicago, IL, United States
    serp_jobs.job_card.full_time
    CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers.We build pipelines...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Hopscotch Primary CareChicago, IL, US
    serp_jobs.job_card.full_time
    At Hopscotch Primary Care, we believe great healthcare should be accessible to all people across all communities.Today, almost 20% of Americans live in a rural community, yet only 11% of physicians...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Capital OneCHICAGO, Illinois, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    ZipRecruiterChicago, IL, United States
    serp_jobs.job_card.full_time
    Job DescriptionJob DescriptionCompany Description.CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology.At CapTech, w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Hispanic Technology Executive CouncilChicago, IL, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Analytics Engineer, Data Architecture

    Lead Analytics Engineer, Data Architecture

    VizientChicago, IL, United States
    serp_jobs.job_card.full_time
    When you're the best, we're the best.We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Snowflake Data Engineer

    Lead Snowflake Data Engineer

    eTeamRosemont, IL, United States
    serp_jobs.job_card.full_time
    We are looking for a hands-on Lead Data Engineer to join our team! In this role, you will be responsible for leading the team of data engineers (Onsite / Offshore) to build new data pipelines (loadin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    ZipRecruiterChicago, IL, United States
    serp_jobs.job_card.full_time
    Job DescriptionJob DescriptionAbout Hopscotch Primary Care .At Hopscotch Primary Care, we believe great healthcare should be accessible to all people across all communities.Today, almost 20% of Ame...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days