Talent.com
Lead Azure Data Engineer

Lead Azure Data Engineer

Ryan Specialty GroupUSA, Illinois, Chicago
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Position Summary

The Lead Azure Data Engineer will be reporting to VP of Data Engineering and will be responsible for implementing data solutions and collaborating with Business Analyst, Data Analyst, IT Teams and key stake holders. This role will lead projects and coach junior staff on build and optimize data pipelines, integrating data from various sources, ETL (Extract, Transform, Load) processes and ensuring data quality and consistency. The Lead will ensure that our data engineering practices are aligned with the latest technologies and industry best practices, focusing on performance, reliability, and efficiency.

What will your job entail?

Job Responsibilities :

  • Provide technical leadership in data architecture and engineering, collaborating with solution stakeholders to align data solutions with business objectives.
  • Mentor less experienced data engineers and team members, fostering a collaborative and innovative work environment.
  • Explore and implement new technologies and practices in data engineering to continually improve our data processes and infrastructure.
  • Manage and enhance complex SSIS packages for data integration and ETL processes, along with SSRS reports for business intelligence.
  • Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory, implementing both batch and real-time data integration processes.
  • Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks environments.
  • Implement and manage data storage solutions using Delta Parquet files in Azure Data Lake Storage, optimizing for query performance and cost-efficiency.
  • Integrate and configure Profisee Master Data Management tools within Azure, focusing on data governance and quality.
  • Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms.
  • Implement data cataloging, classification, and lineage using Azure Purview, developing data governance policies, and ensuring compliance.
  • Enhance and support Tableau reporting solutions, developing complex dashboards, and integrating with Azure data services.
  • Drive automation and process optimization using Azure services and scripting and implement CI / CD pipelines using Azure DevOps.
  • Lead SQL Server database optimization and performance tuning efforts.
  • Lead, Coach and Mentor junior staff on projects.

Work Experience and Education :

  • Bachelor's degree required, Master's degree preferred; Computer science, Information Technology or Engineering is preferred. Any other related discipline or commensurate work experience considered.
  • 12+ years of experience in Data Engineering with a Bachelor's degree, or 8 years of experience with a Master's degree is preferred.
  • Subject Matter Expert in SQL Server Management, Azure Data Factory Development, Databricks Engineering, Delta Parquet File Management, and SQL Server Integration Services.
  • Proficiency in Profisee MDM Integration, Change Data Capture implementation, and data quality and governance with Azure Purview.
  • Proven experience in Tableau and BI Reporting, and strong skills in Automation and Process
  • Licenses & Certifications :

  • Advanced Data Analytics Certifications (ADAC), SAS Statistical Business Analyst Professional Certification (SBAPC), or Cloudera Certified Professional (CCP) Data Engineer a plus.
  • Skills :

    Technical / Functional Skills :

  • Big Data Analytics
  • Leadership
  • Data Governance
  • Data Modeling
  • Data Processing
  • Data Warehousing
  • Database Management
  • Knowledge of ETL processes
  • Machine Learning
  • Predictive Analysis
  • Programming Languages
  • Behavioral Skills :

  • Critical Thinker
  • Communication
  • Relationship Building
  • Effective Communication
  • Time Management
  • Problem Solving
  • Attention to Detail
  • Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment visa at this time
  • Ryan Specialty is an Equal Opportunity Employer. We are committed to building and sustaining a diverse workforce throughout the organization. Our vision is an inclusive and equitable workplace where all employees are valued for and evaluated on their performance and contributions. Differences in race, creed, color, religious beliefs, physical or mental capabilities, gender identity or expression, sexual orientation, and many other characteristics bring together varied perspectives and add value to the service we provide our clients, trading partners, and communities. This policy extends to all aspects of our employment practices, including but not limited to, recruiting, hiring, discipline, firing, promoting, transferring, compensation, benefits, training, leaves of absence, and other terms, conditions, and benefits of employment.

    How We Support Our Teammates

    Ryan Specialty seeks to offer our employees a comprehensive and best-in-class benefits package that helps them - and their family members - achieve their physical, financial, and emotional well-being goals. In addition to paid time off for company holidays, vacation, sick and personal days, Ryan offers paid parental leave, mental health services and more.

    The target salary range for this position is $140,000.00 - $175,000.00 annually.

    The wage range for this role considers many factors, such as training, transferable skills, work experience, licensure and certification, business needs, and market demands. The pay range is subject to change and may be modified in the future. Full-time roles are eligible for bonuses and benefits. For additional information on Ryan Specialty Total Rewards, visit our website https : / / benefits.ryansg.com / .

    We provide individuals with disabilities reasonable accommodations to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment in accordance with applicable law. Please contact us to request an accommodation at HR@Ryansg.com

    The above is intended to describe this job's general requirements. It is not to be construed as an exhaustive statement of duties, responsibilities, or physical requirements. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions.

    serp_jobs.job_alerts.create_a_job

    Azure Data Engineer • USA, Illinois, Chicago

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Lead Analytics Engineer, Data Architecture

    Lead Analytics Engineer, Data Architecture

    Vizient, Inc.Chicago, IL, United States
    serp_jobs.job_card.full_time
    When you're the best, we're the best.We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents. We provide extensive opportunities for ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    Spectraforce TechnologiesAbbott Park, IL, United States
    serp_jobs.job_card.full_time
    Location : Chicago, IL (Remote).We're launching a focused 3-month initiative to : .Bulk-ingest over 50,000 supplier contracts into SAP Ariba, with metadata extraction powered by OCR.Design and implem...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer - Lead

    Data Engineer - Lead

    Omni InclusiveChicago, IL, United States
    serp_jobs.job_card.full_time
    Need solid hands-on candidates.Coding test will be part of evaluation.WS Cloud formation irflow or equivalent orchestration Informatica / Any ETL tool -.serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Lead Snowflake Data Engineer

    Lead Snowflake Data Engineer

    Omni InclusiveRosemont, IL, United States
    serp_jobs.job_card.full_time
    We are looking for a hands-on Lead Data Engineer to join our team! In this role, you will be responsible for leading the team of data engineers (Onsite / Offshore) to build new data pipelines (loadin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Insight GlobalChicago, IL, United States
    serp_jobs.job_card.full_time
    Insight Global is seeking a Lead Data Engineer for a contract to hire opportunity at one of our trading and commodities clients based in Chicago, IL. This role ideally sits local to the Chicago, IL ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Lead Data Engineer (Python / AWS)

    Senior Lead Data Engineer (Python / AWS)

    Capital OneChicago, IL, US
    serp_jobs.job_card.full_time +1
    Senior Lead Data Engineer (Python / AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, yo...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer (AWS, Azure, GCP)

    Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingChicago, IL, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Senior Solutions Engineer

    Senior Solutions Engineer

    Storm3Mundelein, IL, US
    serp_jobs.job_card.full_time
    F4BC; Series A HealthTech | Clinical Data Intelligence Platform.F30D; San Francisco (Hybrid | US Only).F4B0; $160,000+ (base + benefits + equity). This Series A HealthTech company is raising the qua...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    CapTech ConsultingChicago, IL, US
    serp_jobs.job_card.full_time
    CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do a...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Lead Data Engineer

    Lead Data Engineer

    Omni InclusiveChicago, IL, United States
    serp_jobs.job_card.full_time
    Snowflake SQL, Data warehouse, Python, AWS-Lambda, ETL / ELT.Snowflake SQL - advanced SQL expertise.CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.Pyt...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer AWS Azure GCP

    Data Engineer AWS Azure GCP

    CapTech ConsultingChicago, IL, United States
    serp_jobs.job_card.full_time
    CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers.We build pipelines...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Capital OneChicago, IL, US
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,.At Capital One, you'l...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Lead Data Engineer (AWS, Azure, GCP)

    Lead Data Engineer (AWS, Azure, GCP)

    ZipRecruiterChicago, IL, United States
    serp_jobs.job_card.full_time
    Job DescriptionJob DescriptionCompany Description.CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology.At CapTech, w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Engineer (AWS)

    Senior Manager, Data Engineer (AWS)

    Hispanic Technology Executive CouncilChicago, IL, United States
    serp_jobs.job_card.full_time +1
    Senior Manager, Data Engineer (AWS).Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterat...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer Lead

    Data Engineer Lead

    Old National BankChicago, IL, United States
    serp_jobs.job_card.full_time
    US-MN-Lake Elmo | US-MN-Minneapolis | US-MN-Saint Paul | US-MN-St Louis Park | US-IL-Chicago | US-IN-Evansville.Old National Bank has been serving clients and communities since 1834.With over $70 b...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data and Analytics Manager

    Data and Analytics Manager

    Bel Brands USAElk Grove Village, IL, United States
    serp_jobs.job_card.full_time
    The Bel Group is a major player in the food industry through portions of dairy, fruit and plant-based products, and one of the world leaders in branded cheeses. Its portfolio of differentiated and i...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Analytics Engineer, Data Architecture

    Lead Analytics Engineer, Data Architecture

    VizientChicago, IL, United States
    serp_jobs.job_card.full_time
    When you're the best, we're the best.We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authe...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Snowflake Data Engineer

    Lead Snowflake Data Engineer

    eTeamRosemont, IL, United States
    serp_jobs.job_card.full_time
    We are looking for a hands-on Lead Data Engineer to join our team! In this role, you will be responsible for leading the team of data engineers (Onsite / Offshore) to build new data pipelines (loadin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30