Talent.com
serp_jobs.error_messages.no_longer_accepting
Databricks Data Engineer - Manager - Consulting - Location Open (New York)

Databricks Data Engineer - Manager - Consulting - Location Open (New York)

EYNew York, NY, US
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.part_time
job_description.job_card.job_description

Databricks Data Engineer - Manager - Consulting - Location Open

At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

Technology Data and Decision Science Data Engineering Manager

We are looking for a dynamic and experienced Manager of Data Engineering to lead our team in designing and implementing complex cloud analytics solutions with a strong focus on Databricks. The ideal candidate will possess deep technical expertise in data architecture, cloud technologies, and analytics, along with exceptional leadership and client management skills.

The opportunity :

In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that business requirements are translated into effective technical solutions. Key responsibilities include :

  • Understanding and analyzing business requirements to translate them into technical requirements.
  • Designing, building, and operating scalable data architecture and modeling solutions.
  • Staying up to date with the latest trends and emerging technologies to maintain a competitive edge.

Key responsibilities :

As a Data Engineering Manager, you will play a crucial role in managing and delivering complex technical initiatives. Your time will be spent across various responsibilities, including :

  • Leading workstream delivery and ensuring quality in all processes.
  • Engaging with clients on a daily basis, actively participating in working sessions, and identifying opportunities for additional services.
  • Implementing resource plans and budgets while managing engagement economics.
  • This role offers the opportunity to work in a dynamic environment where you will face challenges that require innovative solutions. You will learn and grow as you guide others and interpret internal and external issues to recommend quality solutions. Travel may be required regularly based on client needs.

    Skills and attributes for success :

    To thrive in this role, you should possess a blend of technical and interpersonal skills. The following attributes will make a significant impact :

  • Lead the design and development of scalable data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
  • Oversee the architecture of complex cloud analytics solutions, ensuring alignment with business objectives and best practices.
  • Manage and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement.
  • Collaborate with clients to understand their analytics needs and deliver tailored solutions that drive business value.
  • Ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance.
  • Drive end-to-end data pipeline development, including data ingestion, transformation, and storage, leveraging Databricks and other cloud services.
  • Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts and project progress.
  • Manage client relationships and expectations, ensuring high levels of satisfaction and engagement.
  • Stay abreast of the latest trends and technologies in data engineering, cloud computing, and analytics.
  • Strong analytical and problem-solving abilities.
  • Excellent communication skills, with the ability to convey complex information clearly.
  • Proven experience in managing and delivering projects effectively.
  • Ability to build and manage relationships with clients and stakeholders.
  • To qualify for the role, you must have :

  • Bachelor's degree in computer science, Engineering, or a related field required; Master's degree preferred.
  • Typically, no less than 4 - 6 years relevant experience in data engineering, with a focus on cloud data solutions and analytics.
  • Proven expertise in Databricks and experience with Spark for big data processing.
  • Strong background in data architecture and design, with experience in building complex cloud analytics solutions.
  • Experience in leading and managing teams, with a focus on mentoring and developing talent.
  • Strong programming skills in languages such as Python, Scala, or SQL.
  • Excellent problem-solving skills and the ability to work independently and as part of a team.
  • Strong communication and interpersonal skills, with a focus on client management.
  • Required expertise for managerial role :

  • Strategic Leadership : Ability to align data engineering initiatives with organizational goals and drive strategic vision.
  • Project Management : Experience in managing multiple projects and teams, ensuring timely delivery and adherence to project scope.
  • Stakeholder Engagement : Proficiency in engaging with various stakeholders, including executives, to understand their needs and present solutions effectively.
  • Change Management : Skills in guiding clients through change processes related to data transformation and technology adoption.
  • Risk Management : Ability to identify potential risks in data projects and develop mitigation strategies.
  • Technical Leadership : Experience in leading technical discussions and making architectural decisions that impact project outcomes.
  • Documentation and Reporting : Proficiency in creating comprehensive documentation and reports to communicate project progress and outcomes to clients.
  • Large-scale implementation programs :

  • Enterprise Data Lake Implementation : Led the design and deployment of a cloud-based data lake solution for a Fortune 500 retail client, integrating data from multiple sources (e.g., ERPs, POS systems, e-commerce platforms) to enable advanced analytics and reporting capabilities.
  • Real-Time Analytics Platform : Managed the development of a real-time analytics platform using Databricks for a financial services organization, enabling real-time fraud detection and risk assessment through streaming data ingestion and processing.
  • Data Warehouse Modernization : Oversaw the modernization of a legacy data warehouse to a cloud-native architecture for a healthcare provider, implementing ETL processes with Databricks and improving data accessibility for analytics and reporting.
  • Ideally, you'll also have :

  • Experience with advanced data analytics tools and techniques.
  • Familiarity with machine learning concepts and applications.
  • Knowledge of industry trends and best practices in data engineering.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
  • Knowledge of data governance and compliance standards.
  • Experience with machine learning frameworks and tools.
  • What we look for :

    We seek individuals who are not only technically proficient but also possess the qualities of top performers, including a strong sense of collaboration, adaptability, and a passion for continuous learning. If you are driven by results and have a desire to make a meaningful impact, we want to hear from you.

    What we offer you :

    At EY, we'll develop you with future-focused skills and equip you with world-class experiences. We'll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams.

    We offer a comprehensive compensation and benefits package where you'll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $125,500 to $230,200. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $150,700 to $261,600. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.

    Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.

    Under our flexible vacation policy, you'll decide how much vacation time you need based on your own personal circumstances. You'll also be granted time off for designated EY Paid Holidays, Winter / Summer breaks, Personal / Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

    serp_jobs.job_alerts.create_a_job

    Manager Location • New York, NY, US

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Data Infrastructure Engineer

    Data Infrastructure Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Software Engineer - Data Infrastructure.Key Responsibilities Identify and implement improvements to system's cost efficiency, reducing data storage and processing costs...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Clinical Data Engineer

    Clinical Data Engineer

    VirtualVocationsJamaica, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Clinical Data Engineer who will serve as a technical expert in building data pipelines for clinical data management. Key Responsibilities Build and maintain data pipelin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Data Engineer

    Senior Data Engineer

    VirtualVocationsPaterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Data Engineer to build scalable data solutions and pipelines in a remote environment.Key Responsibilities Build and maintain CI / CD pipelines and design scalable ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Data Engineer Contractor

    Data Engineer Contractor

    VirtualVocationsJamaica, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for an Independent Contractor, Data Engineer, Business Operations.Key Responsibilities Build and maintain a scalable Databricks lakehouse for business operations data Design...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Senior Databricks Architect

    Senior Databricks Architect

    VirtualVocationsBronx, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Lead Consultant (Databricks Architect).Key Responsibilities Serve as the technical lead for project teams, ensuring high-quality execution and alignment with bes...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Salesforce Data Cloud Engineer

    Salesforce Data Cloud Engineer

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Salesforce CDP developer to lead integration across multiple markets and support DevOps initiatives. Key Responsibilities Implement solution architecture and integrate v...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Management Consultant - Data Analytics

    Management Consultant - Data Analytics

    VirtualVocationsAstoria, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Management Consultant - Data Analytics, AI / ML.Key Responsibilities Support project managers with Agile planning, scheduling, and tracking of enterprise-level work effor...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior Manager, Data Platform

    Senior Manager, Data Platform

    VirtualVocationsYonkers, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Manager, Data Platform.Key Responsibilities Develop and evolve the architecture of a Snowflake-based data warehouse to support real-time analytics and compliance...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Data Engineer III

    Data Engineer III

    VirtualVocationsAstoria, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer III to design, develop, and maintain data pipelines and systems.Key Responsibilities Design, develop, and maintain data pipelines and infrastructure using...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Analytics Engineer

    Senior Analytics Engineer

    VirtualVocationsPaterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Analytics Engineer to lead the design and implementation of scalable data models and pipelines. Key Responsibilities Lead complex technical implementations and sh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer (AI / ML)

    Data Engineer (AI / ML)

    VirtualVocationsStaten Island, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer (AI / ML) 2 to support the Generative AI for Forms SBIR project by designing and maintaining data infrastructure for AI applications.Key Responsibilities De...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Azure Data Engineer

    Azure Data Engineer

    VirtualVocationsYonkers, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for an Azure Data Engineer to implement data solutions in Azure and support Infrastructure as Code initiatives. Key Responsibilities : Design, develop, and implement integratio...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    STRONG POINT CONSULTING INC.Union City, NJ, US
    serp_jobs.job_card.full_time
    Job Description : We are looking for Data Engineer supporting the development and maintenance of Enterprise Data Hub within the insurance domain. The ideal candidate will have strong experience in AW...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer

    Data Engineer

    VirtualVocationsPaterson, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer - Remote.Key Responsibilities Design, implement, and maintain scalable ETL / ELT pipelines for structured and unstructured data sources Collaborate with cr...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Data Engineer II

    Data Engineer II

    VirtualVocationsJamaica, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Engineer II who will contribute to solution design architecture and data standards implementation. Key Responsibilities Support and maintain operational availabilit...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Databricks Engineer / Cloud Data Engineer (Remote).Key Responsibilities Design, build, and optimize data pipelines using Databricks, Apache Spark, and Delta Lake...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Lead Data and ML Engineer

    Lead Data and ML Engineer

    VirtualVocationsYonkers, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Lead Data / ML Engineer to build scalable, cost-efficient systems for transforming ad data into reliable intelligence. Key Responsibilities Design, build, and maintain sca...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Data Science Engineer

    Data Science Engineer

    VirtualVocationsNewark, New Jersey, United States
    serp_jobs.job_card.full_time
    A company is looking for a Data Science Engineer to implement data science and machine learning solutions.Key Responsibilities Collaborate with teams to understand business requirements and impro...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Cloud Data Operations Engineer

    Cloud Data Operations Engineer

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Cloud Data Operations Engineer (Technology Specialist I).Key Responsibilities Support the planning, design, implementation, and deployment of Data Cloud services on Mic...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Principal Data Engineer

    Principal Data Engineer

    VirtualVocationsFlushing, New York, United States
    serp_jobs.job_card.full_time
    A company is looking for a Principal Data Engineer, MA or Remote.Key Responsibilities Design, develop, implement, optimize, and maintain data integrations, pipelines, and solutions Collaborate w...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30