Data Architect, Databricks SME

At EY, we’re all in to shape your future with confidence.

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

The opportunity

As an EY Enterprise Data Architect within the EY SAP Enterprise Data Management Initiative, you will lead the definition, design, and execution of scalable data architecture strategies to support enterprise-wide data migration and transformation programs. This role ensures data integrity, consistency, scalability, and alignment with the organization’s enterprise data standards, while enabling long-term data governance.

As part of this role, you will work closely with a high-performing team that is building a modern, enterprise-grade data platform using products from leading providers such as Microsoft, Nvidia, Databricks, Snowflake, AWS, and Google. You will ensure that platform-level design decisions align with EY’s enterprise strategy while enabling seamless integration between SAP and modern cloud ecosystems.

You will collaborate with technical, functional, and business teams to design optimal data models, flows, and frameworks that support SAP BDC processes and accelerate digital transformation.

As a Databricks Subject Matter Expert (SME), you will be the technical authority and hands-on expert driving the design, development, and optimization of the data platform on the Databricks Unified Analytics platform.

You will work closely with enterprise architects, data engineers, and SAP BDC teams to leverage Databricks’ capabilities for scalable ETL, advanced analytics, and AI / ML workloads. Your role is critical in enabling seamless data integration, processing, and transformation between SAP systems and cloud-based data lakes and warehouses.

The team you join is building an enterprise-grade data platform incorporating technologies from Microsoft, Nvidia, Snowflake, AWS, and Google alongside Databricks to support mission-critical SAP BDC data migration and analytics initiatives.

Your key responsibilities

Lead the end-to-end data architecture strategy across SAP BDC initiatives, including data modeling, transformation, and governance.

Define target and transition architectures for both SAP and non-SAP data domains, integrating with modern platforms such as Azure, AWS, Snowflake, and Databricks.

Ensure data platform alignment with architectural principles across hybrid cloud environments, leveraging third-party tools from Microsoft, Nvidia, Google, and others.

Design and validate data flows, lineage, and integration points between legacy systems, SAP S / 4HANA, and cloud-based platforms.

Collaborate with migration teams to drive effective ETL / ELT strategy and data quality frameworks, ensuring consistency across enterprise systems.

Identify and mitigate data risks, including data duplication, data loss, latency, or security compliance gaps.

Guide tool selection, integration architecture, and usage of cloud-native services (e.g., Azure Data Factory, BigQuery, Snowpark, Databricks notebooks) to support data lifecycle processes.

Lead the design and implementation of data pipelines, notebooks, and workflows on the Databricks platform supporting SAP data migration and analytics use cases.

Develop, optimize, and tune Spark jobs for large-scale, distributed data processing.

Collaborate with data architects to align Databricks solutions with enterprise data governance and architecture principles.

Enable data engineers and scientists by building reusable libraries, APIs, and data transformation frameworks using Databricks and related technologies.

Integrate Databricks with SAP data sources and external platforms such as Snowflake, Azure Data Lake, and AWS S3.

Establish and promote best practices around security, cost optimization, and performance on Databricks.

Participate in tooling and automation efforts such as CI / CD pipelines for Databricks assets.

Provide training, mentorship, and knowledge sharing to junior team members and other stakeholders.

Stay current with Databricks and Apache Spark ecosystem updates and innovations.

Collaborate in cross-functional teams leveraging NVIDIA GPU acceleration or AI / ML frameworks integrated with Databricks.

Skills and attributes for success

Strong background in enterprise data architecture and SAP data management (SAP ECC, S / 4HANA, MDG, BW / 4HANA).

Experience working with cloud providers and platforms : Microsoft Azure, AWS, Google Cloud, Snowflake, Nvidia RAPIDS, Databricks.

Proficiency in data modeling (conceptual, logical, physical), data governance, and metadata management.

Experience designing and governing large-scale data migration and transformation initiatives.

Knowledge of data migration tools such as SAP BODS, LSMW, IDocs, or CPI.

Solid understanding of data privacy and compliance standards (GDPR, HIPAA, etc.).

Strong leadership, stakeholder management, and cross-functional collaboration skills.

Familiarity with architecture frameworks such as TOGAF or DAMA-DMBOK.

Strong expertise in Databricks platform and Apache Spark (Scala, Python, or SQL).

Experience designing and developing large-scale ETL pipelines and batch / streaming data workflows.

Familiarity with cloud ecosystems, particularly Azure, AWS, or GCP, and integrating Databricks within these environments.

Knowledge of data architecture, governance, and security practices on cloud data platforms.

Ability to troubleshoot and optimize Spark job performance and resource utilization.

Understanding of data science and machine learning workflows on Databricks is a plus.

Strong communication skills to collaborate with SAP, data architecture, and delivery teams.

Other Requirements :

Experience working in SAP data migration or BDC projects is advantageous.

Agile mindset and experience working in DevOps / CI-CD environments.

Relevant certifications such as Databricks Certified Associate Developer or Professional Data Engineer are beneficial.

Ability to work across global teams and adapt to distributed delivery models.

Job Requirements : Education :

BS / MS in Computer Science, Data Engineering, or related field.

Experience :

12–15+ years of experience in enterprise data architecture, with at least 5 years in SAP BDC or related data transformation environments, with 3+ years specifically on Databricks and Spark-based data platforms.

What we offer you

The compensation ranges below are provided in order to comply with United States pay transparency laws. Other geographies will follow their local salary guidelines, which may not be a direct conversion of published US salary ranges. At EY, we’ll develop you with future-focused skills and equip you with world-class experiences. We’ll empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. Learn more .

We offer a comprehensive compensation and benefits package where you’ll be rewarded based on your performance and recognized for the value you bring to the business. The base salary range for this job in all geographic locations in the US is $138,200 to $266,000. The base salary range for New York City Metro Area, Washington State and California (excluding Sacramento) is $165,800 to $302,300. Individual salaries within those ranges are determined through a wide variety of factors including but not limited to education, experience, knowledge, skills and geography. In addition, our Total Rewards package includes medical and dental coverage, pension and 401(k) plans, and a wide range of paid time off options.

Join us in our team-led and leader-enabled hybrid model. Our expectation is for most people in external, client serving roles to work together in person 40-60% of the time over the course of an engagement, project or year.

Under our flexible vacation policy, you’ll decide how much vacation time you need based on your own personal circumstances. You’ll also be granted time off for designated EY Paid Holidays, Winter / Summer breaks, Personal / Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.

Are you ready to shape your future with confidence? Apply today.

EY accepts applications for this position on an on-going basis.

For those living in California, please click here for additional information.

EY focuses on high-ethical standards and integrity among its employees and expects all candidates to demonstrate these qualities.

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity / expression, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, including arrest and conviction records, in accordance with applicable law.

EY is committed to providing reasonable accommodation to qualified individuals with disabilities including veterans with disabilities. If you have a disability and either need assistance applying online or need to request an accommodation during any part of the application process, please call 1-800-EY-HELP3, select Option 2 for candidate related inquiries, then select Option 1 for candidate queries and finally select Option 2 for candidates with an inquiry which will route you to EY’s Talent Shared Services Team (TSS) or email the TSS at ssc.customersupport@ey.com .

#J-18808-Ljbffr