Job Description
Overview of Job Responsibility :
Develop and support data products, this resource plays a critical role in the development and maintenance of data solutions and deliverables used by internal and external stakeholders.
Design and develop big data solutions built on the Databricks and Azure technology stacks. You will help drive PHM data strategy, managing data pipelines, and ensuring the reliability and scalability of our data platforms.
You will report to the Director, Data Engineering.
Responsibilities :
- Design, implement, and maintain scalable data pipelines and architectures using Databricks and Azure technologies
- Create high performance data products by monetizing warehouse and ETL solutions using python, sql and spark
- Build data flow automation to retrieve, transform and load data. Manage data warehouse structure and file storage rules
- Performance tuning and optimization of ETL and database structures. Optimize data infrastructure performance, reliability, and cost-efficiency
- Monitor long running transactions and can improve query executions using best practices and methodologies
- Design data models for enterprise-wide data integration incorporating :
- Structured and unstructured data
- Real-time, on-demand, batch and varying timing schedules
- Collaborate with cross-functional teams to understand data requirements and deliver innovative solutions
- Develop and enforce data engineering best practices, standards, and policies
- Maintain best practices for handling, storing and using data
- Evaluate and implement new technologies and tools to support data engineering initiatives
- Drive continuous improvement and innovation in data engineering processes
Qualifications
Minimum Requirements :
- Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree
- 5 years experience in a data engineering leadership role, managing teams and complex projects.
- Expertise in Databricks (Delta Lake, Apache Spark, Unity Catalog), Snowflake, Azure (Data Factory, Blob), SQL, and Python.
- Expertise in Datorama, Tableau, PowerBI.
- Strong understanding of data modeling, ETL processes, and data warehousing concepts.
- Experience with cloud infrastructure and services, preferably Azure.
- Excellent analytical and problem-solving skills.
- Effective communication and collaboration skills with the ability to work across teams.
Associate Director, Data Analytics & Business Intelligence New York, New York
Through its global agencies Mindshare, Wavemaker, EssenceMediacom, and mSix&Partners, and cross-channel performance (GroupM Nexus), data (Choreograph), entertainment (GroupM Motion Entertainment) and investment solutions, GroupM leverages a unique combination of global scale, expertise, and inno...
Director of Data and Analytics Engineering
We’re looking for an experienced Director of Data Engineering to oversee building production-facing tools on top of a petabyte-scale warehouse, and work directly with data customers to support analytics and reporting needs. Define and execute the vision, roadmap and strategy for the Data Engineering...
Operations & Technology Transformation Senior Consultant, Guidewire Data Migration - Etl Developer
Operations and Technology Transformation delivers market leading expertise and industry depth by harnessing deep sector knowledge, scaling the power of hybrid services and products, and unlocking the power of Process Bionics to deliver sustainable and impactful solutions to our clients. We advise, d...
Associate Director, Project and Data Management, Pathways - 23904
Through coordinated efforts with participating high schools, colleagues and leadership within Office of Student Pathways, intermediary organizations and other external partners, and specifically with the Career Connected Learning (CCL) team, the Associate Director, Project and Data Management will e...
Regional Sales Director - New York
We are building the enterprise software infrastructure to capture, catalog, refine, enrich, and protect massive datasets and make them available for real-time data analysis and AI training and inference. Designed from the ground up to make AI simple to deploy and manage, VAST takes the cost and comp...
Senior Director, Tax Technology
For existing agreements, a role must be approved and open to external search; otherwise, unsolicited and unapproved submittals and referrals will be considered Armanino property and free of fees. We have a community of resources that are ready and willing to support your ideas, build your skills and...
Senior Software Engineer, Api And Data Delivery
By engineering better data from hundreds of public and third-party sources, we aim to tell the complete story of every business, so that companies of every size can access the financial services they need to grow and thrive. Were a team of curious, driven individuals with diverse backgrounds and ski...
Associate, Cloud Data Engineer
Collaborate with data scientists, analysts, and business stakeholders to assist with data-related technical issues and support dat Data Engineer, Cloud, Associate, Engineer, Azure, Data Scientist, Technology. Develop and maintain scalable data pipelines within Azure/ Snowflake while ensuring optimal...
Director of Data Governance
S Posted byPresidentFocus Capital is supporting its health technology division by introducing a new Director of Dataernance and Innovation to stand up a dataernance program for its Fortune 500 subsidiary that has made breakthroughs in data science and analytics without a true dataernance program. Pa...
Associate Director - Health & Benefits
As a Health and Benefits Associate Director, you will be a leader on the client service team and will be responsible for fostering relationships cross the client organization. Facilitating specialist resources and subject matter experts in health management, absence and disability management, pharma...