Lead Data Integration Engineer

Job Description

Are you ready to explore a world of possibilities?

Join our DTCC family, and you'll grow your expertise and become the best version of you. As you embark on a new journey, you'll be supported and surrounded by other experts as you learn new skills, advance your career, and see the impact of your efforts every day.

Pay and Benefits :

• Competitive compensation, including base pay and annual incentive
• Comprehensive health and life insurance and well-being benefits, based on location
• Retirement benefits
• Paid Time Off and other leave of absence
• DTCC offers a flexible / hybrid model of 3 days onsite and 2 days remote (Onsite Tuesdays, Wednesdays and a third day of your choosing)

Primary Responsibilities :

• Function as a technical expert on one or more applications utilized by DTCC.
• Work with the Business System Analyst to ensure designs satisfy functional requirements.
• Partner with Infrastructure to identify and deploy optimal hosting environments.
• Tune application performance to eliminate and reduce issues.
• Research and evaluate technical solutions consistent with DTCC technology standards.
• Align risk and control processes into day-to-day responsibilities to monitor and mitigate risk; escalates appropriately.
• Apply different software development methodologies dependent on project needs.
• Contribute expertise to the design of components or individual programs and participate in the construction and functional testing.
• Support development teams, testing, troubleshooting, and production support.
• Build applications and construct unit test cases that ensure compliance with functional and non-functional requirements.
• Work with peers to mature ways of working, continuous integration, and continuous delivery.
• Aligns risk and control processes into day-to-day responsibilities to monitor and mitigate risk, advances appropriately.

Sound Like You?

• Minimum of 7 years of related experience
• Bachelor's degree preferred or equivalent experience.

Required Qualifications :

Data warehouse ETL Data Engineer - Snowflake and Python :

• Looking for a strong data engineer with hands-on experience in developing large scale Data engineering pipelines for financial services and preferably for risk management.
• Minimum 7 years of related experience in building and maintaining large scale Data warehouse applications in cloud.
• Minimum 4 years of experience in developing complex data pipelines loading and transforming data into snowflake Database using SQL and PL SQL procedures.
• Preferred experience with Python framework for orchestrating data loads.
• Hands on experience in writing shell scripts for Linux for file processing and orchestration with Python.
• Experience in creating SQL based processes to build slowly changing dimension and several types of facts.
• Experience in data lineage analysis, data profile and creating mapping integration across multiple source systems.
• Experience in developing in AWS cloud-based platform and knowledge of its services.
• Knowledge in Snowflake role-based access, compute warehouse sizing, clustering keys in large tables, partition schemes and query profiling.
• Hands on experience in creating and managing Autosys JILs for scheduling jobs.
• Minimum 5 years of Hands-on experience in writing, tuning, and managing complex SQL for real-time reporting from large scale data warehouse systems in Snowflake.
• 3 years of experience in writing and performance tuning of PL / SQL languages with best practices and standards.
• Strong hands-on experience in bitbucket, git, Liquibase and managing multiple versions of release and CICD pipelines.
• Good understanding of Enterprise Data integration concepts, Data warehouse modelling and Data architecture patterns.

Who We Are :

The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment.

Please contact us to request accommodation.