Job Description
We are seeking a seasoned Technical Data Lead / Architect with over 10 years of experience in leading data programs, and a deep understanding of data architecture, data engineering, and data analysis.
The successful candidate will play a pivotal role in understanding data requirements, designing, developing, testing, and maintaining ETL architectures and databases for large-scale data processing systems.
Key Responsibilities :
- Provide technical leadership and oversight of the data programs.
- Collaborate with business stakeholders, data analysts, data scientists to identify business requirements, analyze opportunities for data-driven improvements and solutions.
- Design, develop, deploy, test, and maintain highly scalable data solutions.
- Lead the development and maintenance of data architecture, data modeling, and ETL processes.
- Collaborate with teams to integrate systems and data quickly and effectively, regardless of technical challenges or complexities.
- Ensure the performance, reliability, and security of databases.
- Develop and implement data standards, procedures, and guidelines to ensure data integrity, dependability, and regulatory compliance.
- Anticipate future demands of initiatives related to data and make recommendations to higher management on necessary upgrades or new systems.
Qualifications
Required Skills & Qualifications :
- Over 10 years of experience leading data programs.
- 5+ years of data engineering experience with ETL (Extract, Transform, Load) tools and processes is crucial, including data migration and data integration from various sources into Snowflake and expertise in at least one ELT tool.
- Proficiency in SQL is essential, including the ability to write complex queries and stored procedures.
- Experience working with legacy and modern sources and file formats like json, csv, xml. and classified data with PII, PHI etc.
- Experience with python for legacy and modern ingestion is essential and usage of libraries for data engineering like pandas, sqlalchemy, snowpark, etc.
- Familiarity with at least one cloud platform, such as AWS, Azure, or Google Cloud, and understanding how Snowflake integrates with these platforms.
Proficiency in Azure Cloud services like Azure data factory, DevOps are advantageous.
- Excellent knowledge of data backup, recovery, security, integrity.
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Staying up to date with the latest features and updates from Snowflake.
- Certification, such as the SnowPro Core Certification or Azure solutions architect / Data Engineer associate, can demonstrate a high level of expertise and commitment to the role.
- Strong leadership and communication skills.
- A degree in Computer Science, Engineering, or a related field.
Senior Manager, Data Engineering (Python, AWS, Airflow)
Center 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data Engineering (Python, AWS, Airflow). Center 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data Engineering (Python, AWS, Airflow). As a Capital One Senior Manager Data Engineer, youll have the oppo...
Engineering Manager - Data Operations
As the Engineering Manager, Data Ops, you will be responsible for managing and optimizing the data infrastructure that supports the organization’s data pipelines, ETL processes, and integrations. Collaboration: Partner with the Data Refinery and Data Products teams to ensure that the data infrastruc...
Senior Manager, Data Engineering
Center 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data EngineeringDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll...
Senior Manager (Engagement Manager), Data Engineering
Overall understanding of analytics from analytic engineering to visualization tools Databricks Data Engineer Professional and Databricks Machine Learning Professional certifications a plus What We Promise You: Exciting projects with great clients in varying departments and verticals across the world...
Senior Manager, Data Engineering (Python, AWS, Airflow)
What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies Lead a team of developers with deep experience in machine learning, distributed microservices, and full stack systems Utilize ...
Engineering Manager - Data Operations
As the Engineering Manager, Data Ops, you will be responsible for managing and optimizing the data infrastructure that supports the organization’s data pipelines, ETL processes, and integrations. Collaboration: Partner with the Data Refinery and Data Products teams to ensure that the data infrastruc...
Senior Manager, Data Engineering - Capital One
Center 1 (19052), United States of America, McLean, VirginiaSenior Manager, Data EngineeringDo you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative,inclusive, and iterative delivery environment? At Capital One, you'll...
Senior Manager, Data Engineering
Senior Manager, Data Engineering. As a Capital One Senior Manager Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based d...
Senior Manager, Data Engineering
Senior Manager, Data Engineering. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Manager Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. The Card Data Org...
Senior Manager, Data Engineering (People Manager)
West Creek 3 (12073), United States of America, Richmond, VirginiaSenior Manager, Data Engineering (People Manager). Utilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and Snowflake. Finance Tech...