Data Engineer (New York)

Data Engineer

We're looking for a skilled and proactive Data Engineer with 25 years of experience to help build and maintain robust, high-performance data pipelines and infrastructure. This role is ideal for someone who thrives in a fast-paced environment, has deep technical knowledge of Redshift, and is capable of diagnosing and improving SQL query performance. You'll work closely with investment advisors, engineering, product, and analytics teams to ensure the reliability, efficiency, and scalability of our data systems.

Key responsibilities include :

• Design, build, and maintain scalable ETL pipelines using Luigi and Apache Airflow
• Monitor and optimize performance of Redshift clusters, particularly : diagnosing high CPU usage, identifying slow or resource-intensive queries, refactoring SQL for performance improvements
• Proactively build data quality alerts and notification systems to ensure pipeline health and catch missing / incomplete data early
• Work closely with analysts and stakeholders to ensure the data is accurate, available, and accessible
• Respond promptly to issues during working hours (within 5 minutes during core hours)
• Lead or assist in potential migration projects (e.g., Redshift to Snowflake or other tools), including planning, testing, and execution

Collaborate on data modeling and schema design to support analytics and application needs

Requirements include :

Bonus : experience leading or supporting data platform migrations

Preferred qualifications include :

Additional requirements :

Benefits :