Overview :
Take the next step in your career now, scroll down to read the full role description and make your application.
Job Purpose
Responsible for maintaining large mortgage and real estate data sets for ICE Data and Analytics to produce data products and custom analytics tools.
Responsibilities include designing, building, and maintaining the infrastructure and systems that enable the collection, storage, processing, and analysis of large volumes of ICE mortgage and real estate data.
Responsibilities
Understanding the business need, securing the right data sources, designing usable data models, and building robust & dependable data pipelines
Work with and data scientists and an application research and development team who use data and machine learning solutions to uncover valuable insights from ICE mortgage and real estate data
Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources.
Ensure data quality, consistency, and accuracy by building out robust data monitoring processes.
Build scalable data pipelines (SparkSQL & PySpark) leveraging Airflow scheduler / executor framework
Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that support ICE mortgage performance and real estate data platforms.
Knowledge and Experience
5+ years of relevant industry experience with a BS / Masters, or 2+ years with a PhD
Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.
g., Redshift, BigQuery, HBase, ClickHouse)
Excellent written and verbal communication skills
Schedule
This role offers work from home flexibility of one day per week.
New York Base Salary Range
The expected base salary for this role if located in New York City is between 139,100 - 195,700 USD. The base salary range does not include Intercontinental Exchange’s incentive compensation.
While we provide this range as general guidance, at ICE we compensate employees based on the skillset and experience of the individual.
Intercontinental Exchange, Inc. is an Equal Opportunity and Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to , , , , , , or ancestry, , or veteran status, or other protected status.
LI-RS1
LI-Hybrid
J-18808-Ljbffr
Senior Data Engineer (Bangkok based, relocation provided)
You will be integral in the design and implementation of reliable, performant and scalable data intelligence solutions to overall improve our data warehouse architecture, business intelligence reporting, data automation solutions and data product developments. Design and develop large and complex da...
Senior Data Engineer (Hybrid- Midtown- Atlanta, Georgia)
As a Senior Data Engineer at Cargill you work across the full stack to design, develop and operate complex high performance and data centric solutions using our comprehensive and modern data capabilities and platforms. Perform data analysis, handle data modeling and configure and develop data pipeli...
Senior Associate Data Engineer
Lead, design, develop and deliver large-scale data systems, data processing and data transformation projects. Experience in implementing data pipelines for both streaming and batch integrations using tools/frameworks like Glue ETL, Lambda, Google Cloud DataFlow, Azure Data Factory, Spark, Spark Stre...
Senior Data Engineer (Salesforce)
Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Senior Data Engineer you will accelerate growth and transformation of our analytics landscape. You will bring a strong desire to guide team members' growth and devel...
Senior Data Engineer - Principal Associate (remote-eligible)
Center 1 (19052), United States of America, McLean, VirginiaSenior Data Engineer - Principal Associate (Remote-Eligible)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery enviro...
Senior Data Engineer
AWS Certified Data Analytics, Google Cloud Professional Data Engineer, Microsoft Azure Data Engineer Associate). As a Senior Data Engineer, you will play a pivotal role in our agile analytics team, leading the design, development, and optimization of complex data infrastructure and pipelines. You wi...
Senior Mechanical Design Engineer (Data Center HVAC)
Senior Mechanical Design Engineer (Data Center HVAC). The Senior Mechanical Design Engineer mentors junior engineers. Effectively interacts with other internal and external teams, including the design engineering, site engineering, construction management and regional operations teams, onsite suppor...
Senior Data Engineer
AWS Certified Data Analytics, Google Cloud Professional Data Engineer, Microsoft Azure Data Engineer Associate). As a Senior Data Engineer, you will play a pivotal role in our agile analytics team, leading the design, development, and optimization of complex data infrastructure and pipelines. You wi...
Senior Electrical Engineer - Data Center
We are Olsson, a team-based, purpose-driven engineering and design firm. As an Electrical Engineer, you will work directly with some of the world’s largest technology companies and other mission-critical clients. You will serve as an electrical engineer on projects, design calculations, write techni...
Senior DataOps Engineer with CI/CD - Data Pipeline & Automation Specialist
Job Description</b><br /> <br /> Job Title : Senior DataOps Engineer with CI/CD Data Pipeline & Automation Specialist<br /> <br /> Job Type : W2<br /> <br /> Experience : 8 - 10 years<br /> <br /> Location : Remote</p> <p> ...