Search jobs > Chicago, IL > Principal software engineer

Principal Software Engineer, (tick history data is a plus)

FactSet
Chicago, Illinois, US
Full-time

We are seeking a highly skilled and innovative Principal Software Engineer to join our Data Solutions Engineering team, part of a major initiative within the Data Solutions (DS) business unit.

This position plays a critical role in developing a world-class tick data historical database, leveraging Big Data tools like Snowflake to service various client-facing applications.

As part of this role, you will be working closely with Product Subject Matter Experts (SMEs) and collaborating with both internal teams and external vendors to structure, optimize, and enhance data services.

Key responsibilities for this accomplished developer will include but are not limited to the following :

Design and prepare tick data for ingestion into Snowflake, collaborating with internal and external teams to ensure best practices are followed.

Fine-tune Snowflake database performance, managing partition keys and indexes while minimizing costs and optimizing data consumption for applications.

Build data pipelines for applications, including End-of-Day bulk feeds, on-demand APIs, and Snowflake data sharing.

Improve tick data offerings by researching technologies, loading Level 2 data, and optimizing time-binned data access.

Explore, design, and architect potential new storage layers and database architectures that could outperform Snowflake for managing tick history data .

Lead proof of concept (POC) initiatives to evaluate the feasibility, performance, and scalability of these alternative solutions.

Design and architect scalable APIs and data connector frameworks.

Lead the architecture, design, development, and launch of high availability, low latency, flexible and scalable APIs.

Mentor and assist other junior engineers in design, implementation, and code reviews.

Stay up to date with advancements in Big Data technologies and data warehousing tools.

Ensure adherence to data security, privacy, and compliance standards.

Drive innovation by evaluating emerging tools and technologies that could improve data management and performance.

Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development and proposed solutions.

Demonstrate a thorough knowledge of data structures and algorithms, object-oriented programming, and software engineering principles.

Ensure that deployed products are properly maintained throughout their lifecycle.

This position requires participation in on-call support on a rotation basis with the team.

Minimum Requirements :

10+ years of related work experience with a focus on data engineering and cloud data platforms.

Critical Skills :

Experience in building RESTful APIs, data pipelines, and managing bulk data processes.

Expertise in database architecture, performance tuning, and data ingestion techniques.

Demonstrated expertise in Python and related scripting languages to automate complex data workflows, optimize ETL processes, and develop robust data integration solutions.

Strong analytical skills with the ability to make data-driven decisions.

Experience working with any relational database.

Experience working with Cloud infrastructure (AWS, Azure, etc.).

Experience working with Snowflake or related technologies.

Knowledge of financial market data, tick data , and Level 2 data is a big plus.

Familiarity with various levels of testing - unit, regression, integration, and load is a plus.

Additional or Desired Skills :

Experience with finance and financial market data is a plus.

Experience with Big Data technologies (e.g., Spark, Hadoop) is a plus.

Understanding of Java and frameworks like Spring Boot is a plus.

Familiarity building RESTful services is a plus.

Experience with NoSQL storage is a plus.

Experience with AWS tools and technologies is a plus.

Experience with multithreaded, caching, and high availability software development is a plus.

Self-starter with deep interest in learning new technologies and taking different approaches to solving complex problems.

Strong written and interpersonal communication skills to interact with business analysts, peers, and management.

Able to work as part of a geographically diverse team as an individual contributor and within a team as well.

Ability to lead and take full ownership of assigned tasks.

Ability to articulate and quickly adopt development best practices.

Ability to create and review documentation.

Education :

Bachelor’s Degree or equivalent in Computer Science or related field.

The budgeted salary range for this position in the states of Connecticut and New York is $160,000.00 - $210,000.00.

At FactSet, we celebrate diversity of thought, experience, and perspective. We are committed to disrupting bias and a transparent hiring process.

All qualified applicants will be considered for employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or veteran status.

FactSet participates in E-Verify.

Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks.

FactSet is an Equal Opportunity Employer M / F / Veteran / Disability / Sexual Orientation / Gender Identity.

J-18808-Ljbffr

19 hours ago
Related jobs
Promoted
Capital One
Chicago, Illinois

West 19th Street (22008), United States of America, New York, New YorkPrincipal Associate, Data Loss Prevention Engineer (CASB)As a member of the Data Loss Prevention (DLP) engineering team, you will play a key role on a team of cyber technicians and engineers to create, implement, and maintain DLP ...

Promoted
National Community Investment Fund
Chicago, Illinois

NCIF is seeking a Principal Software Engineer (Consultant) to lead the development of our current AI-driven data analytics platform. Principal Software Engineer (Consultant). This platform will empower users to conduct natural language queries across multiple public, private, structured, and unstruc...

Promoted
Capital One
Lyons, Illinois

West 19th Street (22008), United States of America, New York, New YorkPrincipal Associate, Data Loss Prevention Engineer (CASB)As a member of the Data Loss Prevention (DLP) engineering team, you will play a key role on a team of cyber technicians and engineers to create, implement, and maintain DLP ...

Promoted
PayPal
Chicago, Illinois

Define validation queries when needed and how to identify discrepancies in the data as they arise. PayPal provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregn...

Promoted
Selby Jennings
Chicago, Illinois

Experience in developing data quality control processes to detect and address data gaps or inaccuracies. Apply fast, check the full description by scrolling below to find out the full requirements for this role. Experience in leveraging and building cloud-native technologies for scalable data proces...

Promoted
Cedar Cares, Inc
Chicago, Illinois

Cboe Data and Access Solutions division is looking for a highly skilled and experienced Principal Software Engineer to join our team. The role is perfect for a seasoned engineer who is an expert in high performance ReactJS front-end development and is comfortable navigating back-end services. Princi...

Hiscox
Chicago, Illinois

A robust understanding of core data engineering topics – ETL vs ELT, structured and unstructured data, data quality and data governance. Participating in code reviews for data engineering practice and as a principal ensuring that all engineers conduct such reviews to a high standard. We are looking ...

Capital One
Chicago, Illinois

Following up and working with internal IT teams to ensure solutions are built, deployed, and modified as necessary according to the projects Provide subject matter expertise to management, business areas, and IT Teams as well as implement appropriate data loss prevention security controls and monito...

CNA
Chicago, Illinois

Acts as the principal designer for major high risk, high complexity systems and their subsystems utilizing a thorough understanding of available technology, tools and existing designs. Assists with the identification and selection of information technologies, vendors, and/or consulting resources whi...

Spline Data
Chicago, Illinois

Spline Data is a focused on building modern quantitative market data feeds and visualizations for fixed income trading desks, portfolio managers, issuers, and beyond. We are on our way to reshaping the traditional ways that participants evaluate market data, so it is key that we find someone who und...