Search jobs > New York, NY > Senior data engineer

Senior Data Engineer - Artificial Intelligence Group

Bloomberg
New York, NY
Full-time

Bloomberg's Engineering AI department has 300+ AI practitioners building highly sought after products and features that often require novel innovations.

We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases.

We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.

At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.

Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009.

We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions.

Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.

We are looking for skilled Senior Data Engineers to join our team if you have a strong background in software development and a passion for data science.

You will work with us on building technologies and tools to ensure the correctness of our search datasets, to protect our clients' personally identifiable information, and to enable key stakeholders to derive insights for the purposes of informing their decisions on the future development of Bloomberg's Search products.

Join the AI Group as a Senior Data Engineer and you will have the opportunity to :

  • Develop and maintain a productionized logging system that produces verifiably correct datasets to support both online Business Intelligence applications as well as offline ML Model training and evaluation pipelines.
  • Implement reusable, efficient, maintainable, and testable code that works on different platforms and scales to billions of data points for the purposes of sessionization, ingestion, and metrics computation.
  • Work with application and product teams to define data needs and SLAs, then implement a data model using idiomatic schema designs tailored to the dataset's intended use case.
  • Design and implement metrics measuring various aspects of the Bloomberg search experience and create Business Intelligence dashboards to help subject matter experts continuously monitor quality, extract actionable insights, and identify new feature development opportunities.

We are looking for a Senior Data Engineer with :

  • 4+ years of experience working with Python and at least one other object-oriented programming language (C / C++, Java, etc.).
  • A degree in Computer Science, Engineering, Mathematics, or similar field of study or equivalent work experience.
  • An understanding of Computer Science fundamentals such as data structures and algorithms and a data oriented approach to problem-solving.
  • Excellent communication skills and the ability to collaborate with engineering peers as well as non-engineering stakeholders.
  • A proven track record building ETL pipelines leveraging technologies such as Kafka Streams, Kafka Connect, Flink, or Spark Streaming.
  • Prior experience building or extending data lakes, using various storage, cataloging, and retrieval technologies such as S3, HDFS, Hadoop, HBase, Hive, Trino, Presto, Cassandra, Spark.
  • Familiarity with workflow orchestration technology, such as Argo, Airflow, or Oozie.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process.

If you would prefer to discuss this confidentially, please email AMER redacted (Americas), EMEA redacted (Europe, the Middle East and Africa), or APAC redacted (Asia-Pacific), based on the region you are submitting an application for.

We give back to the technology community and you can read more about our outreach at : http : / / www.techatbloomberg.com / ai

26 days ago
Related jobs
Promoted
VirtualVocations
The Bronx, New York

A company is looking for a Senior Security Data Engineer to enhance security telemetry and logging. ...

Promoted
Canoe Intelligence
New York, New York

Senior Software Engineer - Integrations. By combining industry expertise with the most sophisticated data capture technologies, Canoe’s technology automates the highly-frustrating, time-consuming, and costly manual workflows related to alternative investment document and data management, extra...

Promoted
VirtualVocations
Queens, New York

A company is looking for a Senior Engineer, Vulnerability Intelligence - Product Security. ...

Promoted
Canoe Intelligence
New York, New York

TITLE: Senior Software Engineer - Services. By combining industry expertise with the most sophisticated data capture technologies, Canoe’s technology automates the highly-frustrating, time-consuming, and costly manual workflows related to alternative investment document and data management, ex...

Promoted
VirtualVocations
Queens, New York

A company is looking for a Staff / Senior Staff Data Engineer, Real-World Data. ...

Promoted
Enigma
New York, New York

We're seeking an experienced Data Product Engineer to join our team and help develop and build the iteration of small business data products. As a Data Product Engineer, you will design and develop data products that solve critical customer pain points. Technical Challenge: Tackle complex data and e...

Disney Entertainment & ESPN Technology
New York, New York

As a member of the Data Capture team you will establish the foundational set of core platform frameworks and pipelines which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics...

CVS Health
New York, New York
Remote

The data operations team will be responsible for data engineer and analysis, quality measures and improvement, data flows and forecasting, and managing our relationship with our customers. This role will join a Data Operations team directly responsible for improving the accuracy and understanding of...

Global Channel Management, Inc
New York, New York

Senior Cloud Data Platform Engineer needs 5+ years of implementing data applications or data platforms with BigData/Hadoop, Python/Java/Spark full stack, etc. Senior Cloud Data Platform Engineer requires:. Extensive experience in designing, engineering and managing data lake ingestion, validation, t...

Wounded Warrior Project
New York, New York

The Wounded Warrior Project (WWP) Senior Data Engineer is a member of the Web, Data, and Analytics team responsible for data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business analysts. Build required infrastructure for optima...