Sr. Software Engineer - Data Platform

Pinecone
Long Island City, New York, US
Full-time

About Pinecone

You could be just the right applicant for this job Read all associated information and make sure to apply.

Pinecone is pioneering a vector database to power modern AI / ML applications. We provide customers with capabilities that until now have only been in the hands of a few tech giants - such Google’s Search and Facebook’s feed ranking.

Our team consists of multiple startup founders, including the core team that created Amazon SageMaker, and is backed by some of Silicon Valley’s prominent investors.

We value integrity, passion, pushing boundaries, real-world problem solving, and a sense of humor. We work in collaboration and encourage new ideas and initiatives.

About The Role

As we continue to grow and scale our business, it's essential that we have a highly skilled data engineering team in place to ensure that we can use robust and reliable data for necessary business operations, analysis, and reporting.

The Experience Team is responsible for helping our users manage, observe, and operate their vector databases at scale. This role is the second engineer on the team dedicated to designing and building the data warehouse and pipelines that enable data discovery, integration, transformation, and analysis across the business.

The team works closely with stakeholders across the business, including growth marketing, product, finance, and sales operations.

Overview

As a Data Engineer on our Data Platform Team, you'll play a vital role in developing and maintaining the infrastructure that powers our use of data across our organization.

You'll collaborate with our software engineers and analysts to ensure that our data is structured, optimized, and readily available to drive our business forward.

You'll be at the forefront of designing and building the data platform that our customers rely on to manage their AI / ML applications.

If you're passionate about working on complex data challenges and thrive in a dynamic, fast-paced environment, we'd love to have you join our team!

Requirements

  • 6+ years hands-on experience writing and deploying production quality code. Familiarity with production Rust applications preferred.
  • Professional experience using Python, Java, or Scala for data processing
  • Deep understanding of SQL and analytical data warehouses
  • Experience designing, building and operating BigQuery instances and pipelines
  • Experience implementing ETL (or ELT) best practices at scale.
  • Experience with data pipeline and orchestration tools (dbt, Airflow, Prefect)
  • Experience with big data processing concepts (Spark, Kafka, DataFlow)
  • Experiences working with cloud infrastructure technologies (GCP, AWS, Kubernetes)
  • Strong data modeling skills and familiarity with the Kimball methodology

Responsibilities

  • Build and maintain data pipelines from internal services and SaaS apps
  • Provide architecture recommendations and implement them
  • Write performant code and define standards for style and maintenance
  • Support and mentor team members to grow technical skills
  • Ship medium to large features independently and with minimal guidance
  • Influence long-range goals and achieve consensus among stakeholders

Compensation Range : $125K - $150K

J-18808-Ljbffr

1 day ago
Related jobs
Promoted
Capital One
New York, New York

Manager - Software Engineer (Fullstack)Do you love building and pioneering in the technology space while driving Software Engineering best practices? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you''ll ...

Arcesium
New York, New York

Arcesium seeks an exceptional Principal Software Engineer - Data Platform to join our Technology team. The Principal Software Engineer on this team will help architect and implement the next generation of Arcesium's data platform. Drive solutions around data modeling, data pipelining & orchestration...

Comcast Corporation
New York, New York

DUTIES:                               Provide technical leadership in designing and developing new software and web applications using C++ in a Linux environment; design database tables using SQL; work with distributed systems, high-performance computing, and cloud computing technologies; develop ba...

Avature
Queens, New York

The Database services team provides a database-as-a-service (DBaaS) platform that engineers depend on to drive applications throughout Bloomberg. You are an experienced Software Engineer who understands and enjoys designing and building automation workflows for SQL Server database solutions on the W...

Affinity Solutions
Queens, New York

Understand existing data models, backend data processes, platform architecture and inbound/outbound file processing. The ideal candidate will have at least 3-5 years of software engineering experience in a fast-paced. Affinity Solutions (Affinity) is the leading consumer purchase data company. We pr...

Genius Sports
Queens, New York

Software engineering experience: modern software development practices and tools, distributed systems, database systems, performance tuning. We are looking for a senior software engineer to build web applications that collect, configure, and visualize sports data across a wide range of Sports. You w...

Theorem
Queens, New York

We strive to be the preferred partner to lending platforms, providing not only access to capital but also underwriting technology capabilities to allow innovative lending platforms to grow their business. Backend Engineer on our CLIP (Custom Loan Integration Program) Team, you’ll take on a key role ...

JPMorgan Chase & Co.
New York, New York

Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark. As a Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking in Wealth management space, you are an integral part of an agile t...

Genpact
New York, New York

Experience with data governance and management best practices, implementing data policies; troubleshooting and resolving data quality issues, and conducting data audits, or managing data access and permissions for data masters, or with data modeling, data security, data privacy, etc. Expertise with ...

Datadog
Queens, New York

Built by engineers, for engineers, Datadog is used by organizations of all sizes across a wide range of industries. We are looking for a Staff Engineer to help us expand and scale our internal Kubernetes resource management and deployment automation systems within Datadog. As part of the Release Pla...