Search jobs > San Francisco, CA > Lead data engineer

AI Data Engineer Lead (Principal)

Grindr
San Francisco, CA
Full-time

This is a hybrid role based in our Palo Alto or San Francisco offices and will require you to be in office Tuesdays and Thursdays.

What’s so interesting about this role?

We at Grindr believe that AI can revolutionize the dating industry. Our Data Engineer lead is responsible for building high quality ML datasets at scale, used to train ML models that power AI-centric features.

In this pivotal role, you will have the opportunity to build foundational tools and data pipelines to ingest, normalize and clean the valuable data that would be fundamental for for our ML engineers in Grindr to build AI tools including recommendations, LLMs, ads, visual search, growth / notifications, trust and safety.

What’s the job?

We’re looking for an exceptional data engineer who is passionate about data for AI and values it can bring to Grindr, Who loves working with data ops at scale;

and who is committed to the hard work necessary to continuously improve our ML data pipelines.

In this position, you will be responsible for establishing and executing the strategy for our organization’s ML Data Engine, with an initial focus on agile ML Data OPs.

This includes identification of infrastructure components and data stack to be used, design and implementation of pipelines between data systems and teams, automation workflows, data enrichment and monitoring tools all for AI models.

As a tech lead specialized in data engineering, you are expected to code and contribute to the stack.

Responsibilities :

  • Dive into our dataset and design, implement and scale data pre / post processing pipelines of ML models
  • Work on applied ML solutions in the areas of data mining, cleaning, normalizing and modeling
  • Be self-motivated in seeking solutions when the correct path isn’t always known
  • Collaborate with engineers in conceptualizing, planning and implementing data engineering initiatives working with different stakeholders
  • Design and build data platforms & frameworks for processing high volumes of data, in real time as well as batch, that will be used across engineering teams
  • Build data processing streams for cleaning and modeling text data for LLMs
  • Research and evaluate new technologies in the big data space to guide our continuous improvement
  • Collaborate with multi-functional teams to help tune the performance of large data applications
  • Work with Privacy and Security team on data governance, risk and compliance initiatives
  • Work on initiatives to ensure stability, performance and reliability of our data infrastructure

What we’ll love about you

  • Bachelors in Computer Science, Mathematics, Physics, or a related fields
  • 5+ years of experience as a data engineer building production-level pre / post-processing data pipelines for ML / DL models, including 2+ years of technical leadership experience
  • Experience in statistical analysis & visualization on datasets using Pandas or R
  • Experience designing and building highly available, distributed systems of data extraction, ingestion, normalization and processing of large data sets in real time as well as batch, that will be used across engineering teams using orchestration frameworks like Airflow, KubeFlow or other pipeline tools
  • Demonstrated prior experience in creating data pipelines for text data sets NLP / large language models
  • Ability to produce well-engineered software, including appropriate automated test suites, technical documentation, and operational strategy
  • Excellent coding skills in Python, Java, bash, SQL, and expertise with Git version control
  • Experience using big data technologies (Snowflake, Airflow, Kubernetes, Docker, Helm, Spark, pySpark)
  • Experience with any public cloud environment - AWS, GCP or Azure
  • Significant experience with relational databases and query authoring (SQL) as well as NoSQL databases like DynamoDB etc
  • Experience building and maintaining ETL (managing high-quality reliable ETL pipelines)

We’ll really swoon if you have

  • 2+ years of experience of technical leadership in building data engineering pipelines for AI
  • Previous experience in building data pipeline for conversational AI APIs and recommender systems
  • Experience with distributed systems and microservices
  • Experience with Kubernetes and building Docker images
  • Experience with building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming
  • Strong understanding of applied machine learning topics
  • Be familiar with legal compliance (with data management tools) data classification, and retention
  • Consistent track record of managing and implementing complex data projects

What you'll love about us

  • Mission and Impact : Grindr is the world-leading LGBTQ social networking service. Your role will impact the lives of millions of LGBTQ people around the world
  • Multiple Locations : We are hiring someone for this role to be based ideally in San Francisco or Palo Alto
  • Family Insurance : Insurance premium coverage for health, dental, and vision for you and partial coverage for your dependents
  • Retirement Savings : Generous 401K plan with 6% match and immediate vest in the US
  • Compensation : Industry-competitive compensation and eligibility for company bonus and equity programs
  • Queer-Inclusive Benefits : Industry-leading gender-affirming offerings with up to 90% cost coverage, access to Included Health, monthly stipends for HRT, and more
  • Additional Benefits : Flexible vacation policy, monthly stipends for cell phone, internet, wellness, and food, one-time home-office setup stipend, and company-sponsored events
  • 30+ days ago
Related jobs
Promoted
VirtualVocations
Oakland, California

A company is looking for a Lead Engineer, Generative AI. ...

Promoted
Greylock
CA, United States

Design, implement, and maintain the core data pipelines and processing platform for our AI-native cloud platform. The company is seeking a staff level engineer that will be responsible for building the underlying systems that ingest data from their customers, transform it and make it available for t...

Promoted
Autodesk, Inc.
San Francisco, California

Principal Engineer, Central Data Lake Lead page is loaded Principal Engineer, Central Data Lake Lead Apply locations San Francisco, CA, USA time type Full time posted on Posted 2 Days Ago job requisition id 24WD77185. Build and scale data infrastructure that powers batch and real-time data processin...

Promoted
Atlassian
San Francisco, California

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. ...

Promoted
Altair Engineering
San Francisco, California

This person will design learning materials focused on various aspects of data analytics with emphasis on data science, BI, data management and IoT, which will play a pivotal role in guiding customers on how to extract maximum value from their data. Working Experience of 2-3 years of hands-on data an...

Promoted
Salesforce
San Francisco, California

Lead or Principal Software Engineer. We’re Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. Looking for Lead engineers for the...

Promoted
Scale AI
San Francisco, California

As a Senior Data Engineer at Scale, you will spearhead building the company's analytical and business-intelligence infrastructure. Scale's customers process millions of tasks through our APIs, and we're looking for a talented Data Engineer to build scalable solutions to support this growth. You will...

Promoted
Money Fit by DRS
San Francisco, California

As a Principal Data Engineer, you will work within the Informatics team and contribute to Tendo's strategic data engineering solutions by ingesting, transforming, and warehousing healthcare-related data from various sources. Your work will enable Data Engineers and Data Scientists to experiment and ...

Capital One
San Francisco, California
Remote

Lead Engineer to help build and maintain APIs and SDKs to train, fine-tune and access AI models at scale. Center 1 (19052), United States of America, McLean, VirginiaSenior Lead Engineer - Generative AI Product Engineering (Remote Eligible). We are committed to building world-class applied science a...

Atlassian
San Francisco, California

Atlassian is seeking a Lead Principal Machine Learning Software Engineer to join our Central AI team. The Central AI organization constructs the fundamental infrastructure, data pipeline, frameworks, models, and other capabilities to expedite AI feature development throughout the entire company. Its...