Talent.com
Founding LLM Inference Engineer
Founding LLM Inference EngineerReducto, Inc. • Harvey, IL, US
Founding LLM Inference Engineer

Founding LLM Inference Engineer

Reducto, Inc. • Harvey, IL, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Reducto helps AI teams ingest real world enterprise data with state of the art accuracy.

The vast majority of enterprise data — from financial statements to health records — is locked in unstructured file formats like PDFs and spreadsheets. We train vision models to read those documents the way a human would, and make it possible to build products, train models, and automate processes at scale.

We've grown incredibly quickly, from zero to mid 7 figure ARR in 1 year, and now work with hundreds of companies ranging from leading AI teams (Harvey, Vanta, Scale), through to enterprise (FAANG, top 3 trading firm).

We're also backed by world class investors like Benchmark and First Round Capital, and are now looking for a LLM / ML Engineer to help us continue to build and improve our state-of-the-art AI models.

The core work will include :

  • Architecting and implementing robust, scalable inference systems for serving state-of-the-art AI models
  • Optimizing model serving infrastructure for high throughput and low latency at scale
  • Developing and integrating advanced inference optimization techniques
  • Working closely with our research team to bring cutting-edge capabilities into production
  • Building developer tools and infrastructure to support rapid experimentation and deployment.

We would love to meet you if you :

  • Philosophy : You are your own worst critic. You have a high bar for quality and don't rest until the job is done right—no settling for 90%. We want someone who ships fast, with high agency, and who doesn't just voice problems but actively jumps in to fix them.
  • Experience : You have deep expertise in Python and PyTorch, with a strong foundation in low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale. You're experienced with modern inference systems like TGI, vLLM, TensorRT-LLM, and Optimum, and comfortable creating custom tooling for testing and optimization.
  • Approach : You combine technical expertise with practical problem-solving. You're methodical in debugging complex systems and can rapidly prototype and validate solutions.
  • Have experience with low-level systems programming (CUDA, Triton) and compiler optimization
  • Are passionate about open-source contributions and staying current with ML infrastructure developments
  • Bring practical experience with high-performance computing and distributed systems
  • Have worked in early-stage environments where you helped shape technical direction
  • Are energized by solving complex technical challenges in a collaborative environment
  • This is an in person role at our office in SF. We're an early stage company which means that the role requires working hard and moving quickly.

    About Reducto

    Nearly 80% of enterprise data is in unstructured formats like PDFs

    PDFs are the status quo for enterprise knowledge in nearly every industry. Insurance claims, financial statements, invoices, and health records are all stored in a structure that's simply impractical for use in digital workflows. This isn't an inconvenience—it's a critical bottleneck that leads to dozens of wasted hours every week.

    Traditional approaches fail at reliably extracting information in complex PDFs

    OCR and even more sophisticated ML approaches work for simple text documents but are unreliable for anything more complex. Text from different columns are jumbled together, figures are ignored, and tables are a nightmare to get right. Overcoming this usually requires a large engineering effort dedicated to building specialized pipelines for every document type you work with.

    Reducto breaks document layouts into subsections and then contextually parses each depending on the type of content. This is made possible by a combination of vision models, LLMs, and a suite of heuristics we built over time. Put simply, we can help you :

  • Accurately extract text and tables even with nonstandard layouts
  • Automatically convert graphs to tabular data and summarize images in documents
  • Extract important fields from complex forms with simple, natural language instructions
  • Build powerful retrieval pipelines using Reducto's document metadata
  • Intelligently chunk information using the document's layout data
  • Benefits at Reducto

  • Lunch : Receive a free lunch to eat with your teammates daily at the office
  • Reimbursed Transportation : Provide us with your receipts and we'll take care of the costs
  • Insurance
  • Generous health insurance covering medical, dental, and vision.

  • Health and Wellness Budget : We provide up to $150 / mo reimbursement for health and wellness spending, such as gym memberships, fitness classes, or similar.
  • Parental Leave : Work with us to build a leave schedule that works for you and your family
  • Reducto is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to sex, race, color, age, national origin, religion, physical and mental disability, genetic information, marital status, sexual orientation, gender identity / assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by applicable national, federal, state or local law.

    J-18808-Ljbffr

    serp_jobs.job_alerts.create_a_job

    Founding Engineer • Harvey, IL, US

    Job_description.internal_linking.related_jobs
    Locum Physician (MD / DO) - Radiology - Interventional in Crown Point, IN

    Locum Physician (MD / DO) - Radiology - Interventional in Crown Point, IN

    LocumJobsOnline • Crown Point, IN, US
    serp_jobs.job_card.full_time
    LocumJobsOnline is working with VISTA Staffing to find a qualified Interventional Radiology MD in Crown Point, Indiana, 46307!. This position with one of VISTA's healthcare partners in.IR procedures...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Machine Learning Engineer

    Machine Learning Engineer

    York Solutions, LLC • Chicago, IL, United States
    serp_jobs.job_card.full_time
    Description Location : onsite 5 days / week in Willis Tower, downtown Chicago.At this time, we are unable to consider candidates requiring visa sponsorship or third-party recruitment agencies for this...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Solutions Engineer

    Solutions Engineer

    IMO Health • Chicago, IL, US
    serp_jobs.job_card.full_time
    At IMO Health, we help healthcare organizations unlock the power of their data.You’ll lead discovery sessions, create impactful demos and proof of concepts, and guide prospects through techni...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Relay Settings Engineer 2

    Relay Settings Engineer 2

    GAI Consultants Inc. • Lisle, IL, United States
    serp_jobs.job_card.full_time
    GAI Consultants is seeking a Relay Settings Engineer 2 with protective relay experience for transmission and distribution systems. The successful candidate will work on various substation and / or pro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AI Engineer & Researcher, Inference - Chicago, USA

    AI Engineer & Researcher, Inference - Chicago, USA

    Speechify • Chicago, IL, US
    serp_jobs.job_card.full_time
    PLEASE APPLY THROUGH THIS LINK : https : / / job-.The mission of Speechify is to make sure that reading is never a barrier to learning. Over 50 million people use Speechify's text-to-speech products ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Applied AI / ML Engineer

    Applied AI / ML Engineer

    Catalyst Labs • Chicago, IL, US
    serp_jobs.job_card.full_time
    Catalyst Labs is a leading talent agency with a specialized vertical in Applied AI, Machine Learning, and Data Science.We stand out as an agency thats deeply embedded in our clients recruitment ope...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Sr Machine Learning Engineer

    Sr Machine Learning Engineer

    The Hartford • Chicago, IL, United States
    serp_jobs.job_card.full_time
    Sr Data Engineer - GE07BEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer - Modeling

    Machine Learning Engineer - Modeling

    Pryon • Chicago, IL, US
    serp_jobs.job_card.full_time
    We’re a team of AI, technology, and language experts whose DNA lives in Alexa, Siri, Watson, and virtually every human language technology product on the market.Now we’re building an in...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Consultant Engineer I, greater Fox Valley, WI area

    Consultant Engineer I, greater Fox Valley, WI area

    FM • ROSELLE, Illinois, United States
    serp_jobs.job_card.full_time
    FM is one of the world’s largest risk management and industrial property insurance organizations.With over 50 office locations worldwide, FM provides specialized property protection to over one thi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_1_day • serp_jobs.job_card.promoted
    Analytics Engineer - Remote

    Analytics Engineer - Remote

    Wallman Unlimited Company • Chicago, Illinois, United States
    serp_jobs.filters.remote
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    The team is currently remote, but that could change at any time.Must be located in Washington DC, Boston, NYC or Chicago. Our client, a leading Am Law 100 firm, is seeking an.This role will design a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    AI / ML

    AI / ML

    Adidev Technologies Inc • Des Plaines, IL, US
    serp_jobs.job_card.full_time
    This role is open to US Citizens, Green Card holders, GC-EAD only.Adidev is looking for an adept Machine Learning Engineer to take the helm in deploying advanced machine learning models, with a spe...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer Chicago, United States

    Machine Learning Engineer Chicago, United States

    IMC Financial Markets • Chicago, IL, US
    serp_jobs.job_card.full_time +1
    As a Machine Learning Engineer, you will play a pivotal role in building systems that drive the training and deployment of large-scale ML models across our global operations.You'll collaborate with...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Machine Learning Engineer

    Machine Learning Engineer

    Tiger Analytics • Chicago, IL, US
    serp_jobs.job_card.full_time
    Tiger Analytics is an advanced analytics consulting firm.We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data.Our consultants b...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Quantum Software Engineer - Machine Learning

    Quantum Software Engineer - Machine Learning

    Infleqtion • Chicago, IL, US
    serp_jobs.job_card.full_time
    The newly hired Quantum Software Engineer – Machine Learning is responsible for designing, training, and deployment of classical machine learning models for a variety of downstream tasks in t...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Principal / Senior Machine Learning Engineer

    Principal / Senior Machine Learning Engineer

    IntelliPro Group Inc. • Chicago, IL, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Principal / Senior Machine Learning Engineer Position Type : FTE Location : San Francisco / Portland ,ME / Boston / Chicago / Seattle Salary Range : $ 20 0,000 - $ 270 , 000 (USD) Job ID# : ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    AI Machine Learning Engineer

    AI Machine Learning Engineer

    York Solutions, LLC • Chicago, IL, United States
    serp_jobs.job_card.full_time +1
    Type : 6+ month contract to hire (C2H is a must have).Location : Willis Tower, downtown Chicago, IL - 5 days on-site, after conversion only 4 days on-site required. This team is looking for someone pa...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Military Intelligence

    Military Intelligence

    Navy • South Holland, IL, United States
    serp_jobs.job_card.full_time
    ABOUT Effective, secure communication in the cyber domain is essential to the everyday operations of military intelligence in America’s Navy. Information Professionals who oversee the seamless opera...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Entry Level Engineer

    Entry Level Engineer

    Messina Talent Advisors • Lisle, IL, US
    serp_jobs.job_card.full_time
    Seeking a motivated Entry-Level Engineer to support our client’s technical team in a hands-on contract role based in Lisle. This position offers valuable exposure to engineering validation pro...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Physician (MD / DO) - Hematology and Oncology in Crown Point, IN

    Physician (MD / DO) - Hematology and Oncology in Crown Point, IN

    LocumJobsOnline • Crown Point, IN, US
    serp_jobs.job_card.full_time +1
    LocumJobsOnline is working with CompHealth to find a qualified Hematology and Oncology MD in Crown Point, Indiana, 46307!. Filled with history and beautiful surroundings, Crown Point has an ample nu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Identity and Access Management (IAM) Engineer

    Identity and Access Management (IAM) Engineer

    Addison Group • Chicago, IL, US
    serp_jobs.job_card.full_time
    Identity and Access Management (IAM) Engineer.This position is eligible for medical, dental, vision, and 401(k).We are seeking a skilled and detail-oriented Identity and Access Management (IAM) Eng...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted