Talent.com
Experimental Design Expert

Experimental Design Expert

HowrecruitHayward, CA, United States
job_description.job_card.1_day_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Senior Data Analyst / Experimental Designer Expert

$170k–$210k USD + equity + annual bonus + incredible benefits

Remote (US / Canada)

Profitable Startup

Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior Data Analyst who lives and breathes experimental design. This isn't a role where experimentation is just one item on a long list. It's the core of what you'll do. You'll own the end-to-end experimentation program, designing rigorous A / B tests that directly shape product strategy and business decisions.

If you're someone who gets excited about power calculations, debates the merits of sequential testing, and has strong opinions about when to use stratification vs. blocking, we want to talk to you.

What you'll do :

  • Own the experimentation roadmap : Design, implement, and analyze sophisticated A / B tests and multivariate experiments that answer critical business questions
  • Be the experimentation subject matter expert : Educate stakeholders on experimental best practices, help them formulate testable hypotheses, and determine appropriate sample sizes and test durations
  • Navigate complexity : Handle challenges like network effects, interference between test groups, non-normal distributions, and multiple testing corrections
  • Drive statistical rigor : Choose appropriate statistical methods (frequentist, Bayesian, sequential testing) based on the context, and clearly communicate tradeoffs
  • Partner with engineering : Collaborate on instrumentation and randomization strategies to ensure experiments are implemented correctly
  • Establish guardrail metrics : Define and monitor metrics that protect the user experience and business health during experimentation
  • Build experimentation infrastructure : Create frameworks, templates, and documentation that scale experimentation across the organization
  • Democratize insights : Translate complex experimental results into clear recommendations that drive action
  • Support ad-hoc analysis : Write SQL queries, build dashboards in Snowflake and future BI tools, and respond to data requests as needed

Requirements :

  • Master's or PhD in Statistics, Mathematics, Economics, Biostatistics, Operations Research, or a related quantitative field (or equivalent advanced training in experimental design and statistical inference)
  • 5+ years of hands-on experience designing and analyzing experiments in a tech, product, or high-growth environment (graduate research involving experimental design counts toward this)
  • Expert-level understanding of experimental design principles : randomization, power analysis, multiple testing corrections, variance reduction techniques, and experimental validity (internal, external, construct)
  • Deep statistical knowledge : confidence intervals, hypothesis testing, regression analysis, ANOVA, and when to apply parametric vs. non-parametric methods
  • Advanced SQL skills : ability to write complex queries to calculate test metrics, detect data quality issues, and perform pre / post analysis
  • Strong Python skills : proficiency with statistical libraries (scipy, statsmodels, or similar) for experiment analysis and simulation
  • Experience with Snowflake or similar cloud data warehouses
  • Track record of impact : examples where your experimental insights led to meaningful product or business changes
  • Exceptional communication skills : ability to explain statistical concepts like p-values, confidence intervals, and sample size calculations to non-technical stakeholders
  • Bonus points for :

  • PhD with dissertation focused on experimental design, causal inference, or applied statistics
  • Familiarity with advanced methods like difference-in-differences, synthetic controls, or instrumental variables
  • Publications, conference talks, or blog posts about experimentation
  • Experience building internal experimentation tools or frameworks
  • Formal training in design of experiments (DOE) or clinical trial methodology
  • A Successful Candidate :

  • Is an experimentation evangelist : You're passionate about rigorous testing and help others understand why shortcuts lead to bad decisions
  • Balances theory with practice : You bring academic rigor but know how to apply it in fast-moving business contexts
  • Is naturally curious : You don't just run tests you dig into surprising results and form hypotheses about user behaviour
  • Is a clear communicator : You can explain why an experiment is underpowered or biased in a way that resonates with PMs and executives
  • Is proactive and independent : You identify opportunities for testing, advocate for experiments, and drive them to completion
  • Is collaborative : You work cross-functionally with product, engineering, marketing, and operations to build an experimentation culture
  • If you're an experimentation expert with strong quantitative training who wants to build a world-class testing program at a profitable, fast-growing startup, we'd love to hear from you. This is a chance to have outsized impact and work behind the scenes of one of the most successful bootstrapped companies you've never heard of.

    serp_jobs.job_alerts.create_a_job

    Experimental • Hayward, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.new
    Howrecruit is hiring : Experimental Design Expert in Sunnyvale

    Howrecruit is hiring : Experimental Design Expert in Sunnyvale

    MediabistroSunnyvale, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Hardware Design Engineer 5

    Hardware Design Engineer 5

    ExperisMountain View, CA, United States
    serp_jobs.job_card.temporary
    Our client, a leader in the technology sector, is seeking a Hardware Design Engineer 5 to join their team.As a Hardware Design Engineer 5, you will be part of the engineering department supporting ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.new
    Howrecruit is hiring : Experimental Design Expert in Alameda

    Howrecruit is hiring : Experimental Design Expert in Alameda

    MediabistroAlameda, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.new
    Experimental Design Expert Job at Howrecruit in San Francisco

    Experimental Design Expert Job at Howrecruit in San Francisco

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.promoted
    Sr. Design Engineer

    Sr. Design Engineer

    RIX INDUSTRIESBenicia, CA, United States
    serp_jobs.job_card.full_time
    RIX Industries is a technology-focused company specializing in the design, development and manufacturing of gas generation systems, precision compressor solutions, and cryogenic cooling technologie...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.new
    Experimental Design Expert Job at Howrecruit in San Jose

    Experimental Design Expert Job at Howrecruit in San Jose

    MediabistroSan Jose, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.new
    Experimental Design Expert Job at Howrecruit in San Mateo

    Experimental Design Expert Job at Howrecruit in San Mateo

    MediabistroSan Mateo, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.new
    Howrecruit is hiring : Experimental Design Expert in Fremont

    Howrecruit is hiring : Experimental Design Expert in Fremont

    MediabistroFremont, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Design Physicist Job at Physics World in Livermore

    Design Physicist Job at Physics World in Livermore

    MediabistroLivermore, CA, United States
    serp_jobs.job_card.full_time
    Design Physicist role at Physics World.Join us and contribute to national security science at Lawrence Livermore National Laboratory (LLNL), where our employees apply their expertise to create solu...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Design Assistant - High End Residential and Specialty Projects

    Design Assistant - High End Residential and Specialty Projects

    L+P InteriorsSausalito, CA, US
    serp_jobs.job_card.full_time
    We are a boutique interior design studio specializing in.Draft drawings and presentations in.AutoCAD, SketchUp, and Google Suite. Assist with sourcing, vendor coordination, and project documentation...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    • serp_jobs.job_card.new
    Lead Design Engineer

    Lead Design Engineer

    Pentangle Tech Services | P5 GroupNewark, CA, US
    serp_jobs.job_card.full_time
    Mechanical Design Lead Engineer - ADAS Sensing.Lucid’s mission is to inspire the adoption of sustainable energy by creating the most captivating luxury electric vehicles, centered around the ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    Lawrence Livermore National Laboratory is hiring : Design Physicist in Livermore

    Lawrence Livermore National Laboratory is hiring : Design Physicist in Livermore

    MediabistroLivermore, CA, United States
    serp_jobs.job_card.full_time
    Associate | Full-time Physical Life Sciences | Livermore, CA | 09 / 24 / 2025 Reference # : REF7535Y Job Code : SES.Science & Engineering MTS 2 / SES. Science & Engineering MTS 3 Organization : Strategi...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Sr. Design Technologist

    Sr. Design Technologist

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    The Senior Design Technologist is responsible for integrating technology into the design process, implementing advanced design workflows, and driving digital transformation initiatives.This role re...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Store Designer

    Store Designer

    AquentHayward, CA, US
    serp_jobs.job_card.full_time
    The Manager of Store Design is essential for organizing and implementing the design of our retail stores for all concepts, including, new stores, relocations, fixture design, franchises, shop-in-sh...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Experimental Design Expert

    Experimental Design Expert

    HowrecruitSunnyvale, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.new
    Experimental Design Expert Job at Howrecruit in Hayward

    Experimental Design Expert Job at Howrecruit in Hayward

    MediabistroHayward, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.new
    Experimental Design Expert Job at Howrecruit in Santa Clara

    Experimental Design Expert Job at Howrecruit in Santa Clara

    MediabistroSanta Clara, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    • serp_jobs.job_card.new
    Howrecruit is hiring : Experimental Design Expert in San Francisco

    Howrecruit is hiring : Experimental Design Expert in San Francisco

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_hours
    ZipRecruiter is hiring : Design Physicist in Livermore

    ZipRecruiter is hiring : Design Physicist in Livermore

    MediabistroLivermore, CA, United States
    serp_jobs.job_card.full_time
    Job Description Join us and make YOUR mark on the World! Are you interested in joining some of the brightest talent in the world to strengthen the United States’ security? Come join Lawrence Liverm...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Design Shop Leader

    Design Shop Leader

    Serena & LilyFremont, CA, US
    serp_jobs.job_card.full_time
    Serena & Lily is seeking a Design Shop Store Leader to lead our Design Shop in Palo Alto, CA.The Design Shop Leader is responsible for establishing and maintaining client services, oversees and...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days