Talent.com
serp_jobs.error_messages.no_longer_accepting
Experimental Design Expert Job at Howrecruit in Sunnyvale

Experimental Design Expert Job at Howrecruit in Sunnyvale

MediabistroSunnyvale, CA, United States
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Senior Data Analyst / Experimental Designer Expert

$170k–$210k USD + equity + annual bonus + incredible benefits

Remote (US / Canada)

Profitable Startup

Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior Data Analyst who lives and breathes experimental design. This isn't a role where experimentation is just one item on a long list. It's the core of what you'll do. You'll own the end-to-end experimentation program, designing rigorous A / B tests that directly shape product strategy and business decisions.

If you're someone who gets excited about power calculations, debates the merits of sequential testing, and has strong opinions about when to use stratification vs. blocking, we want to talk to you.

What you'll do :

  • Own the experimentation roadmap : Design, implement, and analyze sophisticated A / B tests and multivariate experiments that answer critical business questions
  • Be the experimentation subject matter expert : Educate stakeholders on experimental best practices, help them formulate testable hypotheses, and determine appropriate sample sizes and test durations
  • Navigate complexity : Handle challenges like network effects, interference between test groups, non-normal distributions, and multiple testing corrections
  • Drive statistical rigor : Choose appropriate statistical methods (frequentist, Bayesian, sequential testing) based on the context, and clearly communicate tradeoffs
  • Partner with engineering : Collaborate on instrumentation and randomization strategies to ensure experiments are implemented correctly
  • Establish guardrail metrics : Define and monitor metrics that protect the user experience and business health during experimentation
  • Build experimentation infrastructure : Create frameworks, templates, and documentation that scale experimentation across the organization
  • Democratize insights : Translate complex experimental results into clear recommendations that drive action
  • Support ad-hoc analysis : Write SQL queries, build dashboards in Snowflake and future BI tools, and respond to data requests as needed

Requirements :

  • Master's or PhD in Statistics, Mathematics, Economics, Biostatistics, Operations Research, or a related quantitative field (or equivalent advanced training in experimental design and statistical inference)
  • 5+ years of hands-on experience designing and analyzing experiments in a tech, product, or high-growth environment (graduate research involving experimental design counts toward this)
  • Expert-level understanding of experimental design principles : randomization, power analysis, multiple testing corrections, variance reduction techniques, and experimental validity (internal, external, construct)
  • Deep statistical knowledge : confidence intervals, hypothesis testing, regression analysis, ANOVA, and when to apply parametric vs. non-parametric methods
  • Advanced SQL skills : ability to write complex queries to calculate test metrics, detect data quality issues, and perform pre / post analysis
  • Strong Python skills : proficiency with statistical libraries (scipy, statsmodels, or similar) for experiment analysis and simulation
  • Experience with Snowflake or similar cloud data warehouses
  • Track record of impact : examples where your experimental insights led to meaningful product or business changes
  • Exceptional communication skills : ability to explain statistical concepts like p-values, confidence intervals, and sample size calculations to non-technical stakeholders
  • Bonus points for :

  • PhD with dissertation focused on experimental design, causal inference, or applied statistics
  • Familiarity with advanced methods like difference-in-differences, synthetic controls, or instrumental variables
  • Publications, conference talks, or blog posts about experimentation
  • Experience building internal experimentation tools or frameworks
  • Formal training in design of experiments (DOE) or clinical trial methodology
  • A Successful Candidate :

  • Is an experimentation evangelist : You're passionate about rigorous testing and help others understand why shortcuts lead to bad decisions
  • Balances theory with practice : You bring academic rigor but know how to apply it in fast-moving business contexts
  • Is naturally curious : You don't just run tests you dig into surprising results and form hypotheses about user behaviour
  • Is a clear communicator : You can explain why an experiment is underpowered or biased in a way that resonates with PMs and executives
  • Is proactive and independent : You identify opportunities for testing, advocate for experiments, and drive them to completion
  • Is collaborative : You work cross-functionally with product, engineering, marketing, and operations to build an experimentation culture
  • If you're an experimentation expert with strong quantitative training who wants to build a world-class testing program at a profitable, fast-growing startup, we'd love to hear from you. This is a chance to have outsized impact and work behind the scenes of one of the most successful bootstrapped companies you've never heard of.

    serp_jobs.job_alerts.create_a_job

    Design Design Job At • Sunnyvale, CA, United States

    Job_description.internal_linking.related_jobs
    • serp_jobs.job_card.promoted
    Physical Design Lead

    Physical Design Lead

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Product Manager with Design Focus

    Product Manager with Design Focus

    VirtualVocationsFremont, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Product Manager with a knack for Design (Figma).Key Responsibilities Ensure a well-thought-out and functional product Own the design process from concept to execution,...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Product Design Engineer

    Product Design Engineer

    VirtualVocationsSan Francisco, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Product Design Engineer for the Fans Portfolio.Key Responsibilities Lead the design and development of ceiling fans, integrating motor technologies and smart home conne...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Product Design Engineer

    Product Design Engineer

    OSI EngineeringCupertino, CA, US
    serp_jobs.job_card.full_time
    A globally leading technology company is looking for a Product Design Engineer to join its innovative Packaging Product Design team. In this role, you’ll help shape the unboxing experience that exci...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Lead Design Engineer

    Lead Design Engineer

    Pentangle Tech Services | P5 GroupNewark, CA, US
    serp_jobs.job_card.full_time
    Mechanical Design Lead Engineer - ADAS Sensing.Lucid's mission is to inspire the adoption of sustainable energy by creating the most captivating luxury electric vehicles, centered around the human ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Senior 4D Design Engineer

    Senior 4D Design Engineer

    AtkinsRéalisSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Assisting in the development and implementation of BIM strategic planning.Facilitate coordination meetings using BIM models to resolve conflicts. Ability to present 4D visualizations to clients, con...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Product Design Control Specialist

    Product Design Control Specialist

    VirtualVocationsHayward, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Product Design Control Specialist.Key Responsibilities Liaise between Product and Regulatory teams for all product DHF deliverables Drive timelines for product deliver...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Opto-Mechanical Design Engineer - Advanced Sensing Systems

    Opto-Mechanical Design Engineer - Advanced Sensing Systems

    US Tech Solutions, Inc.Mountain View, CA, US
    serp_jobs.job_card.temporary
    Duration : 7 months contract Job Description : We are seeking an Opto-Mechanical Design Engineer (Advanced Sensing Systems) to design, develop, and validate complex mechanical systems that operate re...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Physical Design Engineer at Apple Cupertino, CA

    Physical Design Engineer at Apple Cupertino, CA

    Itlearn360Cupertino, CA, United States
    serp_jobs.job_card.full_time
    Physical Design Engineer Job at Apple, Cupertino, CA.Cupertino, California, United States.Posted : Jun 27, 2025 | Weekly Hours : 40 | Role Number : 200609435. Apple is a place where extraordinary peopl...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Design Engineer

    Design Engineer

    ACCO Engineered SystemsPleasanton, CA, United States
    serp_jobs.job_card.full_time
    This position is responsible for the delivery of engineering services, from conceptual design through construction completion of HVAC, Plumbing, and other contract services offered by ACCO Engineer...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Design Verification Engineer

    Design Verification Engineer

    VirtualVocationsFremont, California, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Design Verification Engineer.Key Responsibilities Apply verification techniques and methodologies to verify designs independently Develop test plans, including ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    • serp_jobs.job_card.promoted
    Experimental Design Expert

    Experimental Design Expert

    HowrecruitFremont, CA, US
    serp_jobs.job_card.full_time
    Senior Data Analyst / Experimental Designer Expert.USD + equity + annual bonus + incredible benefits.Howrecruit has been retained by a profitable, high-growth home services platform to hire a Senior ...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Director, Product Design Job at C3 AI in Redwood City

    Director, Product Design Job at C3 AI in Redwood City

    MediabistroRedwood City, CA, United States
    serp_jobs.job_card.full_time
    Join to apply for the Director, Product Design role at C3 AI Join to apply for the Director, Product Design role at C3 AI C3 AI (NYSE : AI), is the Enterprise AI application software company.C...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    • serp_jobs.job_card.promoted
    Opto-Mechanical Design Engineer

    Opto-Mechanical Design Engineer

    US Tech SolutionsMountain View, CA, US
    serp_jobs.job_card.temporary
    We are seeking an Opto-Mechanical Design Engineer (Advanced Sensing Systems) to design, develop, and validate complex mechanical systems that operate reliably in challenging outdoor environments.Th...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_1_day
    Manager, Product Design - Expressive Design Job at Figma in San Francisco

    Manager, Product Design - Expressive Design Job at Figma in San Francisco

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Overview Figma is growing our team of passionate creatives and builders on a mission to make design accessible to all.Figma\'s platform helps teams bring ideas to life—whether you\'re brainstormin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    • serp_jobs.job_card.promoted
    Physical Design Engineer

    Physical Design Engineer

    WaymoMountain View, CA, United States
    serp_jobs.job_card.full_time
    Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    Sr. Design Technologist Job at CannonDesign in San Francisco

    Sr. Design Technologist Job at CannonDesign in San Francisco

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    Design Technologist at CannonDesign.The Senior Design Technologist is responsible for integrating technology into the design process, implementing advanced design workflows, and driving digital tra...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    Senior Design Specialist Job at Contract Professionals, Inc in San Jose

    Senior Design Specialist Job at Contract Professionals, Inc in San Jose

    MediabistroSan Jose, CA, United States
    serp_jobs.job_card.full_time
    Designer to support program initiatives.Creates innovative and practical mechanical and electro-mechanical concepts and designs for components, assemblies, tools, and products of varying complexity...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30
    UX Design Engineer Job at Hewlett Packard Enterprise in San Jose

    UX Design Engineer Job at Hewlett Packard Enterprise in San Jose

    MediabistroSan Jose, CA, United States
    serp_jobs.job_card.full_time
    Overview This role has been designed as Onsite with an expectation that you will primarily work from an HPE office.Responsibilities You will gather and evaluate UX requirements from Product Mana...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_variable_days
    UX Design Engineer Job at Skillsetafrica in San Francisco

    UX Design Engineer Job at Skillsetafrica in San Francisco

    MediabistroSan Francisco, CA, United States
    serp_jobs.job_card.full_time
    To see this working, head to your live site.All Gold is the engineering and ecommerce team behind some of the world's largest online brands. Since 2010, we've been building critical behind-the-scene...serp_jobs.internal_linking.show_moreserp_jobs.last_updated.last_updated_30