Talent.com
Senior Machine Learning Test Engineer
Senior Machine Learning Test EngineerMetropolis • Seattle, WA, US
Senior Machine Learning Test Engineer

Senior Machine Learning Test Engineer

Metropolis • Seattle, WA, US
job_description.job_card.variable_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Job Description

Job Description

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

We are seeking a Senior Machine Learning Test Engineer with a passion for quality, automation, and real-world impact. In this role, you will be responsible for designing, developing, and executing robust test strategies for cutting-edge perception systems. At Metropolis, we build complex, distributed computer vision systems that span a wide range of platforms, from cameras and embedded edge devices to large-scale cloud infrastructures. These systems power, critical, real-time decisions across parking and new verticals. As a Senior Test Engineer, you will play a pivotal role in verifying that each component in this ecosystem functions correctly in isolation and as part of an integrated system. You'll collaborate closely with engineers across software, hardware, and machine learning teams to define test coverage, develop test harnesses, and identify edge cases that impact performance in production. You will also help shape and improve our continuous integration pipelines and automated validation frameworks to support fast iteration and robust releases.

What you'll do

  • Design and implement test plans, test cases, and test automation frameworks for computer vision and machine learning pipelines
  • Validate the end-to-end performance of CV applications such as object detection, classification, and tracking under diverse scenarios and edge cases
  • Analyze system-level behavior and KPIs (latency, accuracy, robustness) using metrics-driven methodologies
  • Develop tools for test data generation, synthetic validation, and visualization of perception outputs
  • Collaborate with software, ML, hardware, and QA teams to ensure end-to-end system validation and release readiness
  • Investigate, root-cause, and document bugs and issues across the perception stack
  • Drive continuous improvement in test coverage, test automation, and system reliability

What we're looking for

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, Robotics, or a related field
  • 5+ years of hands-on experience in software or system testing, with at least 2 years focused on computer vision (CV), perception, or machine learning systems in production
  • Proficiency in Python and C++ for test automation and strong experience with unit testing frameworks like GTest or PyTest
  • Experience designing and implementing end-to-end test strategies for distributed systems, including using version control like Git and CI / CD pipelines like Jenkins or GitHub Actions
  • Solid understanding of computer vision concepts such as detection, tracking, segmentation, and 2D / 3D geometry
  • Demonstrated experience testing perception or computer vision systems in real-world or hardware-in-the-loop (HIL) environments
  • Familiarity with common ML frameworks like PyTorch and TensorFlow, and CV libraries like OpenCV
  • Strong debugging, profiling, and log analysis skills, especially in embedded or real-world deployment environments
  • Experience with containerization tools like Docker and simulation platforms such as CARLA or NVIDIA Drive Sim
  • Excellent communication skills with a strong ownership mindset and the ability to work independently
  • When you join Metropolis, you'll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. The anticipated base salary for this position is $150,000.00 USD to $180,000.00 USD annually. The actual base salary offered is determined by a number of variables, including, as appropriate, the applicant's qualifications for the position, years of relevant experience, distinctive skills, level of education attained, certifications or other professional licenses held, and the location of residence and / or place of employment. Base salary is one component of Metropolis's total compensation package, which may also include access to or eligibility for healthcare benefits, a 401(k) plan, short-term and long-term disability coverage, basic life insurance, a lucrative stock option plan, bonus plans and more. #LI-NM1 #LI-Onsite

    Metropolis values in-person collaboration to drive innovation, strengthen culture, and enhance the Member experience. Our corporate team members hold to our office-first model, which requires employees to be on-site at least four days a week, fostering organic interactions that spark creativity and connection

    Metropolis may utilize an automated employment decision tool (AEDT) to assess or evaluate your candidacy for employment or promotion. AEDTs are used to assist in assessing a candidate's application relative to the required job qualifications and responsibilities listed in the job posting.

    As part of this process, Metropolis retains data relevant to your candidacy, including personal information, for a period that is reasonably necessary for the use of the tool. If you are hired for the position, your data may become part of your employee records.

    Metropolis Technologies is an equal opportunity employer. We make all hiring decisions based on merit, qualifications, and business needs, without regard to race, color, religion, sex (including gender identity, sexual orientation, or pregnancy), national origin, disability, veteran status, or any other protected characteristic under federal, state, or local law.

    serp_jobs.job_alerts.create_a_job

    Senior Machine Learning Engineer • Seattle, WA, US

    Job_description.internal_linking.related_jobs
    Senior AI / ML Engineer

    Senior AI / ML Engineer

    VirtualVocations • Kent, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior AI / ML Engineer to design, develop, and deploy advanced machine learning solutions.Key Responsibilities : Design, develop, and deploy machine learning models and a...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    VirtualVocations • Kent, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for an Applied Research - Evals & Data professional.Key Responsibilities Design and iterate on next-generation AI agents for real-world applications Develop distributed syst...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior GNC Engineer

    Senior GNC Engineer

    VirtualVocations • Everett, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Guidance, Navigation, & Control (GNC) Engineer.Key Responsibilities Develop and validate a novel high-level vehicle architecture with engineering leads Crea...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Machine Learning Engineer

    Senior Machine Learning Engineer

    VirtualVocations • Everett, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Machine Learning / MLOps Engineer (Remote Opportunity).Key Responsibilities Design and implement algorithmic product architectures and MLOps frameworks across vari...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Generative Machine Learning Engineer

    Generative Machine Learning Engineer

    VirtualVocations • Everett, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Generative Machine Learning Engineer.Key Responsibilities Develop and implement Deep Learning Pipelines using cutting-edge models Sustain the infrastructure for Deep L...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AIML-Sr. On-Device Machine Learning Engineer, Measurement

    AIML-Sr. On-Device Machine Learning Engineer, Measurement

    Apple Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    On-Device Machine Learning Engineer, Measurement.Seattle, Washington, United States Software and Services.We are looking for an experienced on-device machine learning engineer to join our team and ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    AIML - Senior / Staff Software Engineer, Machine Learning Platform Technologies

    AIML - Senior / Staff Software Engineer, Machine Learning Platform Technologies

    Apple • Seattle, WA, US
    serp_jobs.job_card.full_time
    AIML - Senior / Staff Software Engineer, Machine Learning Platform Technologies.Seattle, Washington, United States.Shape the future of search at Apple. The Search Information Intelligence organization...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer

    Machine Learning Engineer

    Zachary Piper Solutions • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Zachary Piper Solutions is seeking a highly skilled and experienced,.AI / Machine Learning Engineer.Federal Engineering team focused on. In this role, you'll help architect and deploy cutting-edge, ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Staff Software Engineer, Machine Learning

    Staff Software Engineer, Machine Learning

    VirtualVocations • Tacoma, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Staff Software Engineer, Machine Learning.Key Responsibilities Set architectural direction and tackle systemic challenges to raise the technical bar for the team Desig...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Senior Test Associate

    Senior Test Associate

    VirtualVocations • Renton, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior Test Associate to validate and support hybrid cloud storage solutions.Key Responsibilities Execute and validate end-to-end test scenarios for hybrid cloud storag...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Senior MLOps Engineer

    Senior MLOps Engineer

    VirtualVocations • Tacoma, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Senior MLOps Engineer to design, build, and scale systems for AI capabilities.Key Responsibilities Design and maintain end-to-end ML pipelines for model training, evalu...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Principal / Senior Machine Learning Engineer

    Principal / Senior Machine Learning Engineer

    IntelliPro Group Inc. • Seattle, WA, US
    serp_jobs.job_card.full_time
    serp_jobs.filters_job_card.quick_apply
    Principal / Senior Machine Learning Engineer Position Type : FTE Location : San Francisco / Portland , ME / Boston / Chicago / Seattle Salary Range : $ 20 0,000 - $ 270 , 000 (USD) Job ID# : ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30
    Machine Learning Product Engineer

    Machine Learning Product Engineer

    VirtualVocations • Kent, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a Full-Stack Machine Learning Product Engineer.Key Responsibilities : Deliver edge-focused product experiences integrating machine learning for intelligence officers and f...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Sr. Machine Learning Engineer

    Sr. Machine Learning Engineer

    Highspot • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Highspot is pioneering the category that is fundamentally changing the way companies increase sales productivity.On a mission to transform the way millions of people work with sales enablement, Hig...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Applied Machine Learning Engineer

    Applied Machine Learning Engineer

    VirtualVocations • Tacoma, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for an Applied Machine Learning Engineer to develop production-grade AI solutions.Key Responsibilities Design, build, and deploy end-to-end generative AI applications and age...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    QA Manual Test Engineer

    QA Manual Test Engineer

    VirtualVocations • Renton, Washington, United States
    serp_jobs.job_card.full_time
    A company is looking for a QA / Manual Test Engineer.Key Responsibilities Participate in bug bashes and ensure project specifications are met before production release Conduct exploratory testing ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_hours • serp_jobs.job_card.promoted • serp_jobs.job_card.new
    Satellite Test HW Engineer, Integrated Vehicle Test

    Satellite Test HW Engineer, Integrated Vehicle Test

    Amazon Kuiper Manufacturing Enterprises LLC • Redmond, WA, United States
    serp_jobs.job_card.permanent
    Project Kuiper is Amazon’s low Earth orbit satellite broadband network.Its mission is to deliver fast, reliable internet to customers and communities around the world, and we’ve designed the system...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted
    Machine Learning Engineer, Siri Attention & Invocation

    Machine Learning Engineer, Siri Attention & Invocation

    Apple Inc. • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Machine Learning Engineer, Siri Attention & Invocation.Seattle, Washington, United States Machine Learning and AI.You will be part of a team whose focus is on applied machine learning, on building ...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer in Test

    Senior Software Engineer in Test

    HRB • Seattle, WA, United States
    serp_jobs.job_card.full_time
    Our client is a community-developed, commercially supported fork of the MySQL relational database management system, making a huge impact on the world. Our client's product was built from the ground...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_30 • serp_jobs.job_card.promoted
    Senior Software Engineer in Test (SDET)

    Senior Software Engineer in Test (SDET)

    The Nuclear Company • Seattle, WA, US
    serp_jobs.job_card.full_time
    Senior Software Engineer in Test (SDET).The Nuclear Company (TNC) is at the forefront of revolutionizing nuclear energy through cutting-edge technology and innovative digital solutions.We're buildi...serp_jobs.internal_linking.show_more
    serp_jobs.last_updated.last_updated_variable_days • serp_jobs.job_card.promoted