LLM Automation Framework Engineer

E-Solutions
California, United States
Full-time
  • Develop and Maintain LLM Automation Frameworks Design, implement, and maintain automation frameworks specifically tailored for Large Language Models.
  • Collaborate with cross-functional teams to ensure the seamless integration of LLM automation into the testing process.
  • Experience with specific Large Language Models (., GPT, BERT).Knowledge of cloud platforms and services (., AWS, Azure).
  • Certifications in software testing or related fields.
  • Integrate LLM automation tests into the continuous integration and continuous deployment pipelines.
  • Proven experience in developing and implementing automation frameworks for Large Language Models.
  • Strong programming skills in languages such as Python, Java, or similar.
  • Experience with popular testing tools and frameworks (., Selenium, JUnit, TestNG).
  • Experience with NLP (Natural Language Processing) concepts and techniques .
  • Familiarity with CI / CD pipelines and version control systems (., Jenkins, Git).

Strong problem-solving and analytical skills. Excellent communication and collaboration skills.

3 days ago
Related jobs
Promoted
Glocomms
Santa Clara, California

The position will lead a team of engineer who are supporting the growth of the AI/LLM platform using software-defined networking and software development. A global data and media company is looking to hire a Lead Engineer for their high-speed network infrastructure team. Strong exposure to high-spee...

Promoted
Lucid Motors
Newark, California

Software Development Engineer in Automation Framework Software development to play a vital role in ensuring Lucid’s vehicles meet Lucid’ rigorous standards. As a key member of our team, you will leverage your passion for software development with an eye toward quality to develop a robust core test a...

E-Solutions
California, United States

Develop and Maintain LLM Automation Frameworks Design, implement, and maintain automation frameworks specifically tailored for Large Language Models. Collaborate with cross-functional teams to ensure the seamless integration of LLM automation into the testing process. Integrate LLM automation tests ...

Apple
Cupertino, California

As a Tools and Automation Quality Engineer you will work alongside engineering teams to deeply understand the technology and develop test plans around it. This is a hybrid QA/Automation role with a focus on leading our overall automation effort for iOS. Your automation work will involve developing a...

E-Solutions
California, United States

Develop and Maintain LLM Automation Frameworks Design, implement, and maintain automation frameworks specifically tailored for Large Language Models. Certifications in software testing or related ate LLM automation tests into the continuous integration and continuous deployment experience in develop...

Apple
San Diego, California

The Wireless Frameworks and Services team is looking for a highly motivated and talented Software Engineer to help develop and maintain automation across all Apple platforms. Responsibilities: Design and implement new classes and tools to aide in the development of our newest framework Triage framew...

Asana
San Francisco, California

Software Engineer, LLM Frameworks and Tools. Within the AI Org at Asana, the LLM Frameworks and Tooling Team is responsible for supporting and scaling Large Language Model (LLM) development across all of Asana. We are a team with a broad charter that serves multiple customers – we manage the infrast...

Promoted
Northrop Grumman
Palmdale, California

Northrop Grumman Aerospace Systems has an opening for an experienced Engineer Software (T02) – Integration & Test engineer to join our team of qualified, diverse individuals. Candidate will work with software developers and other engineers, as needed, to help diagnose and identify the root cause...

Promoted
Elastic
Mountain View, California

We're looking for a Software Engineer to join the Elasticsearch - Search team. This is a senior software engineering role that focuses on enhancing the vector similarity search functionality within Elasticsearch, covering the design and implementation of new vector search features, enhancements to e...

Promoted
VirtualVocations
Downey, California

Software Development Engineer in Test for a CRM platform and operating system....