GenAI Model Deployment Engineer

Job Title :   GenAI Model Deployment Engineer

Experience Required - 6+ Years

Must Have Technical / Functional Skills

1. Proven experience in deploying and managing machine learning models in production.

2. Strong programming skills in Python.

3. Experience with API development and integration.

4. In-depth knowledge of Generative AI model architecture and GPU architecture.

5. Familiarity with cloud platforms and containerization technologies (e.g., Docker, Kubernetes).

6. Excellent problem-solving skills and the ability to work independently and as part of a team.

7. Strong communication skills and the ability to collaborate effectively with stakeholders.

Roles & Responsibilities :

• Deploy and manage large language models (LLMs) in production environments.
• Perform benchmarking to evaluate model performance and optimize deployment strategies.
• Research and implement new frameworks and technologies for hosting and serving models.
• Collaborate with cross-functional teams to integrate machine learning models into existing systems.
• Develop and maintain APIs for model inference and other machine learning services.
• Monitor and troubleshoot model performance and infrastructure issues.
• Stay up-to-date with the latest advancements in machine learning, AI, and related technologies.