Job Title : Agentic AI Engineer / LLMOps
Duration : 6+ Months (Temp to Hire)
Location : Newark, NJ (Hybrid)
We are looking for an Agentic AI Developer to join our growing Agentic AI Platform team. This role will focus on developing, integrating, and managing enterprise-scale AI and MCP (Model Context Protocol) systems including Kong AI Gateway, AWS Bedrock, Azure AI Foundry, and Agentcore . The ideal candidate is hands-on, comfortable with platform engineering, and passionate about shaping the future of enterprise AI enablement.
Key Responsibilities :
- AI Gateway Management :
- Install, configure, and maintain Kong AI Gateway and related plugins (e.g., PII sanitation, observability, routing).
- Implement secure and scalable patterns for MCP server onboarding and routing.
- Agentic Platform Enablement :
- Develop and maintain enterprise agentic AI patterns for consistent and governed agent development.
- Integrate and evaluate platforms such as AWS Bedrock, Agentcore, and Azure AI Foundry for agent lifecycle management.
- Business Partnering :
- Collaborate with business units to design, develop, and deploy intelligent agents aligned with enterprise use cases.
- Create intake workflows and forms (e.g., via ServiceNow) to standardize request and approval processes for new agents or AI capabilities.
- Governance & Standards :
- Work with security and cloud teams to implement guardrails, logging standards, and LLM usage policies.
- Contribute to the development of Agentic AI engineering specifications and best practices.
- Continuous Improvement :
- Participate in platform assessments, proof-of-concepts, and production rollouts.
- Optimize cost, performance, and reliability across AI workloads.
Required Skills & Experience :
4+ years of experience in AI platform engineering, DevOps, or backend development.Hands-on experience with Kong Gateway or equivalent API / AI gateway technologies.Experience integrating with AWS Bedrock, Azure AI Foundry, Anthropic Claude, or Agentcore.Strong knowledge of Python, Node.js, or similar languages for automation and plugin development.Familiarity with ServiceNow, REST APIs, OAuth2 / OpenID, and observability toolingUnderstanding of LLM operations, governance, and security in enterprise settings.Excellent collaboration skills and ability to communicate with cross-functional teams (cloud, security, business).Python development and API development experiencePreferred Qualifications :
Prior experience with agentic frameworks or MCP server development.Knowledge of AI observability, model routing, or enterprise cost optimization.Contributions to AI governance, compliance, or ISO-standard development efforts.