Job Description : GenAI Engineer
Location : Remote is acceptable but ideally able to work with some overlap for West coast US timezone
GenAI Engineer (RAG / LLM)
Seeking a highly skilled and experienced GenAI Engineer with a strong background
in Data Engineering and Software Development to join our team. The ideal candidate will focus on
enhancing our information retrieval and generation capabilities, with specific experience in Azure AI
Search, data processing for RAG, multimodal data integration, and familiarity with Databricks.
In this role, you will be responsible for developing a comprehensive framework that focuses on data
ingestion processes (vector databases and text-to-SQL). This framework will ensure seamless
integration and accessibility of data, which will be consumed by an LLM-based chatbot to optimize
and enhance semiconductor manufacturing processes.
Key Responsibilities :
- Design, develop, and optimize Retrieval-Augmented Generation models to improve
information retrieval and generation processes within our applications.
Develop and maintain search solutions using Azure AI Search to ensure efficient andaccurate information access
Process and prepare data to support RAG workflows, ensuring data quality and relevance.Integrate and manage various data types (e.g., text, images) to enhance retrieval andgeneration capabilities.
Work closely with cross-functional teams to integrate data into our existing retrieval eco-system, ensuring seamless functionality and performance.
Ensure the scalability, reliability, and performance of data retrieval in productionenvironments.
Stay updated with the latest advancements in AI, ML, and data engineering to driveinnovation and maintain a competitive edge.
Projects include :
Azure AI Search Indexing : Implementing advanced search indexing solutions using Azure AIto enhance data accessibility and retrieval.
LLM RAG Chatbot : Support development of chatbot using RAG to improve customersupport and interaction.
What we're looking for :
Bachelor's degree in computer science, Data Science, or a related field.Master's degree in data science or a related field is preferred.Approximately 8 years of experience in Data Science, MLOps, and Data EngineeringProven experience in AI and ML solution implementation, particularly in semiconductormanufacturing.
Proficiency in PythonProven experience in data engineering and software development, with a focus on buildingand deploying RAG pipelines or similar information retrieval systems.
Familiarity with processing multimodal data (e.g., text, images) for retrieval and generationtasks.
Strong understanding of database systems (SQL and NoSQL) and data warehousingsolutions.
Proficiency in Azure AI, Databricks, and other relevant tools and technologies.Excellent problem-solving skills and the ability to work independently and collaboratively ina team environment.
Strong communication skills to effectively convey technical concepts to non-technicalstakeholders.
Experience in developing and deploying scalable ML models in production environments.