Job Description :
Pay Range $75hr - $87hr
Responsibilities :
- Design and build fault-tolerant infrastructure to support the Generative AI Ref architecture (RAG, Summarization, Agent etc).
- Ensure code is delivered without vulnerabilities by enforcing engineering practices, code scanning, etc.
- Build and maintain IAC (terraform / Cloud Formation), CICD (Jenkins) scripts,CodePipeline, uDeploy, & GitHub Actions.
- Partner with our shared service teams like Architecture, Cloud, Security, etc to design and implement platform solutions.
- Collaborate with the DS team to develop a self-service internal developer Generative AI platform.
- Design and build the Data ingestion pipeline for Finetuning LLM Models.
- Create templates (Architecture As Code) implementing Ref architecture application’s topology.
- Build a feedback system using HITL for Supervised finetuning.
Qualifications :
- Bachelor's degree in Computer Science, Computer Engineering, or a technical field.
- 4+ years of experience with AWS cloud.
- At least 8 years of experience designing and building data-intensive solutions using distributed computing.
- 8+ years building and shipping software and / or platform infrastructure solutions for enterprises.
- Experience with CI / CD pipelines, Automated Testing, Automated Deployments, Agile methodologies, Unit Testing and Integration Testing tools.
- Experience with building scalable serverless application (real-time / batch) on AWS stack (Lambda + step function)
- Knowledge of distributed NoSQL database systems.
- Experience with data engineering, ETL technology, and conversation UX is a plus.
- Experience with HPCs, vector embedding, and Hybrid / Semantic search technologies.
- Experience with AWS OpenSearch, Step / Lambda Functions, SageMaker, API Gateways, ECS / Docker is a plus.
- Proficiency in customization techniques across various stages of the RAG pipeline, including model fine-tuning, retrieval re-ranking, and hierarchical navigable small-world graph (HNSW) is a plus.
- Strong proficiency in embeddings, ANN / KNN, vector stores, database optimization, & performance tuning.
- Extensive programming experience with Python, Java.
- Experience with LLM orchestration frameworks like Langchain, LlamaIndex etc.
- Foundational understanding of Natural Language Processing, and Deep Learning.
- Experience with CI / CD pipelines, Automated Testing, Automated Deployments, Agile methodologies, Unit Testing, and Integration Testing tools.
- Excellent problem-solving skills and the ability to work in a collaborative team environment.
- Excellent communication skills.
Staff Data Engineer - Commercial Lines Data Modernization
The Hartford is looking for a Staff Data Engineer to join our Commercial Lines (CL) Data modernization and simplification program. You will have an opportunity to engage in enabling well architected cloud-based data solutions for data and analytics in support of BI, Actuarial, Data Science, Finance,...
GEN AI Data Platform Engineer
Job title: GEN AI Data Platform Engineer. We are seeking an innovative and experienced GEN AI Data Platform Engineer to join our cutting-edge team. Design, develop, and maintain scalable generative AI data platforms. The ideal candidate will have deep expertise in Python, large language models (LLMs...
Staff Data Engineer (Hartford, CT)
Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Hartford Fire Insurance Company in Hartford, CT has the following opening for a Staff Data Engineer. Implem...
Senior Site Reliability Engineer (L2) - (Google Data Platform Services)
We are looking for a motivated Site Reliability Engineer L2 with a focus on Google Data Platform Services to join our dynamic Production data support team. Google Cloud Platform services, especially data-related services like BigQuery, DataProc, composer and Cloud Storage. The ideal candidate will b...
Staff Data Engineer - Hybrid
Join a fast-paced and talented team to deliver Data Engineering capabilities for The Hartford's Commercial Data Science Data Delivery. Programming, SDLC practices, Distributed systems, Data warehousing solutions SQL and NoSQL, ETL tools, CICD, Cloud Technologies (AWS/AZURE),Python/Spark, Datamesh an...
Principal Data Engineer - EDS Platforms - Hybrid
Serve as the subject matter expert and technical leader for Data and Cloud Engineers for a broad range of data platforms, from cloud native services to SaaS data platforms, tools and internally developed data applications. Partner with Enterprise Architecture, Infrastructure and Data Platform Archit...
Staff Data Engineer (Hartford, CT)
Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Hartford Fire Insurance Company in Hartford, CT has the following opening for a Staff Data Engineer. Implem...
Staff Data Engineer - Hybrid
Join a fast-paced and talented team to deliver Data Engineering capabilities for The Hartford’s Commercial Data Science Data Delivery. Programming, SDLC practices, Distributed systems, Data warehousing solutions SQL and NoSQL, ETL tools, CICD, Cloud Technologies (AWS/AZURE),Python/Spark, Datamesh an...
Principal Data Engineer - EDS Platforms - Hybrid
Serve as the subject matter expert and technical leader for Data and Cloud Engineers for a broad range of data platforms, from cloud native services to SaaS data platforms, tools and internally developed data applications. Partner with Enterprise Architecture, Infrastructure and Data Platform Archit...
Staff Data engineer
Database systems, and develop tools for real-time and offline analytic processing; collaborate with Data Science team to transform data and integrate algorithms and models into automated processes; utilize programming skills in Python, SQL or similar languages to build robust data pipelines and dyna...