Developed LLMInspect, GenAI Gateway, as a comprehensive solution to enhance enterprise AI experiences while ensuring security cyber safety. The goal was to create a unified interface that allows users to interact seamlessly with different LLM models such as (OPENAI, Gemini, Local LLMs), all while maintaining strict control over data exchanges. It mask your personal data while you chat with the AI. It also provide the admin dashboard. In which you can view user sentiments, request blocked and model usage.

Technologies Used 🔧

• FastAPI ⚡
• React ⚛️
• OPENAI API 🤖
• GEMINI API 🚀
• SGLang 🔤
• Llama Guard 🔐
• Django 🐍
• Microservices 🔗
• Docker 🐳
• Grafana 📊
• Open Telemetry 🛰