~ Staff Software Developer I

• Developed MVP GEN AI Gateway supporting inference from multiple LLM providers (OpenAI, Gemini, LLama) through a single interface.
• Integrated the UI to support chat inference with multiple models.
• Developed the configuration portal for the Gateway using React and ETCD as the key-value store.
• Integrated Keycloak and OpenID for enterprise authentication.
• Developed MVP for Secure RAG, enabling users to dynamically query files based on their access permissions.

~ Software Developer I & II

• Developed integration for an enterprise browser monitoring tool for Microsoft using Python, SQL, and multiprocessing.
• Developed the licensing server using public-key cryptography to provide SaaS services.
• Added CI/CD pipelines to generate binaries from source code using PyInstaller and created releases.
• Integrated Kafka and MongoDB for centralized record storage.
• Integrated and developed a Grafana dashboard to visualize analytics from centralized record storage.
• Packaged the services using Docker.

Contributed to the development and training of advanced Large Language Models (LLMs) by designing and implementing data generation processes for both Reinforcement Learning from Human Feedback (RLHF) and Supervised Fine-Tuning (SFT). Played a key role in ensuring high-quality training data that enhanced model performance, and collaborated with high-profile clients such as Google, Microsoft, and ServiceNow to tailor solutions that met their specialized requirements.