Hire Arun J. - LLM Engineer

* Spearheaded the development of Teladoc's first Generative AI-based project, creating high-quality clinical and chat summaries using techniques like prompt engineering, self-reflection and DSPy. Led the development of an AI chat assistant for chronic care members, incorporating Retrieval-Augmented Generation (RAG) and custom guardrails for patient safety. Lead engineer and significant contributor for developing and deploying Java, Scala ,Python-based APIs into production, successfully serving 1 million chronic care members. AI Skills & Technologies: High throughput asynchronous, non-blocking AI/ML APIs with Python, FastAPI, AsyncIO, Kafka. Experience with advanced LLM applications using Python, LangChain, Vector databases, Azure OpenAI / Open source Huggingface models, Kubernetes, Nemo Guardrails, MLFlow , RAGAS/LLM-As-Judge evaluation, Observability stacks. Knowledge of fine-tuning techniques, quantization, LLM serving libraries and optimizations. Backend Skills & Technologies: Scala(Play Framework), Java (Spring Boot), Python(FastAPI), Apache Kafka / Confluent cloud, Kafka Connectors, Kubernetes, Docker, Helm, MySQL, Redshift, Jenkins/CloudBees, Azure, Git , New Relic

* Lead engineer and significant contributor for developing and deploying Scala/Python-based services into production, successfully serving 1 million chronic care members. Led intiatives to identify, resolve, and remediate platform-level issues, such as the large-scale data inconsistencies across multiple services. Expert in troubleshooting and performance optimization, including resource contentions, SQL query performance problems, and bugs in code. Tech Stack : Scala, Python, Apache Kafka / Confluent cloud, Kafka Connectors, Kubernetes, Helm, MySQL, Redshift, Jenkins/CloudBees, Azure, Git , New Relic