PG

Hire Puneet G. - LLM Engineer - Remote

Llm Engineer

7+ years
delhi, delhi, india
Apple

About puneet

Hey there! I’m a software engineer and AI Agent expert with deep hands-on experience in Transformers, LLMs, MCPs, A2A, and Agentic AI frameworks. I specialize in building enterprise-scale applications and intelligent automation systems that deliver measurable impact. I thrive in Python, Go, and cloud-native environments (AWS, GCP), with strong expertise in Kubernetes orchestration (Docker, Helm) and observability/governance tools (Grafana, Loki, Mimir, Tempo, OPA, Terraform). AI/ML Expertise 1. LLMs & Transformers – Prompting, fine-tuning, domain adaptation. 2. Agentic AI, MCPs & A2A – Multi-agent workflows and cross-platform integrations. 3. ADK, Langraph, LangChain, VertexAI, HuggingFace – Rapid prototyping & deployment. 4. Agentic RAG, Knowledge Graphs, Reranking – Contextual search, retrieval, reasoning. 5. Backend Engineering – Scalable APIs with FastAPI, Django, Go Chi. AI Innovations & Core Work 1. GenAI Agentic Pytest Framework – Automated test code generation (75% beta accuracy, cut cycle by 60%). 2. LogWatch Agent – A connector-driven AI log analysis tool combining clustering and LLM summarization. Adopted across Palo Alto Networks NetSec teams, enabling complex workflows and reducing regression log review time by 60%. 3. RAG-as-a-Service – Serving 12 teams / 500+ users with RBAC backend, MCP/API connectors, synonym expansion, reranking, knowledge graph support, and multi-model embedding selection. 4. AI Copilot – Automated knowledge management, streamlining QA workflows. 5. Core Engineering Contributions – Designed and built RBAC service (10k+ req/sec), developed Garuda Operator (telemetry & observability), AutoSRE Operator (event-driven pipelines), and a Cardinality optimization tool that reduced large-tenant costs by 60%. Patents Filed 1. LogWatch – AI-powered clustering, summarization & connector-driven workflows. 2. RAG-as-a-Service (SYQR) – Multi-model embeddings & advanced knowledge bases. 3. Graph-based Anomaly Detection – ML + graph structures for rare event detection. 4. CodeTree – Hybrid tree for AI-driven code generation & semantic analysis. What I Bring I merge AI expertise (agents, transformers, MCPs, A2A, ADK, fine-tuning, RAG, knowledge graphs, reranking) with software engineering excellence. Known for a problem-solving mindset, collaboration, and execution focus, I thrive across Software Engineering, SRE, DevOps, and Full-Stack Development. #AIExpert #Transformers #MCPs #A2A #ADK #FineTuning #KnowledgeGraphs #Reranking #ProblemSolver #TeamPlayer #Focused #Determined #Committed

Key Skills

ai agentsamazon ec2amazon web servicesaws lambdacc++cloud securitydata structure and algorithmdeep learningdesign patternsdevopsdjangodjango rest frameworkdockerfastapi+24 more

Experience

Llm Engineer

Current

Apple

Applied ML Team @ Apple

Senior Staff Software Engineer

Palo Alto Networks

* AI Innovations 1. Architected and currently developing a GenAI-powered Agentic Pytest framework for automated test code generation, achieving 75% accuracy in beta and reducing the test automation cycle by 50%. 2. Introduced the LogWatch Agent, leveraging AI-based clustering and LLM-driven summarization and correlation, cutting regression log analysis time by 80%. 3. Building RAG-as-a-Service for Palo Alto Networks, incorporating knowledge graphs, synonym handling, and advanced reranking techniques. 4. Developed an Observability Agent ecosystem with 10+ agents and integrations across 50+ tools (Loki, Prometheus, GitLab Search, PagerDuty, Jira, etc.), reducing on-call and debugging time by 60%. 5. Created an AI Copilot Agent for automated knowledge management, significantly streamlining QA workflows. Core Development 1. Designed and developed the Garuda Operator, advanced telemetry tools, and cost optimization services for observability. 2. Built an event-driven Kubernetes operator to automate and streamline ETL data workflows. 3. Developed a cardinality optimization tool that reduced costs by 60% while improving performance for large-scale tenants. 4. Designed and deployed a high-performance RBAC service, supporting 10+ teams with throughput of 10K+ requests/second. 5. Integrated ML-driven insights into Grafana, Mimir, and Prometheus, enabling predictive observability. Patents Filed six patents, including LogWatch and the RAG-powered chatbot (SYQR), focused on advanced document ingestion and knowledge base creation.

Staff Software Engineer

Palo Alto Networks

I'm part of the Platform Engineering team working on Garuda (in-house observability solution), UNO (DataCenter Platform), and Devclues (IDP).

Education

G.b. Pant Govt. Engineering College

Bachelor Of Technology

G. B. Pant Govt. Engineering College

Bachelor Of Technology

G.b. Pant Govt. Engineering College

Bachelor Of Technology

Interested in connecting with puneet?

Sign up for NinjaHire to send a connection request.

Common Questions

What is puneet's expertise?

puneet specializes in LLM Engineer - Remote, with expertise in ai agents, amazon ec2, amazon web services, aws lambda, c.

Where is puneet located?

puneet is based in delhi, delhi, india.

How much experience does puneet have?

puneet has 7+ years of professional experience.

How can I contact puneet?

You can connect with puneet through NinjaHire by signing up for a free account.

Looking for a different LLM Engineer - Remote?

Describe exactly who you need and NinjaHire will source them for you.

Type a role to try NinjaHire for free