Vrushank articles - 11 total
LLMs in Prod 2025: Insights from 2 Trillion+ Tokens
2024 marked the year when AI moved from experiments to mission-critical systems. But as organizations...
Model Context Protocol for building reliable, enterprise LLM applications
Picture the modern enterprise LLM application scene - from customer service chatbots parsing...
LLMs in Prod: The Reality of AI Outages, No LLM is Immune
This is Part 2 of our series analyzing Portkey's critical insights from production LLM deployments....
LLMs In Prod: Day 1
This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next...
Portkey is Joining Hacktoberfest
Portkey today is one of the most popular and performant open source AI Gateways in the market, and...
How I Optimized My Prompts For E-commerce Search Using DSPy
This is a guest post by Ganaraj, based on the talk he gave at the LLMs in Prod Meetup in...
Three Prompt Libraries you should know as an AI Engineer
As developers we write code to develop logic that eventually helps solve larger problems or automate...
Stream LLM Responses from Cache
LLMs can become more expensive as your app consumes more tokens. Portkey's AI gateway allows you to...
Open Source Models for your next AI use-case
Open-source models offer greater control, tools for quality improvement, and cost savings. They are...
OpenAI Model Deprecation Guide
On Jan 4, OpenAI will retire 33 models, including GPT-3 (text-davinci-003) and various others. This...
Find AI Grants, Compute Credits, and Investments
Did you know? Over $8 Million USD in investments & credits are up for grabs for early-stage AI...