Ian Macartney articles - 10 total
Work Stealing: Load-balancing for compute-heavy tasks
For fast, light-weight workloads, you can often get away with a small number of powerful machines....
Supercharge `npm run dev` with package.json scripts
npm run dev is the standard for "run my website locally," but how does it work? How can we expand its...
Convert your .json array to a .jsonl (JSON Lines)
JSON Lines is a file format that stores one JSON object per line in a file. This is more scalable...
Implementing Rate Limiting with only two numbers
There’s a lot of buzz about rate limiting, in part because of the cost exposure associated with LLM...
Streaming HTTP Responses using fetch
This post will look at working with the JavaScript Streams API which allows making a fetch HTTP call...
Multiple apps on a single domain hosted on sub-paths
tl;dr It's possible to deploy multiple apps on the same domain by serving each at a different...
GPT Streaming With Persistent Reactivity
Building ChatGPT-powered experiences feel snappier when the responses show up incrementally. Instead...
Using Pinecone and Embeddings
Looking to implement semantic search or add on-demand context to a GPT prompt so it doesn’t just make...
The Magic of Embeddings
How similar are the strings “I care about strong ACID guarantees” and “I like transactional...
Building a Full-Stack ChatGPT app
In this post, we’ll walk through putting together a full-stack chat app, and add some features....