Your own ChatGPT Like service
- FREE from heavy hosting.
- FREE from costly API.
Meaning:
- You have a minimal website like 2GB RAM, 1GB disk, 1 CPU. ($4/mo?)
- You run the huge LLM model at home (32GB RAM or more, Powerful GPU, 1TB Disk, etc..).
- You use a free Kiponos plan (Single Dev / Team Starter) as mediator of any request and response from the model running at home.
BOOM!
Your website serves your home-running model in real-time!
Cons:
- Your website works as long as you run the LLM model at home.
- Initial Setup of Kiponos.io account. (Use a Free plan)
Pros:
- No API costs - you run your own model.
- No Hosting costs - the heavy RAM/CPU is used at your home. not in the hosting service.
That's an earthquake game changer - servicing LLM or any model!
How does Kiponos make it work?
- Kiponos provides real-time collaboration of multiple SDK instances.
- Your account defines a "Team" that multiple SDKs collaborates in.
- You have one Kiponos SDK at your hosting service running under a minimal server and webapp.
- You have the other Kiponos SDK running at home under your home server app that interface locally with your local LLM or any model you wish.
- Both SDKs works with the real-time hub of Kiponos.io service.
- Any Set/Get done by ANY of your SDK instances, is instantly dispatched to the Kiponos Server and distributed in real-time to all SDKs.
All Kiponos events are dispatched using WebSockets, permanent connection.
That's why everything is super fast in real-time.
Your team members always see the real-time state on Kiponos.io Web Admin.
Kiponos Web Admin is also WebSocket Based, so everything is instantly show online.
How do I get started?
Sign Up for a free plan at Kiponos.io (Single Dev or if you have a team, get the free Team Starter)
-
In Kiponos.io Web account: Define your various Envs like:
- Your Production WebSite env.
- Your Home Server env.
- (Optionally More envs? like Local Tests, Staging, etc..)
Generate your SDK tokens and use them as shown in Kiponos page.
Java SDK and coming next Python SDK and React SDK.
Kiponos support Java and Spring Boot framework to consume its SDK.
Following users demand, Kiponos will support soon Python and React.
That's it! Any model served for free without hosting costs!
Join the earthquake - Sign Up your own team: Kiponos.io