jai.mom
A reverse WebSocket tunnel that bridges your local Ollama instance to a public API endpoint. No port forwarding. No price. Always.
A public Node.js server that acts as the entry point. It authenticates requests and routes traffic.
Your PC connects outbound via a WebSocket. No need to open router ports or mess with firewalls.
Requests are executed on your local GPU via Ollama, and the text is streamed back instantly.
Only allowed websites are permitted to send requests. All others are blocked by CORS.
Register on this dashboard to generate your API keys.
Build from source — the prebuilt binaries are tied to a different host. Clone the repo and run npm install && npm start from client/electron-app.
Copy your Slug and Key from the Dashboard into the App.
Copy your Slug and Key from the Dashboard to the website you would like to use it on, and enjoy.
Head over to my discord and into the Neural Gateway category for more info.
Don't trust the EXE and a inconspicuous virus total result? Good.
The entire stack is open source.