OhhO Serve
Prototype inference console.
- Category: Intelligence
- Accent: cyan
- Live app: Open the console
A prototype console with simulated responses. 4-bit quantisation, Prometheus metrics, request batching, and a Docker single-command deploy are not built.
Overview (hero)
Serve is a prototype console. Works today: a browser playground that returns a simulated action. 4-bit quantisation, Prometheus metrics, request batching, and a Docker single-command deploy are not built.
Highlights
- Prototype console — simulated responses
- Does not load a model onto a GPU
- Vision: not built
What you get
- Works today is the console on this site. It shows a simulated predict response. It does not serve a Vision-Language-Action model.
- 4-bit quantisation, Prometheus, request batching, and a Docker single-command deploy are not built.
Features
- Simulated predict — The console returns a deterministic sample action. It is not a running model server.
- Vision: not built — 4-bit quantisation, Prometheus metrics, request batching, and a Docker single-command deploy are not built.
How it works
- Open the console — You see a simulated predict playground.
- Read the numbers as a sample — Latency and throughput on the page are not scraped from a metrics endpoint.
- Do not deploy from this page — There is no single command and no Docker image published from this site.
- Use the public training scripts for OmniBot — Recording and training scripts live in the public OmniBot repository. They are not this console.
Specs
| Spec | Value |
|---|---|
| Status | Prototype console with simulated responses |
| Quantization | 4-bit quantisation is not built. |
| Metrics | Prometheus is not built. |
| Batching | Request batching is not built. |
| Deploy | Docker, single command is not built. |
Plans
There is no paid plan. The console demo is free. Hosted cloud is a waitlist, not a checkout.
FAQ
Can I run my own fine-tuned model? Not from this console. It returns a simulated action. It does not load a checkpoint.
Where does inference run? It does not. The page is a prototype. 4-bit quantisation, Prometheus, batching, and a Docker single-command deploy are not built.