OpenJev
An open decision server that speaks the same wire protocol on an open model, so the official SDKs can be pointed at it. Its distinguishing choice is to read answers out of the model's own token probabilities instead of parsing generated text, which is closer to what the hosted model does. The price is a patched inference backend and a GPU or Apple silicon machine to run it on.
- self-hosted
- vllm
- mlx
- diffusiongemma
- logprobs
- From
- razorback16
- License
- Apache-2.0
- Language
- Python
- GitHub stars
- 427 (2026-09-26)
- Published
- 2026-09
- Listed here
- 2026-09-26
Sources checked
Also in this category
Open implementations- Open implementations
LocalJev
A bridge rather than a reimplementation: it keeps the request and response shapes, but gets its probabilities by asking an ordinary local chat model for a JSON number and then validating and normalising the result. That lets it run against a plain OpenAI-compatible server with no patched backend, and the README is explicit that a self-reported probability is not the same thing as a logit read. Check the calibration before you threshold on it.
GitHub Next776 stars2026-09-18