Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.
Cost / License
- Free
- Open Source (MIT)
Platforms
- Windows
- Mac
- Linux
- Android
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.
