OpenRouter Runner
1 like
OpenRouter Runner is a monolith inference engine, built with Modal. It serves as a robust solution for the deployment of tons of open source models that are hosted in a fallback capacity on openrouter.ai.
Cost / License
- Freemium
- Open Source
Platforms
- Self-Hosted
OpenRouter Runner
1 like
Features
No features, maybe you want to suggest one?
Tags
- llm-inference
OpenRouter Runner News & Activities
Highlights All activities
Recent activities
- Mostazzita commented on OpenRouter Runner
the closest thing to hugging chat
- Mostazzita liked OpenRouter Runner
- james22 updated OpenRouter Runner
- james22 added OpenRouter Runner
- POX updated OpenRouter Runner
OpenRouter Runner information
Developed by
OpenRouterTeam Licensing
Open Source (MIT) and Freemium product.Pricing
free version with limited functionality.Written in
Alternatives
0 alternatives listedSupported Languages
- English
What is OpenRouter Runner?
OpenRouter Runner is a monolith inference engine, built with Modal. It serves as a robust solution for the deployment of tons of open source models that are hosted in a fallback capacity on openrouter.ai.
Features:
- Autoscales/Load Balances Inference through the Modal.com /Microservice
- Integrate with platforms like HuggingFace for model download
- Observebility (through Datadog & Sentry)
End-User Interface: REST API only.
Management Interface: Modal CLI & "model.com" web service. (terminal usage required for setup).
Comments and Reviews
the closest thing to hugging chat