gen-ai-proxy

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics.

Dashboard view

Cost / License

  • Free
  • Open Source

Platforms

  • Self-Hosted
-
No reviews
0likes
0comments
0alternatives
0news articles

Features

Suggest and vote on features
No features, maybe you want to suggest one?

 Tags

  • openai-proxy
  • ai-gateway
  • llm-gateway
  • OpenAI
  • llmops

gen-ai-proxy News & Activities

Highlights All activities

Recent activities

Show all activities

gen-ai-proxy information

  • Developed by

    PL flagMotlify

  • Licensing

    Open Source (Apache-2.0) and Free product.

  • Written in

  • Alternatives

    0 alternatives listed

  • Supported Languages

    • English

AlternativeTo Category

AI Tools & Services

GitHub repository

  •  3 Stars
  •  0 Forks
  •  0 Open Issues
  •   Updated  
View on GitHub
gen-ai-proxy was added to AlternativeTo by Tafeen on and this page was last updated .
No comments or reviews, maybe you want to be first?
Post comment/review

What is gen-ai-proxy?

gen-ai-proxy - a self-hosted, open-source (Apache 2.0) proxy for LLM's

🔍 Track token usage per model/provider 📊 Exposes Prometheus metrics – ready for Grafana dashboards 🔌 Supports OpenAI-compatible endpoints 🧩 Multiple models/providers per user 🔐 API-key auth, JWT, and full Docker-compose deployment in minutes

Packed with simple UI and REST API, deployed easily with docker

Built for devs, ops, and anyone who loves control + visibility.

Official Links

AppStores & Other Links