Apps tagged with 'llm-inference' Page 2 of 3

All apps in Apps tagged with 'llm-inference' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Corpus2GPT icon
     1 like

    Corpus2GPT: A project enabling users to train their own GPT models on diverse datasets, including local languages and various corpus types, using Keras and compatible with TensorFlow, PyTorch, or JAX backends for subsequent storage or sharing.

    Cost / License

    Platforms

    • Self-Hosted
    Training GPT from scratch in an artificial dummy data in 50 lines of code!
    5 alternatives
  2. Lexora is an AI infrastructure platform that provides hosted AI models, knowledge bases (RAG), image generation, and access to frontier AI models through a unified API. Developers can build AI assistants, chat with documents, and pay only for what they use instead of renting GPUs.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Landing Page
    RAG trained AI Assistant for free!!
    Usage Graph!
    +1
    Nodes available!
    9 alternatives
  3. Arch icon
     Like

    The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    Arch screenshot 1
  4. OpenAdapter is an AI gateway sold as a flat subscription. One API key gets you 40+ open-source models (DeepSeek, Qwen, Kimi, GLM, MiniMax, Mistral, Llama) plus web search, OCR, vision, embeddings and a vector DB. Works with Cursor, VS Code, Claude Code, Zed and any OpenAI-compatible app.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Windows
    • Mac
    • Linux
    The AI Subscription developers must have
    View your usage in the dashboard
    Models
    +1
    View your Quota and Usage metrics
    45 alternatives
  5. The DeepSeek API provides developers with direct access to DeepSeek’s advanced AI models, enabling them to run text, code, and multimodal tasks through simple endpoints for seamless integration into applications.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    DeepSeek Platform screenshot 1
    DeepSeek Platform screenshot 1
    DeepSeek Platform screenshot 2
    +1
    DeepSeek Platform screenshot 3
    16 alternatives
  6. GPUniq icon
     Like

    GPUniq is a stable GPU compute platform built for AI teams and developers who need reliable performance without paying traditional cloud prices. It provides on-demand access to powerful GPUs for LLM training, inference, computer vision, generative workloads, and 3D rendering —...

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    search page
    Page with opensource  hosted LLMs
    GPU Burst feature
  7. GMI Cloud icon
     Like

    You’re about to supercharge your AI models with lightning-fast inference. Inference Engine makes it easy to scale, and optimize your models for real-time performance. Let’s get started—your AI is ready to shine.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    GMI Cloud screenshot 1
    GMI Cloud screenshot 1
    GMI Cloud screenshot 2
    +1
    GMI Cloud screenshot 3
    29 alternatives
  8. Lyrio.ai icon
     Like

    Lyrio.ai is an AI-powered workspace built for people who use AI to think, research, and write — not just chat. Unlike linear chatbots that forget context the moment a session ends, Lyrio gives you a persistent, branching canvas where every conversation, insight, and document...

    Cost / License

    • Freemium
    • Proprietary

    Application types

    Platforms

    • Online
    Lyrio AI Workspace
    Branching
    Pins
    +3
    Synthesize
    8 alternatives
  9. EZmodel icon
     Like

    Abstract the complexity, focus on building great products. Fully compatible with OpenAI SDK - no new API to learn. From creative to production, AI capabilities at your fingertips.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    EZmodel screenshot 1
    EZmodel screenshot 1
    EZmodel screenshot 2
    +1
    EZmodel screenshot 3
    23 alternatives
  10. inferit icon
     Like

    inferit is a visual take on LLM inference. Most inference frontends are limited to a single visual input/output "thread". This makes it hard to compare output from different models, prompts and sampler settings.

    Cost / License

    Platforms

    • Online
    • Self-Hosted
    inferit screenshot 1
    inferit screenshot 1
    inferit screenshot 2
  11. Welcome to Vanish Private AI Chat by Startpage, your mystical AI chat companion available today on iOS. Vanish Private AI ensures your privacy & security by never logging your IP address or chat queries, saving conversations only locally on your device (never on our...

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • iPhone
    • iPad
    • Android
    Vanish Private AI screenshot 1
    Vanish Private AI screenshot 1
    Vanish Private AI screenshot 2
    +4
    Vanish Private AI screenshot 3
    19 alternatives
  12. Run and fine-tune generative AI models with easy-to-use APIs and highly scalable infrastructure. Train and deploy models at scale on our AI Acceleration Cloud and scalable GPU clusters. Optimize performance and cost.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Together AI screenshot 1
    29 alternatives
  13. LitGPT icon
     Like

    Every LLM is implemented from scratch with no abstractions and full control, making them blazing fast, minimal, and performant at enterprise scale.

    Cost / License

    Platforms

    • Windows
    • Linux
    • Mac
    • Python
    1 alternatives
  14. LogFare icon
     Like

    OpenAI-compatible API with access to frontier models. Create a free account, get your API key, and start building. No rate limits, no credit card.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
    LogFare screenshot 1
    LogFare screenshot 1
    LogFare screenshot 2
    +1
    LogFare screenshot 3
    14 alternatives
  15. Infercom icon
     Like

    EU sovereign Enterprise AI inference platform with OpenAI-compatible API for running open-source LLMs on dedicated infrastructure in Europe. Full GDPR, no US CLOUD act exposure.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    Dashboard
    Playground
    Plans
    6 alternatives
  16. Fellou icon
     Like

    An innovative, AI-driven web browser designed to revolutionize online interactions by integrating advanced artificial intelligence into every aspect of browsing.

    Cost / License

    • Free
    • Proprietary (MIT)

    Platforms

    • Mac
    Fellou screenshot 1
    Fellou screenshot 1
    Fellou screenshot 2
    +44
    Fellou screenshot 3
    3 alternatives
  17. NetMind icon
     Like

    Net the future, power the AI. From APIs to enterprise solutions.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    NetMind screenshot 1
    9 alternatives
  18. A serverless AI platform that runs models on Cloudflare's network, offering over 50 open-source models and a comprehensive suite for global application deployment.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Cloudflare Workers AI screenshot 1
    Cloudflare Workers AI screenshot 1
    52 alternatives
  19. Inkarms icon
     Like

    Open-source AI agent automates coding tasks from the terminal, logs actions locally, operates in a secure environment, and integrates with Slack, Telegram, and Discord.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Telegram
    • Discord
    • Slack
    • Terminal
    • WhatsApp
    • Telegram bot API
    Inkarms screenshot 1
    9 alternatives
  20. OpenAI Platform’s ChatGPT API lets you integrate GPT-5 series models to generate text, analyze and create images, work with audio, produce structured outputs, and build tool-using agents.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    OpenAI Platform screenshot 1
    OpenAI Platform screenshot 1
    OpenAI Platform screenshot 2
    +2
    OpenAI Platform screenshot 3
    18 alternatives
  21. Groq icon
     Like

    Groq is a technology company offering GroqCloud, a high-performance inference platform designed to deliver ultra-fast, low-cost AI model execution.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    Groq screenshot 1
    Groq screenshot 1
    Groq screenshot 2
    17 alternatives
  22. Luminal icon
     Like

    Luminal compiles AI models to give you the fastest, highest throughput inference in the world.

    Cost / License

    Platforms

    • Online
    • Software as a Service (SaaS)
    Luminal screenshot 1