LLM operations tools with a free plan

Figure and bar: visits/mo, estimate · year: online since

1. #3O

   OpenRouter

   Routes API requests to 500 language models across 80 providers through a unified interface.

   224k
   Active
   From $5.50/mo
   2023
2. #4A

   AI21

   Routes requests between open-source and frontier models to reduce token costs while maintaining quality.

   103k
   Active
   From $0.20 per use
   2017
3. #5L

   LangChain

   Provides the open-source LangChain and LangGraph frameworks for building LLM applications and agents, plus LangSmith for tracing, evaluating and deploying them.

   92.2k
   Active
   From $39/user/mo
   2023
4. #7M

   Mistral

   Provides frontier language models, agents, and infrastructure for building custom AI systems.

   63.6k
   Active
   From $14.99/user/mo
   2023
5. #9M

   Modal

   Runs inference, training, and batch processing workloads on GPUs with instant autoscaling and sub-second cold starts.

   52.1k
   Active
   From $0/mo
6. #10T

   Truefoundry

   Routes requests to language models and agents with observability, access controls, and deployment across cloud or on-premises infrastructure.

   46.2k
   Active
   From $25/user/mo
7. #13L

   LLM Stats

   Ranks and compares 300 AI models by intelligence, speed, price, and context window.

   29.1k
   Active
   Free
8. #14G

   GreenPT

   Provides AI chat, APIs, and specialized tools running on European renewable energy infrastructure with transparent energy tracking.

   28k
   Active
   From ≈ $5.06/mo
   2025
9. #16W

   Weights & Biases

   Tracks machine learning experiments, manages models and datasets, and monitors AI applications in production.

   21.2k
   Active
   From $60/mo
   2017
10. #19L

    LiteLLM

    Routes requests across 140+ LLM providers and 1800+ models through a single API gateway with cost optimization and access controls.

    15.2k
    Active
    Free plan
    2023
11. #20L

    Lightning AI

    Cloud platform from the PyTorch Lightning team for developing, training and serving AI models on GPUs.

    14.1k
    Active
    Free plan
12. #21B

    Braintrust

    Observability platform that traces agent execution, evaluates outputs, and discovers production patterns to improve quality.

    13.7k
    Active
    From $249/mo
    2022
13. #22L

    Liquid AI

    Distributes small foundation models optimized to run on devices without sending data to servers.

    11.3k
    Active
    Free plan
    2023
14. #24F

    Fireworks AI

    Hosts open-weight language and image models for fast inference via API, with fine-tuning and dedicated GPU deployments.

    8.7k
    Active
    From $0.01 per use
15. #25L

    Langfuse

    Traces, evaluates, and monitors language model applications in production with observability and prompt management.

    7.5k
    Active
    From $29/mo
16. #27H

    HoneycombMCP · sign-in

    Stores and queries distributed traces, logs and metrics in real time to debug production services, including LLM and agent calls.

    6.5k
    Active
    From $150/mo
    2016
17. #29E

    EdgeChatMCP · open

    Runs one language model on your Mac for offline chat, slide decks, medical and legal lookups, and permission-gated web search.

    6.1k
    Active
18. #30B

    Baseten

    Deploys and serves AI models in production with optimized inference across cloud infrastructure.

    5.9k
    Active
    Free plan
    2019
19. #31P

    Portkey

    Routes requests to 1600 language models through a unified API with observability, guardrails, and prompt management.

    5.9k
    Active
    From $49/mo
20. #32O

    OpenLayer Agents

    Tests and monitors machine learning and LLM systems with configurable evaluations before release and tracing, cost and policy checks in production.

    4.7k
    Active
    Free plan
    2021
21. #33S

    Supermemory MCP

    Stores and retrieves long-term memory for AI agents through an API, indexing conversations and files and injecting relevant context into prompts.

    4.6k
    Active
    From $19/mo
22. #34M

    Maxim AI

    Simulates, evaluates and monitors AI agents and LLM apps, with test datasets, automated and human evaluators, production tracing and an open-source gateway.

    4.2k
    Active
    Free plan
23. #35H

    Humanloop

    Humanloop has joined Anthropic and is sunsetting its platform.

    3.6k
    Maintained
    Free plan
24. #36H

    Helicone

    Routes, debugs, and analyzes LLM API calls with observability and monitoring.

    2.7k
    Active
    From $79/mo
25. #37W

    WhatLLM.org

    Ranks and compares language models by quality benchmarks, pricing, and speed across providers.

    2.5k
    Active
    Free
26. #39A

    Agent Forge

    Provides decentralized GPU compute infrastructure and coordinates autonomous AI agents across a network.

    1.1k
    Active
    From $20/mo
27. #40L

    LLM Gateway Chat

    Routes requests across 40 LLM providers through a unified API with cost tracking and automatic failover.

    989
    Active
    From $5 per use
28. #43L

    LangWatch

    Tests and evaluates AI agents through simulation, tracing, and scoring before production deployment.

    452
    Active
    From ≈ $33/user/mo
29. #45F

    FastRouter.ai

    Routes requests across 200+ LLMs through a single OpenAI-compatible API with intelligent failover and cost optimization.

    319
    Active
    From $199/mo
30. #49R

    Regolo.ai

    Serves OpenAI-compatible language models from EU data centers with zero data retention.

    162
    Active
    From ≈ $44/mo
31. #51O

    Ollama LLM Throughput Benchmark

    Benchmarks language model throughput across different hardware and configurations.

    141
    Active
    Open source
32. #55A

    AiverseWorld

    Discovers, compares, and evaluates AI tools with prompt utilities and cost calculators.

    109
    Active
    From $7/mo
33. #58I

    Inferencer

    Runs and inspects large language models locally with token-level control and distributed inference.

    77
    Active
    From $9.99/mo
34. #60F

    Flowtask

    Structures Slack, email, and docs into executable task memory for AI agents and teams.

    71
    From ≈ $5.28/mo
    2024
35. #61G

    gpu.fund

    Compares live GPU rental prices across cloud providers and tracks price changes over time.

    54
    Active
    Free
36. #64F

    flatkey.ai

    Routes requests across 100+ AI models and 1000+ tools through a single API key and unified billing.

    38
    Active
    From $10/mo
37. #66C

    Chat LLM

    Access 395 AI language models including GPT, Claude, and Gemini through a free web chat interface.

    37
    Active
    From $5/mo
    2024
38. #67A

    A4F

    Routes requests to hundreds of language models through a single API with automatic provider failover.

    35
    Active
    From $25/mo
39. #68R

    RedPill

    Routes AI inference requests through verified trusted execution environments with encrypted paths and cryptographic proofs.

    32
    Active
    From $0.01 per use
40. #69C

    CostPerPrompt

    Displays current pricing for 313 language models across vendors and calculates monthly API costs.

    32
    Active
    Free
41. #72P

    Plurai

    Generates test scenarios and evaluates AI agents against policy violations and edge cases in production.

    29
    Active
    From $0.15 per use
42. #74P

    Plano

    Routes prompts and orchestrates agents with observability, guardrails, and model selection.

    26
    Active
    Open source
43. #75B

    Benchable.ai

    Benchmarks and compares large language models on cost, speed, and accuracy for your specific tasks.

    26
    Active
44. #77P

    Paralleliq

    Identifies idle GPU capacity and tier mismatches in inference fleets to reduce cost per token without touching production.

    24
    Active
    Free plan
45. #80N

    NoemaAI Launch

    Runs language models locally on Apple devices with file search and tool integration, syncing across Mac, iPhone, iPad and Vision Pro.

    20
    Active
    Free
46. #84M

    memgram

    Stores and retrieves contextual memory for AI agents across conversations with inspection and governance.

    18
    From $29/mo
47. #85S

    Septor Labs

    Routes requests across language models, embeddings, and agents through a single OpenAI-compatible endpoint with caching and observability.

    17
    Active
    From $14/mo
    2025
48. #87C

    Cattus

    Routes prompts to multiple AI models and aggregates responses in one interface.

    16
    Maintained
    From ≈ $18/mo