LLM operations250 tools

Figure and bar: visits/mo, estimate · year: online since

1. #1O

   OpenAI

   Develops GPT language models plus image and video models, offered through the ChatGPT app and a paid developer API.

   40.8M
   2015
2. #2N

   NVIDIAMCP · sign-in

   Designs GPUs, data-center accelerators and networking hardware, plus CUDA and software stacks for training and running AI models, graphics and gaming.

   12.6M
   Active
   From ≈ $399 once
   1993
3. #3O

   OpenRouterMCP · sign-in

   Routes API requests to 500 language models across 80 providers through a unified interface.

   224k
   Active
   Free plan
   2023
4. #4O

   Ollama

   Runs open-source language models locally or in cloud, with API access for coding agents.

   193k
   Active
   From $20/mo
   2023
5. #5A

   AI21

   Routes requests between open-source and frontier models to reduce token costs while maintaining quality.

   103k
   Active
   From $0.20 per use
   2017
6. #6L

   LangChain

   Provides the open-source LangChain and LangGraph frameworks for building LLM applications and agents, plus LangSmith for tracing, evaluating and deploying them.

   92.2k
   Active
   From $39/user/mo
   2023
7. #7A

   Arena AI

   Ranks large language models on a public leaderboard built from crowdsourced blind side-by-side comparisons of their answers.

   78.3k
   Active
   2023
8. #8M

   Mistral

   Provides frontier language models, agents, and infrastructure for building custom AI systems.

   63.6k
   Active
   From $14.99/mo
   2023
9. #9T

   Thinking Machines Lab

   Provides Tinker, an API for fine-tuning open-weight language models with LoRA while the lab runs the distributed training infrastructure.

   59.5k
   Active
   From $0.33 per use
   2025
10. #10M

    Modal

    Runs inference, training, and batch processing workloads on GPUs with instant autoscaling and sub-second cold starts.

    52.1k
    Active
    From $250/mo
11. #11T

    Truefoundry

    Routes requests to language models and agents with observability, access controls, and deployment across cloud or on-premises infrastructure.

    46.2k
    Active
    From $25/user/mo
12. #12R

    ReplicateMCP · sign-in

    Runs and fine-tunes machine learning models through an API with a single line of code.

    37k
    Active
    From $0.00 per use
13. #13T

    Together AI

    Runs open-source language models with serverless inference, batch processing, and GPU clusters.

    32.7k
    Active
    2022
14. #14L

    LLM StatsMCP · sign-in

    Ranks and compares 300 AI models by intelligence, speed, price, and context window.

    29.1k
    Active
15. #15G

    GreenPT

    Provides AI chat, APIs, and specialized tools running on European renewable energy infrastructure with transparent energy tracking.

    28k
    Active
    From $5/mo
    2025
16. #16A

    Arize

    Observes agent behavior, evaluates performance with evals, and suggests improvements through automated debugging.

    27.2k
    Active
    From $50/mo
17. #17W

    Weights & Biases

    Tracks machine learning experiments, manages models and datasets, and monitors AI applications in production.

    21.2k
    Active
    Free plan
    2017
18. #18G

    GMI CloudMCP · sign-in

    Runs AI model inference and agents on serverless or dedicated GPU infrastructure with automatic scaling.

    19.7k
    Active
    From $2.60 per use
19. #19M

    micro1

    Supplies expert human training data, evaluations and reinforcement learning environments for labs training frontier AI models and agents.

    15.4k
    Active
    Contact sales
20. #20L

    LiteLLM

    Routes requests across 140+ LLM providers and 1800+ models through a single API gateway with cost optimization and access controls.

    15.2k
    Active
    Open source
    2023
21. #21L

    Lightning AI

    Cloud platform from the PyTorch Lightning team for developing, training and serving AI models on GPUs.

    14.1k
    Active
    From $10/mo
22. #22B

    Braintrust

    Observability platform that traces agent execution, evaluates outputs, and discovers production patterns to improve quality.

    13.7k
    Active
    From $249/mo
    2022
23. #23L

    Liquid AI

    Distributes small foundation models optimized to run on devices without sending data to servers.

    11.3k
    Active
    From $0.02 per use
    2023
24. #24G

    Galileo

    Captures groundtruth data, builds and auto-tunes evaluations, and distills them into production guardrails for AI agents and RAG systems.

    9.8k
    Active
25. #25F

    Fireworks AI

    Hosts open-weight language and image models for fast inference via API, with fine-tuning and dedicated GPU deployments.

    8.7k
    Active
    From $0.01 per use
26. #26L

    LangfuseMCP · open

    Traces, evaluates, and monitors language model applications in production with observability and prompt management.

    7.5k
    Active
    From $29/mo
27. #27U

    Uniphore

    Enterprise platform that prepares business data, fine-tunes domain-specific language models and runs agents that execute workflows across operations and customer service.

    6.8k
    Active
    2008
28. #28H

    HoneycombMCP · sign-in

    Stores and queries distributed traces, logs and metrics in real time to debug production services, including LLM and agent calls.

    6.5k
    Active
    From $150/mo
    2016
29. #29B

    Barndoor AI

    Routes AI model and agent requests through access controls, data-loss prevention and audit logging before they reach the model.

    6.5k
    Active
    Contact sales
30. #30E

    EdgeChatMCP · open

    Runs one language model on your Mac for offline chat, slide decks, medical and legal lookups, and permission-gated web search.

    6.1k
    Active
31. #31B

    Baseten

    Deploys and serves AI models in production with optimized inference across cloud infrastructure.

    5.9k
    Active
    Free plan
    2019
32. #32P

    Portkey

    Routes requests to 1600 language models through a unified API with observability, guardrails, and prompt management.

    5.9k
    Active
    From $49/mo
33. #33O

    OpenLayer AgentsMCP · sign-in

    Tests and monitors machine learning and LLM systems with configurable evaluations before release and tracing, cost and policy checks in production.

    4.7k
    Active
    Free plan
    2021
34. #34S

    Supermemory MCPMCP · sign-in

    Stores and retrieves long-term memory for AI agents through an API, indexing conversations and files and injecting relevant context into prompts.

    4.6k
    Active
    From $19/mo
35. #35M

    Maxim AI

    Simulates, evaluates and monitors AI agents and LLM apps, with test datasets, automated and human evaluators, production tracing and an open-source gateway.

    4.2k
    Active
    Free plan
36. #36H

    Humanloop

    Humanloop has joined Anthropic and is sunsetting its platform.

    3.6k
    Maintained
    Free plan
37. #37H

    Helicone

    Routes, debugs, and analyzes LLM API calls with observability and monitoring.

    2.7k
    Active
    From $79/mo
38. #38W

    WhatLLM.org

    Ranks and compares language models by quality benchmarks, pricing, and speed across providers.

    2.5k
    Active
    Free
39. #39P

    Patronus

    Generates simulated digital environments and benchmarks for training and evaluating AI agents.

    1.7k
    Active
    Contact sales
40. #40A

    Agent Forge

    Provides decentralized GPU compute infrastructure and coordinates autonomous AI agents across a network.

    1.1k
    Active
    From $20/mo
41. #41L

    LLM Gateway ChatMCP · sign-in

    Routes requests across 40 LLM providers through a unified API with cost tracking and automatic failover.

    989
    Active
    Free plan
42. #42A

    Aleph Alpha

    Develops specialized sovereign large language models for business-critical applications with customization and optimization services.

    820
    Active
    2019
43. #43O

    OmniRoute

    Routes requests across 352 model providers through a single OpenAI-compatible endpoint, falling back automatically when a provider is unavailable or out of quota.

    641
    Active
44. #44A

    All Innovativ

    Generates web tools, QR codes, hosted pages, and runs language model applications in a browser.

    559
    Active
    From $9.99/mo
    2023
45. #45L

    LangWatch

    Tests and evaluates AI agents through simulation, tracing, and scoring before production deployment.

    452
    Active
    From ≈ $32/user/mo
46. #46C

    Cyfuture AI

    Provides GPU infrastructure, model inference, fine-tuning, and AI applications including chatbots, voice agents, and RAG systems.

    397
    Active
    From $0.60 per use
    2001
47. #47F

    FastRouter.ai

    Routes requests across 200+ LLMs through a single OpenAI-compatible API with intelligent failover and cost optimization.

    319
    Active
    From $199/mo
48. #48O

    OminiGate

    Routes requests to text, image, and video models from multiple providers through a single API endpoint.

    298
    Active
    From $0.01 per use
    2025