LLM operations tools that state GDPR compliance

Figure and bar: visits/mo, estimate · year: online since

1. #3O

   OpenRouter

   Routes API requests to 500 language models across 80 providers through a unified interface.

   224k
   Active
   From $5.50/mo
   2023
2. #5L

   LangChain

   Provides the open-source LangChain and LangGraph frameworks for building LLM applications and agents, plus LangSmith for tracing, evaluating and deploying them.

   92.2k
   Active
   From $39/user/mo
   2023
3. #6A

   Arena AI

   Ranks large language models on a public leaderboard built from crowdsourced blind side-by-side comparisons of their answers.

   78.3k
   Active
   2023
4. #10T

   Truefoundry

   Routes requests to language models and agents with observability, access controls, and deployment across cloud or on-premises infrastructure.

   46.2k
   Active
   From $25/user/mo
5. #15A

   Arize

   Observes agent behavior, evaluates performance with evals, and suggests improvements through automated debugging.

   27.2k
   Active
   From $50/mo
6. #25L

   Langfuse

   Traces, evaluates, and monitors language model applications in production with observability and prompt management.

   7.5k
   Active
   From $29/mo
7. #26U

   Uniphore

   Enterprise platform that prepares business data, fine-tunes domain-specific language models and runs agents that execute workflows across operations and customer service.

   6.8k
   Active
   2008
8. #27H

   HoneycombMCP · sign-in

   Stores and queries distributed traces, logs and metrics in real time to debug production services, including LLM and agent calls.

   6.5k
   Active
   From $150/mo
   2016
9. #28B

   Barndoor AI

   Routes AI model and agent requests through access controls, data-loss prevention and audit logging before they reach the model.

   6.5k
   Active
   Contact sales
10. #32O

    OpenLayer Agents

    Tests and monitors machine learning and LLM systems with configurable evaluations before release and tracing, cost and policy checks in production.

    4.7k
    Active
    Free plan
    2021
11. #34M

    Maxim AI

    Simulates, evaluates and monitors AI agents and LLM apps, with test datasets, automated and human evaluators, production tracing and an open-source gateway.

    4.2k
    Active
    Free plan
12. #35H

    Humanloop

    Humanloop has joined Anthropic and is sunsetting its platform.

    3.6k
    Maintained
    Free plan
13. #37W

    WhatLLM.org

    Ranks and compares language models by quality benchmarks, pricing, and speed across providers.

    2.5k
    Active
    Free
14. #38P

    Patronus

    Generates simulated digital environments and benchmarks for training and evaluating AI agents.

    1.7k
    Active
    Contact sales
15. #39A

    Agent Forge

    Provides decentralized GPU compute infrastructure and coordinates autonomous AI agents across a network.

    1.1k
    Active
    From $20/mo
16. #40L

    LLM Gateway Chat

    Routes requests across 40 LLM providers through a unified API with cost tracking and automatic failover.

    989
    Active
    From $5 per use
17. #43L

    LangWatch

    Tests and evaluates AI agents through simulation, tracing, and scoring before production deployment.

    452
    Active
    From ≈ $33/user/mo
18. #44C

    Cyfuture AI

    Provides GPU infrastructure, model inference, fine-tuning, and AI applications including chatbots, voice agents, and RAG systems.

    397
    Active
    From $0.60 per use
    2001
19. #48M

    MegaLLM

    Routes requests across 70 language models, automatically selecting the cheapest and fastest provider.

    167
    Active
20. #49R

    Regolo.ai

    Serves OpenAI-compatible language models from EU data centers with zero data retention.

    162
    Active
    From ≈ $44/mo
21. #64F

    flatkey.ai

    Routes requests across 100+ AI models and 1000+ tools through a single API key and unified billing.

    38
    Active
    From $10/mo
22. #66C

    Chat LLM

    Access 395 AI language models including GPT, Claude, and Gemini through a free web chat interface.

    37
    Active
    From $5/mo
    2024
23. #67A

    A4F

    Routes requests to hundreds of language models through a single API with automatic provider failover.

    35
    Active
    From $25/mo
24. #69C

    CostPerPrompt

    Displays current pricing for 313 language models across vendors and calculates monthly API costs.

    32
    Active
    Free
25. #72P

    Plurai

    Generates test scenarios and evaluates AI agents against policy violations and edge cases in production.

    29
    Active
    From $0.15 per use
26. #75B

    Benchable.ai

    Benchmarks and compares large language models on cost, speed, and accuracy for your specific tasks.

    26
    Active
27. #76A

    ApexApi

    Routes requests to 130 AI models through a single API key and OpenAI-compatible endpoint.

    24
    Active
    From $10 per use
28. #78P

    Phoenix Grove Systems™

    Provides access to open-source language models with privacy-first architecture and persistent memory across conversations.

    22
    Active
29. #79C

    CoralBricks

    Serves open-source language models through an OpenAI-compatible API optimized for coding and research agents.

    22
    Active
30. #85S

    Septor Labs

    Routes requests across language models, embeddings, and agents through a single OpenAI-compatible endpoint with caching and observability.

    17
    Active
    From $14/mo
    2025
31. #86C

    cortecs

    Routes requests to multiple large language models through a GDPR-compliant gateway with policy-based provider selection.

    16
    Active
    Pay per use
32. #91L

    LiberaGPT

    Runs large language models entirely offline on iPhone and Android devices without subscriptions or data collection.

    14
    Active
    Free
33. #97Z

    ZOLIX Lite

    Analyzes cloud and AI infrastructure spending to detect waste and recommend cost optimizations across AWS, Azure, GCP, and OCI.

    9
    Active
    Free plan
    2024
34. #101M

    Model Price WatchMCP · open

    Lists current per-million-token prices for LLM APIs from many providers, each linked to the provider's pricing page.

    6
    Active
    2026
35. #102R

    RunInfra

    Serves open-source language models with prompt caching to reduce inference cost and latency.

    5
    Active
    From $0.05 per use
    2024
36. #105R

    Retrace

    Records and replays agent execution to fork failed steps, test fixes, and enforce runtime safety guardrails.

    4
    Active
    From $29/mo
37. #107B

    bourdon

    Provides shared memory for AI agents with instant recognition and background detail retrieval.

    3
    Active
    From $29/mo
38. #111R

    Rainwater Labs

    Builds customizable foundation models designed for secure, air-gapped deployment with embedded alignment and compliance.

    3
    Active
39. #113B

    Bike4MindMCP · open

    Runs chat, agent jobs and interactive artifacts across hosted frontier models and self-hosted open-weight models from one workbench.

    3
    Active
    From $30/mo
40. #117A

    AgentPrizm

    Provides persistent, auditable memory layer for AI agents via API and MCP protocol.

    2
    Active
    From $19/mo
41. #118株

    株式会社イネブラ

    Routes requests to multiple LLM providers through a unified API gateway with cost optimization and model switching.

    2
    Active
    From ≈ $6.21/mo
42. #124S

    Softprobe

    Captures and analyzes AI agent execution traces to identify performance issues and verify improvements.

    2
    From $499/mo
43. #138V

    VRAM Shield

    Monitors and throttles GPU VRAM temperature on RTX laptops to prevent thermal damage.

    1
    Maintained
    From $29.95 once
44. #141N

    NodegroveMCP · open

    Attaches a cloud GPU on wake for running open models, ComfyUI workflows and LoRA fine-tuning, with files kept while asleep.

    1
    Active
45. #144S

    Scalattice

    Routes OpenAI-compatible inference requests to open models hosted on a distributed network of contributed GPUs.

    2.7k installs/mo
    Active
    Pay per use
46. #146C

    Corbenic AI

    Detects and skips redundant LLM computations to reduce inference costs by up to 98 percent.

    149 linking domains
    Active
    From $5.12/mo
47. #157A

    ApiLink

    Routes requests to 369 AI models from 45 providers through a single OpenAI-compatible API endpoint.

    34 linking domains
    Active
48. #171Z

    zizka.ai

    Stores agent execution traces, replays sessions, and detects behavior drift in production.

    29 linking domains
    Active