BricksLLM

Visit Tool

BricksLLM is an AI Agents & Automation tool that functions as an enterprise-grade API gateway. It helps monitor and impose cost or rate limits per API key, offering fine-grained access control and monitoring for various LLMs.

Claim this tool

No Views Yet

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is BricksLLM?

BricksLLM is a cloud-native AI gateway written in Go, providing enterprise-level infrastructure for LLM production use cases. It offers native support for OpenAI, Azure OpenAI, Anthropic, and vLLM, as well as custom deployments and open-source LLMs. Key features include PII detection and masking, rate limiting, cost control and analytics, request analytics, caching, retries, and failover. It also provides model and endpoint access control, Datadog integration, and logging with privacy control. A managed version with a dashboard is available, making it easier to interact with and deploy in production environments.

Best used for

Ideal for developers and product managers who need to manage and secure LLM API usage, impose cost or rate limits, and ensure data privacy. Especially valuable for enterprises requiring fine-grained access control and monitoring for various LLMs in production environments.

Common actions

manage LLM APIs

monitor LLM usage

secure LLM access

control LLM costs

improve LLM reliability

"AI Agents"github copilotface swappingopen-sourcedeepfakecollaborationlow-code/no-codeautomated workflowworkflows

Capabilities

Key features

PII detection and masking
Rate limit control
Cost control and analytics
Request analytics
Caching and retries
Failover support
Model access control

Target Audience

developerproduct managerstartup founder

Integrations

openaiazure-openaianthropicvllmdatadog

Pricing & Plans

Open Source

Free

FAQs

What LLM providers does BricksLLM support?

BricksLLM provides native support for OpenAI, Azure OpenAI, Anthropic, and vLLM. It also supports custom deployments and integration with various open-source LLMs, offering flexibility for different production needs.

Can BricksLLM help with PII protection?

Yes, BricksLLM includes PII detection and masking features. This allows organizations to block or redact requests containing sensitive personally identifiable information, enhancing data privacy and compliance.

How does BricksLLM help manage API costs and usage?

BricksLLM enables users to set LLM usage limits, rate limits, and cost limits per API key. It also provides cost and request analytics, allowing for fine-grained monitoring and control over LLM expenditures and access.

Trending

Subcategories trending in AI Agents & Automation

AI Frameworks & Infra Chatbots & Conversational AI Workflow Agents Personal Assistants RAG & Document AI Voice Agents

Trending

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce