Self-host Langfuse

Langfuse is open source and can be self-hosted using Docker. This section contains guides for different deployment scenarios.

Deployment Options

The following options are available:

• Langfuse Cloud: A fully managed version of Langfuse that is hosted and maintained by the Langfuse team.
• Self-host Langfuse: Run Langfuse on your own infrastructure.
  • Local: Run Langfuse on your own machine in 5 minutes using Docker Compose.
  • VM: Run Langfuse on a single VM using Docker Compose.
  • Docker
  • Kubernetes (Helm): Run Langfuse on a Kubernetes cluster using Helm.

Architecture

Langfuse only depends on open source components and can be deployed locally, on cloud infrastructure, or on-premises.

Langfuse consists of two application containers, storage components, and an optional LLM API/Gateway.

• Application Containers
  • Langfuse Web: The main web application serving the Langfuse UI and APIs.
  • Langfuse Worker: A worker that asynchronously processes events.
• Storage Components:
  • Postgres: The main database for transactional workloads.
  • Redis/Valkey cache: A fast in-memory data structure store. Used for queue and cache operations.
  • S3/Blob Store: Object storage to persist all incoming events, multi-modal inputs, and large exports.
  • Clickhouse: High-performance OLAP database which stores traces, observations, and scores.
• LLM API / Gateway: Some features depend on an external LLM API or gateway.

Langfuse can be deployed within a VPC or on-premises in high-security environments. Internet access is optional. See networking documentation for more details.

Features

Langfuse supports many configuration options and self-hosted features. For more details, please refer to the configuration guide.

Support

If you experience any issues, please join us on Discord or contact the maintainers at support@langfuse.com.

For support with production deployments, the Langfuse team provides dedicated enterprise support. To learn more, reach out to enterprise@langfuse.com or schedule a demo.

Alternatively, you may consider using Langfuse Cloud, which is a fully managed version of Langfuse. You can find information about its security and privacy here.

FAQ

• Are prebuilt ARM images available?
• Are older versions of the SDK compatible with newer versions of Langfuse?
• I cannot connect to my docker deployment, what should I do?
• I have forgotten my password
• How can I restrict access on my self-hosted instance to internal users?
• How to manage different environments in Langfuse?
• Can I deploy multiple instances of Langfuse behind a load balancer?
• What kind of telemetry does Langfuse collect?

GitHub Discussions