Librechat Deployment

Deployment of local Librechat service on docker.

Installation

This deployment only requires docker to be installed.

Please see installation instructions here.

Deployment

1. Clone this repository to your local workstation.

2. Review the docker-compose.yaml file and .env

   • Please see Librechat documentation for configuration

3. To deploy the Open WebUI service and the pipelineservice:

docker compose up -d

Once completed, you can access the web service on localhost:3080

RAG

Use RAG with OpenAI Embedding (default)

1. Add the following to oyur .env file:

RAG_API_URL=http://host.docker.internal:8000

2. If your OpenAI API key is set to “user_provided,” also add this to your .env file to provide an OpenAI API key:

RAG_OPENAI_API_KEY=sk-your-openai-api-key-example

Configuration

1. Create administrator user
   • The first user you register will be admin
   • This is a local user only, therefore you can use a dummy email (i.e. [email protected])
   • Password stored locally.