slm

Small Language Models local stack with Open WebUI, Ollama, Open Terminal, and a constrained outbound proxy.

Services

Service	Image / Build	Function
ollama	ollama/ollama:rocm	Local LLM backend (AMD/ROCm).
openwebui	ghcr.io/open-webui/open-webui:main	Web chat UI connected to ollama.
terminal	Local build (open-terminal/Dockerfile)	Development terminal for Open WebUI workflows.
tinyproxy	Local build (tinyproxy/Dockerfile)	HTTP/HTTPS proxy with domain allowlist in tinyproxy/filter.

Network

• lan: internal-only bridge for app-to-app traffic
• wan: egress bridge used only by tinyproxy for outbound internet access
• OpenWebUI exposed on host port ${OPENWEBUI_PORT} (default 8080)

Outbound policy

• Services use HTTP_PROXY and HTTPS_PROXY pointing to http://tinyproxy:8888.
• Allowed destinations are controlled by tinyproxy/filter.
• Internal service-to-service traffic bypasses proxy via NO_PROXY.

Quick start

1. Create environment file:

cp .env.dist .env

2. Generate terminal API key:

echo "OPEN_TERMINAL_API_KEY=$(openssl rand -hex 32)" >> .env

3. Start the stack:

docker-compose up -d

4. Access Open WebUI:

• http://<host>:${OPENWEBUI_PORT} (default 8080)

Day-to-day commands

# Start
docker-compose up -d

# Logs
docker-compose logs -f openwebui
docker-compose logs -f ollama
docker-compose logs -f terminal
docker-compose logs -f tinyproxy

# Status
docker-compose ps

# Stop
docker-compose down

Proxy allowlist updates

1. Edit tinyproxy/filter.
2. Rebuild only proxy service:

docker-compose up -d --build tinyproxy