Point AnythingLLM at Pareto's OpenAI-compatible API to run GLM 5.3 Flash, DeepSeek V4.1 Flash and MiMo V2.6 Flash on Pareto GPUs. Pay per token from one prepaid balance.
Setup
Get an API key in the dashboard, then add this to your chat app.
Run AnythingLLM with the Generic OpenAI provider. Keep Max Tokens at 8192 or more; reasoning counts toward it.
TerminalShell
docker run -d -p 3001:3001 --cap-add SYS_ADMIN \
-v anythingllm_storage:/app/server/storage \
-e STORAGE_DIR=/app/server/storage \
-e LLM_PROVIDER=generic-openai \
-e GENERIC_OPEN_AI_BASE_PATH=https://api.paretoinference.com/v1 \
-e GENERIC_OPEN_AI_API_KEY="$PARETO_API_KEY" \
-e GENERIC_OPEN_AI_MODEL_PREF=z-ai/glm-5.3-flash \
-e GENERIC_OPEN_AI_MAX_TOKENS=8192 \
mintplexlabs/anythingllm:1.16.2Models