coja/dots
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[Docs] sanitize locators in the published infra guides

Browse Source
This commit is contained in:
coja
2026-08-13 00:04:37 +02:00
parent a099091b6c
commit 885a62520d
2 changed files with 16 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files
fl/.config/llamacpp/README.md
+4 -3
View File
@@ -6,14 +6,15 @@ Last full clean sweep: **2026-08-08 03:22** — all 11 presets loaded and ran gr
- **Box**: AMD RX 7600 XT 16 GB (ROCm, ~288 GB/s) + Ryzen 5600X (6 cores) + 48 GB RAM.
⚠ The GPU **also drives the display** — see [VRAM safety](#vram-safety-the-golden-rules).
- **Endpoints**: LAN `http://192.168.0.204:11343/v1` · remote `https://llm.duskadiy.com/api/v1`
(own reverse proxy to the same server, no key).
- **Endpoints**: LAN `http://$SERVER:11343/v1` · remote `https://<own-domain>/api/v1`
(own reverse proxy to the same server; keyless — put auth in front before exposing it).
`$SERVER` = the box's LAN address.
- **Files here**: `config.ini` (model presets — the section names ARE the API model ids),
`bench.py` (safety-first benchmark), `bench-results.md` / `bench-history.md` (ledgers, generated).
## How it runs
systemd unit **`llama.service`** (on the server, user `anon`) runs a script wrapping:
systemd unit **`llama.service`** (on the server, under a dedicated service user) runs a script wrapping:
```
llama-server --port 11343 --host 0.0.0.0 --models-max 1 --models-preset ~/.config/llamacpp/config.ini