Use in-process Llama cleanup
This commit is contained in:
parent
548be49112
commit
a83a843e1a
7 changed files with 235 additions and 116 deletions
|
|
@ -5,6 +5,7 @@
|
|||
- `src/leld.py` is the primary entrypoint (X11 STT daemon).
|
||||
- `src/recorder.py` handles audio capture using PortAudio via `sounddevice`.
|
||||
- `src/leld.py` owns Whisper setup and transcription.
|
||||
- `src/aiprocess.py` runs the in-process Llama-3.2-3B cleanup.
|
||||
|
||||
## Build, Test, and Development Commands
|
||||
|
||||
|
|
@ -33,3 +34,5 @@ System packages (example names): `portaudio`/`libportaudio2`, `libayatana-appind
|
|||
|
||||
- Audio input is configured via the `recording.input` field in `config.json`.
|
||||
- STT model and device are configured via the `stt` section in `config.json`.
|
||||
- LLM model settings are locked; model downloads to `~/.cache/lel/models/`.
|
||||
- `-v/--verbose` enables verbose logs (including llama.cpp) with `llama::` prefix.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue