LLM Configuration
Configure RuVLLM for local inference and fine-tuning.
When to use
When you need to configure local LLM inference, create MicroLoRA adapters for task-specific fine-tuning, or set up SONA for real-time adaptation.
Steps
- Check status — call
mcp__claude-flow__ruvllm_statusto see current model and adapter state - Generate config — call
mcp__claude-flow__ruvllm_generate_configwith model parameters - Create MicroLoRA — call
mcp__claude-flow__ruvllm_microlora_createfor task-specific adapters - Adapt MicroLoRA — call
mcp__claude-flow__ruvllm_microlora_adaptwith training data - Create SONA — call
mcp__claude-flow__ruvllm_sona_createfor real-time neural adaptation - Adapt SONA — call
mcp__claude-flow__ruvllm_sona_adaptwith feedback signals
MicroLoRA vs SONA
| Feature | MicroLoRA | SONA |
|---|---|---|
| Speed | Minutes to train | <0.05ms adaptation |
| Scope | Task-specific fine-tuning | Real-time micro-adjustments |
| Persistence | Saved as adapter weights | Session-scoped |
| Use case | Specialized domain tasks | Continuous feedback loops |