Architecture
Roadmap & Ideas
🗺️ Roadmap & Ideas#
Synthesized from ideas.yaml, CHECKLIST.md, roadmap-vision.md, next-lvd-dashboard.md
Updated: 2026-04-04 | All core phases COMPLETE | Stack verified GREEN
Current State#
| Layer |
Status |
Details |
Svelte Dashboard :55666 |
🟢 |
Vite dev, Font Awesome, fusion bar, settings, model picker |
Relay API :55667 |
🟢 |
Express + Socket.IO bridge, 10+ REST endpoints, SQLite stats |
MindServer :55668 |
🟢 |
Agent lifecycle, profile CRUD, settings hot-swap |
Viewer :55669 |
🟢 |
Prismarine 3D, proxied via /viewer/ in Vite |
Spigot :25565 |
🟢 |
Paper 1.21.11, offline-mode, RCON optional |
| PM2 Orchestration |
🟢 |
ecosystem.config.cjs, 4 services online |
| Docker Compose |
🟡 |
docker-compose.yml exists, Dockerfiles missing |
| E2E Tests |
🔴 |
No Playwright/Puppeteer suite yet |
Feature Matrix#
| ID |
Feature |
Complexity |
Dependencies |
Priority |
| F1 |
🎬 Replay System (Flashback-inspired) |
HIGH |
SQLite events, viewer timeline, server plugin |
⭐⭐⭐ |
| F2 |
🎥 Premium Agent View (1st/3rd person + hotbar) |
HIGH |
Prismarine viewer mods, per-agent camera |
⭐⭐ |
| F3 |
🎮 Agent Control Suite (dev/debug toggles) |
MED |
Settings spec extension, new Svelte panel |
⭐⭐⭐ |
| F4 |
🖥️ Control Panel UI (extend Mindcraft settings) |
MED |
settings_spec.json expansion, SettingsPanel.svelte |
⭐⭐⭐ |
| F5 |
🗣️ Agent TTS Voice (Groq + OpenRouter fallback) |
MED |
Groq TTS API, audio playback in dashboard |
⭐⭐ |
Implementation Roadmap#
Phase 5: Agent Control & Settings Extension#
Lowest friction, highest daily-use impact
| Step |
Task |
Effort |
| 5.1 |
Extend settings_spec.json with debug/dev fields (render distance, pathfinder viz, verbose levels) |
S |
| 5.2 |
Add dev/debug toggle section to SettingsPanel.svelte (new “Developer” tab) |
M |
| 5.3 |
Wire debug toggles to MindServer via set-agent-settings socket event |
S |
| 5.4 |
Quick-action toolbar: pause/resume, force-respawn, teleport-to-agent |
M |
| 5.5 |
Keyboard shortcuts for debug actions (F-keys / Ctrl combos) |
S |
Phase 6: Agent TTS Voice#
Independent module, no core changes required
| Step |
Task |
Effort |
| 6.1 |
Create bots/services/tts.js — Groq TTS client with OpenRouter fallback |
M |
| 6.2 |
Emit agent-speak socket event from MindServer on agent chat |
S |
| 6.3 |
Dashboard audio player: receive agent-voice, play audio blob |
M |
| 6.4 |
Per-agent voice toggle in SettingsPanel |
S |
| 6.5 |
Voice queue + interrupt handling (no overlap, skip stale) |
S |
Phase 7: Premium Agent View#
Requires Prismarine viewer modifications
| Step |
Task |
Effort |
| 7.1 |
Per-agent camera selector in Viewer component |
M |
| 7.2 |
First-person perspective lock (attach camera to bot entity) |
L |
| 7.3 |
Hotbar/inventory overlay in viewer iframe |
M |
| 7.4 |
Auto-switch 1st→3rd person on combat/death events |
M |
| 7.5 |
Picture-in-picture multi-agent view (2×2 grid) |
L |
Phase 8: Replay System#
Heaviest lift — requires structured event capture infrastructure
| Step |
Task |
Effort |
| 8.1 |
Structured JSONL event emitter in agent runtime |
M |
| 8.2 |
Event archiver: persist JSONL to SQLite events table |
M |
| 8.3 |
Replay API: GET /api/replay?start=&end=&agent= |
M |
| 8.4 |
Timeline scrubber UI component |
L |
| 8.5 |
Viewer replay renderer: feed archived events to Prismarine |
XL |
| 8.6 |
Timelapse generator: condensed replay at N× speed |
L |
| 8.7 |
Highlight detector: auto-mark deaths, discoveries, combat |
M |
Infrastructure Prerequisites#
| ID |
Task |
Why |
Effort |
| I1 |
Create Dockerfile.node + bots/dashboard/Dockerfile |
Docker path blocked without them |
M |
| I2 |
Add Playwright E2E suite (e2e/) |
No automated UI regression tests |
M |
| I3 |
Self-host Font Awesome (remove CDN) |
Air-gapped lab requirement |
S |
| I4 |
Fix nested bots/.git (decide: submodule vs single-repo) |
Outer git can’t track bot files |
S |
| I5 |
Docker socket permissions for user mc |
docker compose build fails |
S |
Quick Wins (can ship today)#
| # |
What |
Impact |
~Time |
| Q1 |
Self-host Font Awesome files in static/ |
Air-gap ready, no CDN dependency |
15min |
| Q2 |
Add 3-5 debug fields to settings_spec.json |
Unlock dev toggles |
20min |
| Q3 |
Dockerfile.node from node:20-bookworm-slim |
Unblock Docker path |
30min |
| Q4 |
Playwright smoke test: load dashboard, check title + icons |
First E2E gate |
45min |
Recommended Execution Order#
Infrastructure: I3 → I1 → I5 → I4 → I2
Features: F4 → F3 → F5 → F2 → F1
Quick wins: Q1 → Q2 → Q3 → Q4 (parallel)
Each feature phase should end with npm run green (check + build + verify + contract).