grabowski
a202283a60
Deploy web Studio / deploy (push) Successful in 3m46s
Measured with the new tools/bench_web.py on the web Studio's house demo, CPU slowed 6x:
- Idle: running CSS animations repainted the whole drawing every frame (99% of the main
thread in a window). Animations now step on about ten times a second by default
("light", 5% idle); the new toolbar button switches light / smooth / off and the browser
remembers it; [build] animation sets the default for built pages; view.animation().
Pan and zoom gestures pause them. Status LEDs pause off-screen and with the rest now.
- Pan 28 -> 10 ms, zoom 69 -> 11 ms per step: gestures move the drawing as one compositor
layer (transform) and set the viewBox once they end; --iso-k is set on the tags group
only and only when it changes; the stage box is read once per frame.
- Hover 22 -> 15 ms per move: the tooltip is placed once per frame on its own layer and
measured only when its text changes; the Studio's x/y readout updates ten times a second
in a contained box; hover work in the Studio runs once per frame.
- Long object lists skip layout of rows out of sight (content-visibility).
- WASM built with opt-level 3: engine render 11.7 -> 9.4 ms for 10% more download.
Checks: Studio 102/102 (animation modes, pan as a layer, contained readout), web 87/87.
130 lines
8.3 KiB
Markdown
130 lines
8.3 KiB
Markdown
# Roadmap
|
|
|
|
Each phase ends with tests, a Studio/viewer check in Edge, commit and push.
|
|
|
|
## Phase 1: engine, Studio, MCP (done)
|
|
|
|
- [x] Core: projection with 4 rotations, primitives (box, prism, cylinder, frustum, face, poly, flat,
|
|
openings, lines, disc, circle, stem, figures, puffs, fan, raw, groups, sequences), sprites with
|
|
90° object frames, depth sort ported from the JS views, SVG writer, tags, tooltips
|
|
- [x] Theme: built-in palette, materials and rules converted from the Mooban/CNX CSS; TOML overrides
|
|
- [x] Rhai runtime: drawing API, module imports from memory, errors with file:line, safety limits
|
|
- [x] Prefab library: site, area, road, parking, wall, fence, lamp, marker, tree, tree row, hedge,
|
|
building (storeys, windows, door, flat/gable roof, solar, AC, cut-open levels), carport, shed,
|
|
car (driving), truck, motorbike, person, crowd, tank, container, generator, solar field, chimney
|
|
- [x] Scene document + prefab catalog with property schemas
|
|
- [x] Project folder, ops (add/update/remove/duplicate/reorder/set_cfg/replace), Workspace (save, undo,
|
|
reload on outside changes), check, static HTML page, SVG export
|
|
- [x] Viewer JS: port of the views' mount() (pan, pinch, wheel, declutter, tooltips, full screen) for
|
|
prerendered, server and future WASM sources
|
|
- [x] Studio GUI: palette, object list, placing, drag-to-move with snap, keyboard, forms from schemas,
|
|
levels, undo/redo, live follow of agent edits, MCP connection panel
|
|
- [x] MCP: 15 tools over stdio and HTTP (`/mcp`), validation messages for agents
|
|
- [x] Demo project, 52 Rust tests, Playwright Studio + MCP test
|
|
|
|
## Web Studio (done)
|
|
|
|
- [x] `isokit-wasm`: the engine in the browser (wasm-bindgen, 2.8 MB / 0.75 MB gzipped); `Store`
|
|
trait (folder or memory) under the `Workspace`; Studio JSON API shared with `isokit studio`
|
|
- [x] `studio.js` runs on a pluggable backend; the web shell answers it from WASM
|
|
- [x] Projects in IndexedDB; new, demo copy, delete; export / import `.zip` (stored or deflated) and
|
|
folders (drop or pick); two tabs on one project stay in step
|
|
- [x] Folder projects (File System Access, Chrome / Edge): edits written to disk, outside changes
|
|
followed live and undoable, Build page writes `dist/index.html`
|
|
- [x] Code editor for scripts, prefabs, theme and manifest, with script errors by file and line
|
|
- [x] MCP tools inside the page (`isokit.mcp`), WebMCP registration when the browser offers it
|
|
- [x] `tools/build_web.py` (static output), `tools/check_web.py` (44 checks, Edge)
|
|
- [ ] Deploy a hosted copy; render in a Web Worker for very large scenes
|
|
|
|
## Agent window (done)
|
|
|
|
- [x] ✦ Agent in the Studio: chat with a model on an OpenAI-compatible endpoint (default: B4L's
|
|
inference server) that edits the scene with the MCP tools + page tools (select, view);
|
|
streamed answers and reasoning, tool calls with results, clickable object ids, Stop, Undo
|
|
- [x] `isokit studio` relays the calls (`/api/agent/*`, key stays on the machine, no CORS);
|
|
settings from `ISOKIT_LLM_*` or `agent.json` in the user's config folder
|
|
- [x] Web Studio calls the endpoint from the page; isokit.buildfor.life relays `/llm/` to the
|
|
inference server (Caddy) so the page needs no CORS from it
|
|
- [x] `tools/mock_llm.py` + `tools/agent_checks.py` in both Studio checks
|
|
- [ ] Keep the conversation per project across reloads; attach a rendered view (PNG, Phase 4)
|
|
for vision models
|
|
|
|
## Build your own house (done)
|
|
|
|
- [x] House parts: `house_wall` (drawn along a line, ends adapt at corners, T-junctions and
|
|
straight runs), `window` and `door` that sit on a wall and cut its opening (door styles:
|
|
panel, glass, double, sliding, opening; open / closed, hinge and swing by rotation),
|
|
`floor` (boards / tiles / carpet / stone), `roof` (hip, gable, flat, solar), `stairs`
|
|
- [x] Furniture: chair, sofa / armchair, table with chairs, desk with monitor and chair, TV,
|
|
bed with nightstands, cupboard, bookshelf, kitchen run (sink, hob, wall cabinets, fridge),
|
|
bathtub, shower, toilet, washbasin, plant, rug, floor lamp
|
|
- [x] Cut-open levels for houses: walls in front of rooms cut low (rooms found by their floors),
|
|
roof as an outline, storeys from z (`storey_h`), upper storeys left out
|
|
- [x] Scripting: `objects_of`, `objects_at`, `objects_on`, `mount_of`, `mounted`, `frame`,
|
|
`to_world`, `to_local`, `local_of`; prefab meta `shape` (line / rect), `mount`, `storey`
|
|
- [x] Studio: drag to draw lines and rectangles (walls, roads, fences, floors, areas, buildings),
|
|
Room tool (floor + walls, shared walls not doubled), windows and doors snap onto walls
|
|
(hover preview) and move, turn, copy and delete with them, new parts land on the storey
|
|
shown, collapsible palette that scrolls on its own
|
|
- [x] `examples/house` (a furnished house built from parts), House demo in the web Studio
|
|
- [ ] Openings across two walls; diagonal walls; floor openings for stairs
|
|
|
|
## Backlog (2026-10)
|
|
|
|
1. ~~Web performance~~ (done, see below)
|
|
2. Conveyors: placeable conveyors
|
|
3. Producers with adjustable production speed
|
|
4. Robotic arms
|
|
5. Rounded streets: curved road segments
|
|
6. Sidewalks along streets
|
|
7. Roundabouts
|
|
8. Waypoint animation: a person or car moving along a path of waypoints
|
|
9. ~~Build your own house~~ (done, see above)
|
|
|
|
Done since: the middle mouse button only moves the camera; fences and site walls join like house
|
|
walls (`line_joint`); fence designs (mesh, wood, bars, half stone, cobble, brick with pillars);
|
|
runs of walls and fences drawn corner by corner, ends snapping onto the pieces they meet;
|
|
multi-select (Ctrl+click on the map and in the list, Shift range, Shift+drag box, Ctrl+A; group drag,
|
|
nudge, turn, copy, delete and property edits; a second click on a wall or fence selects the joined
|
|
run); the Pond with fish swimming round (`swim` primitive, CSS rotation), lily pads, ripples, reeds.
|
|
|
|
Web performance, measured with `tools/bench_web.py` on the web Studio's house demo with the CPU
|
|
slowed 6x (before → after): idle main thread in a browser window 99% → 5% (animations step about ten
|
|
times a second instead of repainting the drawing every frame; ▷ toolbar button: light / smooth / off,
|
|
`[build] animation`); zoom 69 → 11 ms per wheel step, pan 28 → 10 ms per move (gestures move the
|
|
drawing as one compositor layer and draw it again when they end; no forced layouts; `--iso-k` set on
|
|
the tags only); hover 22 → 15 ms per move (tooltip placed once per frame on its own layer, x/y
|
|
readout ten times a second); rotate 226 → 154 ms, edit 409 → 305 ms until painted (WASM built with
|
|
opt-level 3: engine render 11.7 → 9.4 ms at full speed).
|
|
|
|
## Phase 2: richer editing
|
|
|
|
- [x] Interior prefabs (see Build your own house); a building `rooms` prop is still open
|
|
- [ ] Path objects in the Studio: click points for areas, roads (polyline with width), fences, walls,
|
|
pipe runs; vertex handles
|
|
- [ ] Multi-select (box select, Shift-click), group move, align/distribute
|
|
- [ ] Copy/paste between projects; prefab thumbnails in the palette (rendered icons)
|
|
- [ ] Measure tool and grid overlay; numeric resize handles on the selection
|
|
- [ ] Studio editor for `theme.toml` (colour pickers) and for project parameters
|
|
|
|
## Phase 3: embedding in the other projects
|
|
|
|
- [ ] Host pages on the WASM build (`isokit-wasm` exists, see Web Studio): the same scene
|
|
recomputes in the browser when a host page's calculator changes the parameters (cnx_vinyl
|
|
fleet calculator)
|
|
- [ ] `isokit build --fragment`: `<style>` + `<script>` blocks for the Python build scripts of the
|
|
host pages (replace `inline.py`)
|
|
- [ ] Host API parity with CNXIso (`mount`, `update(cfg)`, `setLevel`, `focus`, `info`, `onPick`)
|
|
- [ ] Port the existing scenes: mooban estate, CNX Scuba centre (section cut), CNX Vinyl plant;
|
|
check each against its old view with the QA checklist from the skill
|
|
|
|
## Phase 4: output and QA
|
|
|
|
- [ ] Section cut layer (underground scenes) from iso-scuba: cut plane, clip-path per cavity
|
|
- [ ] PNG export (static style resolution + resvg) so agents get an image from `render_view`
|
|
- [ ] `isokit check` rules from the QA checklist: props on paved areas, runs ending in the air,
|
|
covers drawn over their contents, tag overlaps
|
|
- [ ] Performance budget test (render ms per view, 60 fps pan) on a 3,500-node scene
|
|
(`tools/bench_web.py` measures it by hand for now)
|
|
- [ ] Packaged desktop app (Tauri); shared projects for the hosted web Studio (behind login)
|