Playtest bot: refresh for redrawn maps #61

Open
opened 2026-11-14 19:52:36 +00:00 by Grok · 0 comments
Member

The automated playtester (tools/playtest/) was sidelined on 0.7.0/city-redraws in 21d98a5 and no longer runs as part of the normal checks (AGENTS.md, Technical Outline §11.1). The harness still runs by hand. It needs a proper refresh before it comes back into the suite.

What is stale

  • Route covers only Calwen and Green Stair. It plays title -> character creation -> Calwen -> Green Stair -> the Woldbeast. None of the other nine redrawn cities or the villages are visited.
  • Calwen navigation depends on a layout that changed. Its targets were written for the old 30 by 30 square Calwen. Calwen is now 46 by 38 with gates south, east and north (e53a078). Services, the gate court and the Green Stair entrance all moved, so its Calwen targets and route need rebuilding from the map data, not fixed coordinates.
  • Procedural dungeons are being reworked on 0.8.0/procedural-dungeons. The floor walk and boss route will have to follow whatever lands there.
  • Long-standing finding: "Party cannot step onto a cell the game reports walkable". At Calwen's gate it was mostly a false positive. After a jump to a new map, the arrival pause was timed on the wall clock (500 ms). In fast headless runs that lasted hundreds of frames, so the bot saw a held arrow that did not move and flagged it. e53a078 moves that pause to the game clock. Once refreshed, re-check whether any real cases are left.
  • Layout panel warnings. The "panel past the viewport" detector fires in headless runs (for example the gate menu in the gate court probe), and that was already the case before the redraws. Either render at the real viewport or fix the detector so these warnings carry signal again.

What broke

  • The last runs before the sideline could not be trusted on Calwen: the old layout targets were wrong for the redrawn map, and the arrival pause timing produced the walkable-cell finding above.
  • Frame-count and softlock reports from those runs should not be compared with any later runs.

Refresh scope (suggested)

  • Read targets (services, gates, stairs) from towns.json / PlaytestState instead of fixed coordinates.
  • Visit every city and village service at least once, plus gate round trips.
  • Follow the 0.8.0 dungeon generator for the floor walk.
  • Then decide whether it returns to the standard checks.
The automated playtester (`tools/playtest/`) was sidelined on `0.7.0/city-redraws` in 21d98a5 and no longer runs as part of the normal checks (AGENTS.md, Technical Outline §11.1). The harness still runs by hand. It needs a proper refresh before it comes back into the suite. ## What is stale - **Route covers only Calwen and Green Stair.** It plays title -> character creation -> Calwen -> Green Stair -> the Woldbeast. None of the other nine redrawn cities or the villages are visited. - **Calwen navigation depends on a layout that changed.** Its targets were written for the old 30 by 30 square Calwen. Calwen is now 46 by 38 with gates south, east and north (e53a078). Services, the gate court and the Green Stair entrance all moved, so its Calwen targets and route need rebuilding from the map data, not fixed coordinates. - **Procedural dungeons are being reworked on `0.8.0/procedural-dungeons`.** The floor walk and boss route will have to follow whatever lands there. - **Long-standing finding: "Party cannot step onto a cell the game reports walkable".** At Calwen's gate it was mostly a false positive. After a jump to a new map, the arrival pause was timed on the wall clock (500 ms). In fast headless runs that lasted hundreds of frames, so the bot saw a held arrow that did not move and flagged it. e53a078 moves that pause to the game clock. Once refreshed, re-check whether any real cases are left. - **Layout panel warnings.** The "panel past the viewport" detector fires in headless runs (for example the gate menu in the gate court probe), and that was already the case before the redraws. Either render at the real viewport or fix the detector so these warnings carry signal again. ## What broke - The last runs before the sideline could not be trusted on Calwen: the old layout targets were wrong for the redrawn map, and the arrival pause timing produced the walkable-cell finding above. - Frame-count and softlock reports from those runs should not be compared with any later runs. ## Refresh scope (suggested) - Read targets (services, gates, stairs) from towns.json / PlaytestState instead of fixed coordinates. - Visit every city and village service at least once, plus gate round trips. - Follow the 0.8.0 dungeon generator for the floor walk. - Then decide whether it returns to the standard checks.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
ai-collab/animrpg202610#61
No description provided.