3d71c651fc
- testcases/*.md: declarative test definitions (send, expect_response, expect_state, expect_actions, action) - runtime_test.py: standalone runner + pytest integration via conftest.py - /tests route: web UI showing last run results from results.json - /api/tests: serves results JSON - Two initial testcases: counter_state (UI actions) and pub_conversation (multi-turn, language switch, tool use, memorizer state) - pub_conversation: 19/20 passed on first run - Fix nm-text vertical overflow in node metrics bar Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
43 lines
1.2 KiB
Markdown
43 lines
1.2 KiB
Markdown
# Pub Conversation
|
|
|
|
Tests multi-turn conversation with context tracking, language switching,
|
|
and memorizer state updates across a social scenario.
|
|
|
|
## Setup
|
|
- clear history
|
|
|
|
## Steps
|
|
|
|
### 1. Set the scene
|
|
- send: Hey, Tina and I are heading to the pub tonight
|
|
- expect_response: length > 10
|
|
- expect_state: situation contains "pub" or "Tina"
|
|
|
|
### 2. Language switch to German
|
|
- send: Wir sind jetzt im Biergarten angekommen
|
|
- expect_response: length > 10
|
|
- expect_state: language is "de" or "mixed"
|
|
|
|
### 3. Context awareness
|
|
- send: Was sollen wir bestellen?
|
|
- expect_response: length > 10
|
|
- expect_state: topic contains "bestell" or "order" or "pub" or "Biergarten"
|
|
|
|
### 4. Tina speaks
|
|
- send: Tina says: I'll have a Hefeweizen please
|
|
- expect_response: length > 10
|
|
- expect_state: facts any contains "Tina" or "Hefeweizen"
|
|
|
|
### 5. Ask for time (tool use)
|
|
- send: wie spaet ist es eigentlich?
|
|
- expect_response: matches \d{1,2}:\d{2}
|
|
|
|
### 6. Back to English
|
|
- send: Let's switch to English, what was the last thing Tina said?
|
|
- expect_state: language is "en" or "mixed"
|
|
- expect_response: contains "Tina" or "Hefeweizen"
|
|
|
|
### 7. Mood check
|
|
- send: This is really fun!
|
|
- expect_state: user_mood is "happy" or "playful" or "excited"
|