gitea/agent-runtime
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
agent-runtime/testcases/expert_recovery.md
Nico d8ab778257 v0.15.9: Auto-DESCRIBE retry, unmapped table recovery, animation queue 
Expert retry loop enhanced:
- On "Unknown column" error, auto-DESCRIBEs the failing table
- DESCRIBE result injected into re-plan context
- Unmapped tables handled via SELECT * LIMIT fallback
- Recovery test step 4: abrechnungsinformationen (unmapped) → success

Graph animation queue:
- Events queued and played sequentially with 200ms interval
- Prevents bulk HUD events from canceling each other's animations
- Node pulses and edge flashes play one by one

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-29 19:43:33 +02:00

1.2 KiB
Raw Blame History

Expert Recovery

Tests that the expert recovers from SQL errors by retrying with corrected queries, not by reporting the error and stopping.

Setup

  • clear history

Steps

1. Expert recovers from column error silently

  • send: zeig mir alle Geraete von Objekt 4 mit Bezeichnung und Einbaudatum
  • expect_trace: has tool_call
  • expect_response: not contains "Unknown column" or "1054" or "error" or "Error"
  • expect_response: length > 20

2. Multi-table query with potential errors

  • send: zeig mir alle Nutzer und ihre Geraete fuer Kunde 2
  • expect_trace: has tool_call
  • expect_response: not contains "Unknown column" or "1054" or "error" or "Error"
  • expect_response: length > 20

3. Expert does not give up on first failure

  • send: zeig mir Verbrauchswerte fuer Geraet 50 im letzten Monat
  • expect_trace: has tool_call
  • expect_response: not contains "I need assistance" or "developer" or "schema issue"
  • expect_response: length > 10

4. Expert retries on unmapped table (abrechnungsinformationen)

  • send: zeig mir die letzten 3 Abrechnungsinformationen
  • expect_trace: has tool_call
  • expect_response: not contains "Unknown column" or "1054"
  • expect_response: length > 10