fix: release expression token storage

2026-09-22 10:24:43 +00:00
parent 728292c5f6
commit d60672f575
4 changed files with 77 additions and 2 deletions
@@ -8,3 +8,15 @@ Safety caps (to prevent memory abuse):
 - Maximum program lines: 500,000

 If a file exceeds these limits, the loader fails cleanly.
+
+## Expression-token cleanup
+
+Each expression now releases its token strings and token-array storage before returning. This is a narrow cleanup boundary; runtime-owned variables, loaded programs, and other allocations remain separate follow-up work.
+
+Focused verification:
+
+```text
+python3 tools/validate_memory_cleanup.py
+```
+
+The validator builds an AddressSanitizer/UndefinedBehaviorSanitizer binary, runs a repeated variable-overwrite probe, and confirms LeakSanitizer no longer reports allocations from `tokenize`/`toks_add`. The interpreter remains a trusted-script runtime, not a sandbox.