erhan/abap-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

STATE/handover: baseline restarted on the 11-task subset

Browse Source
This commit is contained in:
Kral
2026-10-03 22:36:30 +02:00
parent 689820af4d
commit 040b9900fd
2 changed files with 12 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/devir-notlari.md
View File

@@ -1,4 +1,4 @@
# Handover notes (2026-10-03, 19:10) # Handover notes (2026-10-03, 22:40; baseline shortened, see train/STATE.md)
Read this file, `CLAUDE.md`, `train/STATE.md` and `train/README.md` first. Merge the durable parts into Read this file, `CLAUDE.md`, `train/STATE.md` and `train/README.md` first. Merge the durable parts into
CLAUDE.md and the docs when they are done, then empty this file. CLAUDE.md and the docs when they are done, then empty this file.
@@ -30,7 +30,7 @@ Night chain (`train/night_chain.sh`):
`t01_test_budget40` and starts the baseline on all 25 subset tasks (budget 60): `t01_test_budget40` and starts the baseline on all 25 subset tasks (budget 60):
`python3 train/baseline.py --label baseline --run-base 20100`, log `runs/stage1/baseline.log`. `python3 train/baseline.py --label baseline --run-base 20100`, log `runs/stage1/baseline.log`.
If T01 failed: notification "T01 test failed: baseline not started", and it stops. If T01 failed: notification "T01 test failed: baseline not started", and it stops.
3. Notification "Baseline (25 tasks) ended". Expected: 25 tasks × 20–40 min ≈ 8–16 h, end on 4 October 3. Notification "Baseline (11 tasks) ended". Expected: 25 tasks × 20–40 min ≈ 8–16 h, end on 4 October
morning to noon. morning to noon.
After the jobs: After the jobs:
@@ -68,11 +68,11 @@ Done:
Waiting for jobs (do these in the next session): Waiting for jobs (do these in the next session):
- After "DeepSeek reruns ended": update the 6 W7B tasks in 11h (G0107 G0173 G0175 G0177 G0181 G0191) and - After "DeepSeek reruns ended": update the 6 W7B tasks in 11h (G0107 G0173 G0175 G0177 G0181 G0191) and
the category means; check G0107 G2 and G0181 (K, ALV) results; G0170 decision (stronger gap?). the category means; check G0107 G2 and G0181 (K, ALV) results; G0170 decision (stronger gap?).
- After "Baseline (25 tasks) ended": B2 summary; confirm the easy marks with the Qwen scores; decide the - After "Baseline (11 tasks) ended": B2 summary; confirm the easy marks with the Qwen scores; decide the
Kral spot-check list (flagged tasks + one per category, ~10). Kral spot-check list (flagged tasks + one per category, ~10).
- Rerun queue `runs/stage1/rerun_queue.txt` (G0119, G0162): run after the baseline. Cost: DeepSeek, about - Rerun queue `runs/stage1/rerun_queue.txt` (G0119, G0162): run after the baseline. Cost: DeepSeek, about
0.05-0.08 USD real per run, so about 0.15 USD for two runs. Give the estimate again before starting. 0.05-0.08 USD real per run, so about 0.15 USD for two runs. Give the estimate again before starting.
- A4H memory limit (Kral 2026-10-03: do it when the system is idle, so after "Baseline (25 tasks) ended"; no - A4H memory limit (Kral 2026-10-03: do it when the system is idle, so after "Baseline (11 tasks) ended"; no
second question needed): check `docker stats` and the HANA allocation limit first; choose the limit with the second question needed): check `docker stats` and the HANA allocation limit first; choose the limit with the
data (about 32 GB is the SAP minimum for the trial image; too low gives an OOM kill); clean stop of `a4h` data (about 32 GB is the SAP minimum for the trial image; too low gives an OOM kill); clean stop of `a4h`
(give HANA time), apply the limit, start, test `localhost:50000` and one MCP call. The Mac mini has 64 GB; swap (give HANA time), apply the limit, start, test `localhost:50000` and one MCP call. The Mac mini has 64 GB; swap

14
train/STATE.md
View File

@@ -1,6 +1,6 @@
# Stage 1 state # Stage 1 state
Task: `docs/stage1-training-task.md`. Settings and weights: `train/README.md`. Updated 2026-10-03 22:25. Task: `docs/stage1-training-task.md`. Settings and weights: `train/README.md`. Updated 2026-10-03 22:40.
## Done ## Done
@@ -28,11 +28,13 @@ Task: `docs/stage1-training-task.md`. Settings and weights: `train/README.md`. U
## Running (detached) ## Running (detached)
- MLX server PID 59352, log `runs/stage1/server.log`. - MLX server PID 66098 (not restarted), log `runs/stage1/server.log`.
- T01 test (budget 40, harness check), PID 59414, log `runs/stage1/baseline_t01.log`. - Baseline on the 11-task subset (`train/subset.json`; the 25-task subset is `train/subset_v1_25.json`), started
- Night chain `train/night_chain.sh` PID 60017, log `runs/stage1/night_chain.log`: after the DeepSeek reruns 2026-10-03 22:36 by `train/baseline_chain.sh` (PID 69101; python PID 69107), logs `runs/stage1/baseline_chain.log`
and the T01 test, it starts the baseline on the 25 tasks (budget 60), log `runs/stage1/baseline.log`, and `runs/stage1/baseline.log`. Settings: max_tokens 16384, reasoning medium, budget 60 (`train/README.md`).
macOS notification at the end. Expected end: 4 October, morning to noon. macOS notification after 2 tasks ("ask for the time estimate") and at the end ("Baseline (11 tasks) ended").
- The earlier night chain (25 tasks) was stopped with its first T01 run (aborted at 33 tool calls after 2 h;
A4H objects deleted; directory `runs/stage1/baseline/_aborted_20100_T01`).
## Next ## Next