erhan/abap-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
96 Commits 1 Branch 0 Tags
7f03849a86ec515be7c62f8c91307dbcb9f5958c
Commit Graph

43 Commits

Author SHA1 Message Date
Kral
542fc8ec31 B: stage 2 data analysis (repair taxonomy, teacher vs Qwen behaviors, duplicates, empty_response); empty_response fix (cap 24000, retry temperature, stream guard) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-06 05:56:23 +02:00
Kral
1ddb9a7c65 Series A result: local Qwen 3 of 20 accepted, failures are loops and search loops; dashboard public copy 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-06 05:45:24 +02:00
Kral
9c753a37ff Infrastructure outage handling (MCP/A4H down: wait, clean up, rerun), dashboard fix, budget limit 129 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 22:27:48 +02:00
Kral
eb13453097 Series A: local Qwen on the MacBook (remote server), 12 h window with hard stop, clean pause on server loss, dashboard card, docs/remote-model.md 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 21:57:01 +02:00
Kral
dc8d99a913 Dashboard: ignore an old STOPPED.txt while a controller runs 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 21:32:23 +02:00
Kral
59496cb08b Lock leak: controlled reproduction attempts and method (not reproduced), enqueue reader; restart plan for 12 October 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 19:47:16 +02:00
Kral
4432ac896c Only kinds below their target share are generated and run; one-controller flock guard 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 19:39:37 +02:00
Kral
976274d48a Balanced generation under the pipeline, per-kind brake; STATE: type mix fix 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 19:27:43 +02:00
Kral
55f4068330 STRU and exception tasks accepted; G6 cascade fix, exception class mutants, RTTI unit notes 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 19:25:09 +02:00
Kral
b119f1afac Object type mix: INTF, TABL, STRU, MSAG, exception tasks (harness G2, mutants, generator notes), balanced generator, kind-deficit job order, dashboard mix card 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 18:52:29 +02:00
Kral
224ba1a5f8 Summary: correct the guard line; pipeline summary reads the limit from .env 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 18:05:49 +02:00
Kral
332fb4601d Live status page (SAP colors), rewritten every 5 minutes 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 17:56:30 +02:00
Kral
ae37617a0d Budget guard: ratio 2.07 measured, limit 142; limit read from .env at each check 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 14:47:54 +02:00
Kral
c062df2ec5 Trajectory runs: tool-call budget 100 for tasks with a CDS contract object (eval keeps 60) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 14:08:33 +02:00
Kral
13360292dd Pipeline controller: plan 2 (hard +, error +50 %), backlog throttle, 2 trajectory workers, stop rules, summaries every 50; budget reserve 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 13:35:54 +02:00
Kral
1c4667a0fc MCP load test (read, heavy read, write modes) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 13:26:13 +02:00
Kral
9de3911578 K variants for training (free text, EPOD tool names), second attempt only for failed tasks, docs/epod-syntax-hint.md 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 12:50:43 +02:00
Kral
35f0eb0e0c Overlap limit for whole spec 0.75, slot logs; STATE and roadmap: stage 2 data progress 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 12:04:11 +02:00
Kral
d5e43e1a83 Trajectory record (messages, raw tool results, metadata; reasoning apart) and trajectory runner 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 12:03:54 +02:00
Kral
a4eb567e4c Proxy: local abaplint messages on a bare 'save failed' (EPOD syntax check cannot see the rejected source) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 12:03:54 +02:00
Kral
229f862600 Generator training mode: train pool, eval overlap check, category mix, error-targeted tasks 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
 2026-10-05 11:53:07 +02:00
Kral
5532a5b226 baseline: setup failure is not recorded as a result; repair_stats tolerates a missing trajectory 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-04 12:07:33 +02:00
Kral
8d1db9c67c Devstral Small 2: serve.sh, baseline.py without thinking args, repair rate, activation error message fix, stop rule in chain (run base 21000) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-04 08:57:12 +02:00
Kral
5c68a1b1b7 Loop guard: also identical call with identical result 3 times in a row; baseline restarts (run base 20500) 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-04 07:59:28 +02:00
Kral
0401186a6c Loop guard (3 identical pushes), end_reason and activation error records per run; thinking off for the stage 1 baseline 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-04 07:07:44 +02:00
Kral
689820af4d Baseline shortened: 11-task subset (1 per category + T01), max_tokens 16384, settings in README; baseline_chain.sh 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 22:36:00 +02:00
Kral
d4ed32cf38 G0181: restore ALV output in K spec; K prompt keeps output form 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 18:26:24 +02:00
Kral
92e30eb554 Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 18:25:30 +02:00
Kral
01e99158a9 Agent: max_tokens 32k for cloud models and retry on empty turns (runaway reasoning); proxy: sap_activate fallback for PROG/FUNC 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 17:07:31 +02:00
Kral
7510131a7d ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 16:31:03 +02:00
Kral
428b3565b2 Proxy: ADT REST write+activate fallback when EPOD does not activate a second PROG/FUNC write 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 14:29:37 +02:00
Kral
39769afce8 Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 12:10:52 +02:00
Kral
d3250acfb8 Empirical filter runner (DeepSeek); real cost ratio in docs 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 09:29:20 +02:00
Kral
03ab36149e Fix coverage with several contract classes; table annotation and file path checks; clean task dir on write 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 08:44:35 +02:00
Kral
fb576b0954 In-place E/I: G2 needs a changed seed contract object, G4 skips it; regenerate G0009/G0013/G0016/G0023 as G0188-G0191 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 06:33:33 +02:00
Kral
3550f0b651 Eval review v1: checklist, review helper, 24 tasks reviewed; G0002/G0022 tests fixed; I/E generator definitions 
- docs/eval-inceleme.md checklist; harness/review.py
- 19 accept, 1 fix pending (G0019), 4 flagged (I/E tasks solvable without legacy code)
- generator: categories I and E fix/refactor the seed object in place

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 06:23:38 +02:00
Kral
a12fa4dff6 H and K tested (G0168, G0178 accepted); keyword fast path needs all groups 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 06:04:36 +02:00
Kral
f907351c0d Mutation check done on all accepted tasks; mutant fixes; dump filter in proxy 
- skip sy-subrc lines and CDS type lengths; CDS literal mutants; mutate helper classes
- proxy: sap_short_dumps shows only dumps of the current run
- 26/26 tasks pass; results in docs/faz1-tasarim.md 11g

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
 2026-10-03 06:02:59 +02:00
Kral
0ba25faeea Mutation in generator; category H (stop) scoring and judge; category K variants and tool schema variant; evalset plan 
- mutation.py: negation mutants, skip WHILE/DO blocks (endless loop blocked RFC ~8 min)
- generator: accept only after mutation check; survivors go back as repair feedback
- runner/judge.py: stop tasks scored 100/30/0; gap by keywords, else judge model
- proxy: tool schema variant generic_v0 (draft); generator make_k_variant
- evalset.py: 88 slots for step F (A-I, H, K)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-03 05:37:20 +02:00
Kral
32f03fcad4 Hard batch G0022-G0026: 5/5 accepted; budget floor, CDS checks, mutation check 
- generator: budget floor (2x oracle activations, 3x calls), static checks for CDS
  $parameters and UNION annotation
- harness/mutation.py: deterministic mutants of the reference; hidden tests must fail
- G0022 revalidated with harness fixes: oracle 100, null 0
- results in docs/faz1-tasarim.md 11f

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-03 05:16:30 +02:00
Kral
3570d7ef9b Harness: G6 ignores unknown standard superclass; dependency order for seed/reference; max_tokens 80k 
- abaplint does not know CX_STATIC_CHECK: exception hierarchies failed G6 (G0022, G0005)
- generator orders seed and reference objects by name references (G0022 attempt 1)
- max_tokens from pilot distribution (accepted calls 4k-76k)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-03 05:06:04 +02:00
Kral
5de5e2851c Generator: pilot analysis and fixes; G0002-G0021 tasks; handover notes merged 
- Static bundle checks (name length, seed type, reserved words, contract test classes,
  testclasses_file), local abaplint parser check before SAP, max_tokens, robust JSON parse
- Runner: G2 for CDS views with parameters, contract_check detail in report
- G0020 and G0013 fixed by review and revalidated (oracle 100, null 0)
- Pilot results in docs/faz1-tasarim.md 11e; handover notes merged into CLAUDE.md and docs

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-10-03 05:04:23 +02:00
Kral
1c6c85492e Harness: runner, generator, tasks T01 T13 T14 T15, CLAUDE.md 2026-10-02 21:42:51 +02:00