erhan/abap-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
8ef85c2713cfd42551d2363331823781cba9e8e7
abap-llm/tasks_gen/eval
History
Kral e3f5dcd668 G0181 failure analysis (int8 in SALV), W7B results
2026-10-03 19:16:56 +02:00
..
G0001
Fix coverage with several contract classes; table annotation and file path checks; clean task dir on write
2026-10-03 08:44:35 +02:00
G0002
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0003
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0004
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0005
Fix coverage with several contract classes; table annotation and file path checks; clean task dir on write
2026-10-03 08:44:35 +02:00
G0006
Fix coverage with several contract classes; table annotation and file path checks; clean task dir on write
2026-10-03 08:44:35 +02:00
G0007
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0008
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0009
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0010
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0011
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0012
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0013
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0014
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0015
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0016
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0017
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0018
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0019
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0020
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0021
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0022
Step F first pass: 81/92 accepted; budget floor 60 calls; rejected slots moved for regeneration
2026-10-03 12:10:52 +02:00
G0023
In-place E/I: G2 needs a changed seed contract object, G4 skips it; regenerate G0009/G0013/G0016/G0023 as G0188-G0191
2026-10-03 06:33:33 +02:00
G0024
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0025
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0026
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0100
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0101
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0102
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0103
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0104
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0105
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0106
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0107
G0181 failure analysis (int8 in SALV), W7B results
2026-10-03 19:16:56 +02:00
G0108
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0109
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0110
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0111
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0112
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0113
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0114
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0115
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0116
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0117
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0118
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0119
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0120
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0121
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0122
Review fixes G0019, G0108: added hidden tests; revalidated
2026-10-03 16:35:20 +02:00
G0123
Handover notes, train/STATE.md, detached night chain for DeepSeek reruns and the stage 1 baseline
2026-10-03 18:34:07 +02:00
G0124
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0125
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0126
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0127
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0128
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0129
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0130
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0131
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0132
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0133
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0134
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0135
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0136
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0137
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0138
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0139
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0140
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0141
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0142
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0143
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0144
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0145
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0146
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0147
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0148
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0149
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0150
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0151
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0152
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0153
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0154
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0155
Handover notes, train/STATE.md, detached night chain for DeepSeek reruns and the stage 1 baseline
2026-10-03 18:34:07 +02:00
G0156
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0157
Handover notes, train/STATE.md, detached night chain for DeepSeek reruns and the stage 1 baseline
2026-10-03 18:34:07 +02:00
G0158
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0159
Handover notes, train/STATE.md, detached night chain for DeepSeek reruns and the stage 1 baseline
2026-10-03 18:34:07 +02:00
G0160
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0161
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0162
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0163
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0164
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00
G0165
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0166
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:25 +02:00
G0167
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0168
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0169
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:25 +02:00
G0170
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0171
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:25 +02:00
G0172
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0173
Decision: no separate SAP user for the harness (2026-10-03)
2026-10-03 19:00:50 +02:00
G0174
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0175
Decision: no separate SAP user for the harness (2026-10-03)
2026-10-03 19:00:50 +02:00
G0176
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0177
Decision: no separate SAP user for the harness (2026-10-03)
2026-10-03 19:00:50 +02:00
G0178
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0179
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0180
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0181
G0181 failure analysis (int8 in SALV), W7B results
2026-10-03 19:16:56 +02:00
G0182
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0183
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0184
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0185
Runner: G2 finds the FUNCTION statement after local classes; budget floor applied to all tasks
2026-10-03 18:25:30 +02:00
G0186
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0187
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0188
ADT fallback: Accept headers for FUNC; G0189 accepted; regen2 results
2026-10-03 16:31:03 +02:00
G0189
Review: 10 remaining accepted tasks (checklist)
2026-10-03 18:55:33 +02:00
G0190
Empirical filter results: DeepSeek reruns W6A/W7A (partial)
2026-10-03 18:54:16 +02:00
G0191
G0181 failure analysis (int8 in SALV), W7B results
2026-10-03 19:16:56 +02:00
easy_candidates.json
Review: 9 random high-score checks; easy candidates list
2026-10-03 18:56:12 +02:00