erhan/abap-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

MLX server: prompt cache limit (memory); restart after the T01 test

Browse Source 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014aUaQeLnwbb1zTpN7kHeat
This commit is contained in:
Kral
2026-10-03 18:47:03 +02:00
parent 81d8cf6f99
commit d83a39a8d8
3 changed files with 14 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
train/restart_server.sh Executable file
View File

@@ -0,0 +1,11 @@
#!/bin/sh
# Restart the MLX server with the prompt cache limit when the T01 test (PID 59414) has ended,
# before the night chain starts the baseline. Log: runs/stage1/restart_server.log
cd "$(dirname "$0")/.."
while kill -0 59414 2>/dev/null; do sleep 20; done
echo "$(date '+%F %T') T01 test ended; restart server"
kill 59352; while kill -0 59352 2>/dev/null; do sleep 2; done
nohup train/serve.sh > runs/stage1/server.log 2>&1 &
echo "$(date '+%F %T') new server PID $!"
i=0; until curl -s -m 2 http://127.0.0.1:8080/v1/models >/dev/null 2>&1 || [ $i -ge 60 ]; do sleep 5; i=$((i+1)); done
echo "$(date '+%F %T') server ready: $(curl -s -m 2 http://127.0.0.1:8080/v1/models | head -c 80)"