dev-strender Claude Fable 5.1 commited on
Commit
80208ae
ยท
1 Parent(s): 483134a

fix: swap solar-mini4-preview to solar-mini4 (preview model retired)

Browse files

The Upstage API now returns 400 invalid_request_body for
solar-mini4-preview. solar-mini4 resolves to solar-mini4-260922 and the
full v44 pipeline runs cleanly on the demo sample (11 steps, ~4s).

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

Files changed (2) hide show
  1. runner.py +1 -1
  2. solar_eval/providers/upstage.py +1 -1
runner.py CHANGED
@@ -49,7 +49,7 @@ CONFIGS: tuple[Config, ...] = (
49
  label="solar-mini4 ํŒŒ์ดํ”„๋ผ์ธ",
50
  pipeline="pipeline_dev_v44", # = v41 + document_chunking
51
  prompt="prompt_dev_260917_vsplit",
52
- model="solar-mini4-preview",
53
  note=(
54
  "FT ๊ต์—ด โ†’ ํŒ์ •ํ˜• step1(5KB) โ†’ ๋ฌธ๋งฅ ๊ต์ • ์–ดํœ˜/๋ฌธ๋ฒ• 2์Šคํ… โ†’ ๊ฒฐ์ •๋ก  ๊ทœ์น™ 6์ธต. "
55
  "์ž…๋ ฅ 3.3k ํ† ํฐ."
 
49
  label="solar-mini4 ํŒŒ์ดํ”„๋ผ์ธ",
50
  pipeline="pipeline_dev_v44", # = v41 + document_chunking
51
  prompt="prompt_dev_260917_vsplit",
52
+ model="solar-mini4",
53
  note=(
54
  "FT ๊ต์—ด โ†’ ํŒ์ •ํ˜• step1(5KB) โ†’ ๋ฌธ๋งฅ ๊ต์ • ์–ดํœ˜/๋ฌธ๋ฒ• 2์Šคํ… โ†’ ๊ฒฐ์ •๋ก  ๊ทœ์น™ 6์ธต. "
55
  "์ž…๋ ฅ 3.3k ํ† ํฐ."
solar_eval/providers/upstage.py CHANGED
@@ -17,7 +17,7 @@ THINK_PATTERN = re.compile(r"<think>(.*?)</think>", re.DOTALL)
17
 
18
  MAX_RETRIES = 3
19
  RETRY_DELAYS = [5, 10, 20] # seconds
20
- # 429 is expected on low-quota models (e.g. solar-mini4-preview: 100 RPM / 50k TPM),
21
  # so rate-limit waits don't consume the generic retry budget -- otherwise the
22
  # sample is dropped from results.jsonl and the score is computed on survivors.
23
  RATE_LIMIT_MAX_WAITS = 40
 
17
 
18
  MAX_RETRIES = 3
19
  RETRY_DELAYS = [5, 10, 20] # seconds
20
+ # 429 is expected on low-quota models (e.g. solar-mini4: 100 RPM / 50k TPM),
21
  # so rate-limit waits don't consume the generic retry budget -- otherwise the
22
  # sample is dropped from results.jsonl and the score is computed on survivors.
23
  RATE_LIMIT_MAX_WAITS = 40