together:qwen3.8-2.4t-a95b
8/18/2026, 8:11:49 AM · 15 tests · run d26f5bc7-ab4e-42bf-a455-2cf6360ee9d9
basic-generation
okPlain streaming generation with a soft length constraint (~100 words).
- Produced 98 words (128 output tokens).
Result
{
"wordCount": 98,
"outputTokens": 128
}togetherai:Qwen/Qwen3.8-2.4T-A95B
usage-cost
okAsserts usage tokens populate and cost computes from the ChatReq contract.
- in=60 out=65 rt=0 cost=$0.000556 (paid).
Result
{
"inputTokens": 60,
"outputTokens": 65,
"reasoningTokens": 0,
"costUsd": 0.00055625,
"paid": true
}togetherai:Qwen/Qwen3.8-2.4T-A95B
streaming-structure
okAsserts a streaming call captures events that reconstruct into the final text.
- mode=streaming, 29 stream events, 1 text block(s), 35 chars.
Result
{
"mode": "streaming",
"streamEventCount": 29,
"textBlocks": 1,
"textLen": 35
}togetherai:Qwen/Qwen3.8-2.4T-A95B
complete-stream-parity
okSame prompt via stream() and complete() both return valid, matching results.
- stream="Paris" · complete="Paris"
Result
{
"streamText": "Paris",
"completeText": "Paris"
}togetherai:Qwen/Qwen3.8-2.4T-A95B
togetherai:Qwen/Qwen3.8-2.4T-A95B
reasoning-conformance
okAsserts the model's reasoning knob behaves as its reasoning-config declares.
- Class (from reasoning-config): toggleable.
- off: out=594 · mid: out=1050 (rt=0, rchars=1043).
Result
{
"class": "toggleable",
"mode": "deterministic",
"offOutputTokens": 594,
"midOutputTokens": 1050,
"midReasoningTokens": 0
}togetherai:Qwen/Qwen3.8-2.4T-A95B
togetherai:Qwen/Qwen3.8-2.4T-A95B
single-tool-call
okOffers a calculator tool and checks the model calls it for an arithmetic question.
- Called "multiply" with args {"a":23,"b":17}.
Result
{
"toolCalled": true,
"toolName": "multiply",
"args": {
"a": 23,
"b": 17
},
"correct": true
}togetherai:Qwen/Qwen3.8-2.4T-A95B
tool-loop
okForces a tool call, feeds the result back, and checks the continuation uses it.
- step1 (required): multiply({"a":23,"b":17}) → step2: " The product of 23 multiplied by 17 is 391."
Result
{
"toolName": "multiply",
"args": {
"a": 23,
"b": 17
},
"product": 391,
"continuation": "\n\nThe product of 23 multiplied by 17 is 391.",
"usesResult": true,
"forced": true
}togetherai:Qwen/Qwen3.8-2.4T-A95B
togetherai:Qwen/Qwen3.8-2.4T-A95B
web-search
okEnables server-side web search and checks invocation counts, the per-request cost surcharge, and provider-executed output blocks.
- Skipped: model does not support the catalog's web_search tool version.
Result
{
"skipped": "no server-side web search support"
}reasoning-tool-continuity
okReasoning model: continuity token captured on a tool call and replayed so the follow-up succeeds.
- Step 1 didn't engage reasoning (adaptive discretion) — signature not exercised this run.
- reasoned=false, none token —; follow-up → "Great! The balance for account 'acme-42' is **$1,234 USD**. ## Calcul"
Result
{
"signatureType": "none",
"tokenCaptured": false,
"reasoned": false,
"answered": true,
"continuation": "Great! The balance for account 'acme-42' is **$1,234 USD**.\n\n## Calculation: 5% Annual Compound Growth Over 7 Years\n\nThe compound interest f"
}togetherai:Qwen/Qwen3.8-2.4T-A95B
togetherai:Qwen/Qwen3.8-2.4T-A95B
prompt-cache
okRepeat a large prefix; assert cache-read tokens are reported and cost drops.
- Skipped: provider has no (known) prompt-cache reporting.
Result
{
"skipped": "cacheStyle=none"
}json-output
okRequests a strict JSON object and checks it parses with the required keys.
- Output parsed as JSON.
- All required keys present.
- Output is bare JSON (no leading prose/fence).
Result
{
"parsed": {
"name": "Anthropic",
"founded": 2021,
"headquarters": "San Francisco, California"
},
"validJson": true,
"missingKeys": [],
"bareJson": true
}togetherai:Qwen/Qwen3.8-2.4T-A95B
summarize-memex
okSummarizes an ~11k-token essay to ~500 words (long input, reasoning minimized).
- Read ~10388 input tokens, wrote 534 words (709 output tokens) in 8339ms.
Result
{
"wordCount": 534,
"inputTokens": 10388,
"outputTokens": 709,
"latencyMs": 8339
}togetherai:Qwen/Qwen3.8-2.4T-A95B
truncation
okTiny maxTokens on a long prompt yields finishReason:"length".
- finishReason=length, out=100 tokens.
Result
{
"finishReason": "length",
"outputTokens": 100
}togetherai:Qwen/Qwen3.8-2.4T-A95B
streaming-only-rejection
okStreaming-only models reject complete(); all others accept it.
- streamingOnly=false; complete() succeeded.
Result
{
"streamingOnly": false,
"completeThrew": false
}abort
okA pre-aborted signal rejects the call (abort is threaded + honored).
- pre-aborted signal → rejected (AbortError).
Result
{
"rejected": true,
"errorName": "AbortError"
}