together:deepseek-v4-flash
8/8/2026, 8:54:05 AM · 15 tests · run d3016c75-1d6e-4db4-ab36-a9e6d640dbeb
basic-generation
okPlain streaming generation with a soft length constraint (~100 words).
- Produced 99 words (149 output tokens).
Result
{
"wordCount": 99,
"outputTokens": 149
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
usage-cost
okAsserts usage tokens populate and cost computes from the ChatReq contract.
- in=14 out=192 rt=185 cost=$0.000056 (paid).
Result
{
"inputTokens": 14,
"outputTokens": 192,
"reasoningTokens": 185,
"costUsd": 0.00005572000000000001,
"paid": true
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
streaming-structure
okAsserts a streaming call captures events that reconstruct into the final text.
- mode=streaming, 34 stream events, 1 text block(s), 35 chars.
Result
{
"mode": "streaming",
"streamEventCount": 34,
"textBlocks": 1,
"textLen": 35
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
complete-stream-parity
okSame prompt via stream() and complete() both return valid, matching results.
- stream="Paris" · complete="Paris"
Result
{
"streamText": "Paris",
"completeText": "Paris"
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
reasoning-conformance
okAsserts the model's reasoning knob behaves as its reasoning-config declares.
- Class (from reasoning-config): toggleable.
- off: out=422 · mid: out=592 (rt=272).
Result
{
"class": "toggleable",
"mode": "deterministic",
"offOutputTokens": 422,
"midOutputTokens": 592,
"midReasoningTokens": 272
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
single-tool-call
okOffers a calculator tool and checks the model calls it for an arithmetic question.
- Called "multiply" with args {"a":23,"b":17}.
Result
{
"toolCalled": true,
"toolName": "multiply",
"args": {
"a": 23,
"b": 17
},
"correct": true
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
tool-loop
okForces a tool call, feeds the result back, and checks the continuation uses it.
- step1 (required): multiply({"a":23,"b":17}) → step2: "The product of 23 multiplied by 17 is 391."
Result
{
"toolName": "multiply",
"args": {
"a": 23,
"b": 17
},
"product": 391,
"continuation": "The product of 23 multiplied by 17 is 391.",
"usesResult": true,
"forced": true
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
web-search
okEnables server-side web search and checks invocation counts, the per-request cost surcharge, and provider-executed output blocks.
- Skipped: model does not support the catalog's web_search tool version.
Result
{
"skipped": "no server-side web search support"
}reasoning-tool-continuity
okReasoning model: continuity token captured on a tool call and replayed so the follow-up succeeds.
- reasoned=true, none token —; follow-up → "The current balance for account **acme-42** is **$1,234**. Now, let's"
Result
{
"signatureType": "none",
"tokenCaptured": false,
"reasoned": true,
"answered": true,
"continuation": "The current balance for account **acme-42** is **$1,234**.\n\nNow, let's compute the balance after 7 years with 5% annual compound interest:\n\n"
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
prompt-cache
okRepeat a large prefix; assert cache-read tokens are reported and cost drops.
- Skipped: provider has no (known) prompt-cache reporting.
Result
{
"skipped": "cacheStyle=none"
}json-output
okRequests a strict JSON object and checks it parses with the required keys.
- Output parsed as JSON.
- All required keys present.
- Output is bare JSON (no leading prose/fence).
Result
{
"parsed": {
"name": "Anthropic",
"founded": 2021,
"headquarters": "San Francisco, California, USA"
},
"validJson": true,
"missingKeys": [],
"bareJson": true
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
summarize-memex
okSummarizes an ~11k-token essay to ~500 words (long input, reasoning minimized).
- Read ~10232 input tokens, wrote 512 words (636 output tokens) in 9452ms.
Result
{
"wordCount": 512,
"inputTokens": 10232,
"outputTokens": 636,
"latencyMs": 9452
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
truncation
okTiny maxTokens on a long prompt yields finishReason:"length".
- finishReason=length, out=100 tokens.
Result
{
"finishReason": "length",
"outputTokens": 100
}togetherai:deepseek-ai/DeepSeek-V4-Flash-0731
streaming-only-rejection
okStreaming-only models reject complete(); all others accept it.
- streamingOnly=false; complete() succeeded.
Result
{
"streamingOnly": false,
"completeThrew": false
}abort
okA pre-aborted signal rejects the call (abort is threaded + honored).
- pre-aborted signal → rejected (AbortError).
Result
{
"rejected": true,
"errorName": "AbortError"
}