haiku-4.5

6/9/2026, 3:26:45 AM · 4 tests · run 6f9c98b6-f141-497f-93ea-fb113d118235

basic-generation

Plain streaming generation with a soft length constraint (~100 words).

Produced 100 words (140 output tokens).
Length is in a reasonable band around the ~100-word target.

Result

{
  "wordCount": 100,
  "outputTokens": 140
}

4f05a0e5-4cdf-448a-bae8-c7a441899105

Jun 9, 2026, 03:26:31

anthropic:claude-haiku-4-5-20251001

Input

Output

140

Cost

$0.000719

Mode

streaming

Latency

2.2s

TTFT

969ms

Tok/s

63.9

Tok/s (adj)

114.6

single-tool-call

Offers a calculator tool and checks the model calls it for an arithmetic question.

Called "multiply" with args {"a":23,"b":17}.
Correct tool and correct operands.

Result

{
  "toolCalled": true,
  "toolName": "multiply",
  "args": {
    "a": 23,
    "b": 17
  },
  "correct": true
}

2e07b867-377a-420a-9203-8867f9693a58

Jun 9, 2026, 03:26:32

anthropic:claude-haiku-4-5-20251001

Input

641

Output

Cost

$0.000986

Mode

streaming

Latency

1.2s

Tok/s

59.7

json-output

Requests a strict JSON object and checks it parses with the required keys.

Output parsed as JSON.
All required keys present.
Output had leading prose or a code fence before the JSON.

Result

{
  "parsed": {
    "name": "Anthropic",
    "founded": 2021,
    "headquarters": "San Francisco, California"
  },
  "validJson": true,
  "missingKeys": [],
  "bareJson": false
}

d0cba7bb-c1e7-42b6-9674-1271620d7b7b

Jun 9, 2026, 03:26:33

anthropic:claude-haiku-4-5-20251001

Input

Output

Cost

$0.000270

Mode

streaming

Latency

810ms

TTFT

614ms

Tok/s

50.6

Tok/s (adj)

209.2

summarize-memex

Summarizes an ~11k-token essay to ~500 words (long input, reasoning minimized).

Read ~10602 input tokens, wrote 545 words (772 output tokens) in 11839ms.
Summary length is near the ~500-word target.

Result

{
  "wordCount": 545,
  "inputTokens": 10602,
  "outputTokens": 772,
  "latencyMs": 11839
}

5e67fc8d-63bb-42d6-ad56-c7b459568ac2

Jun 9, 2026, 03:26:45

anthropic:claude-haiku-4-5-20251001

Input

10,602

Output

772

Cost

$0.0145

Mode

streaming

Latency

11.8s

TTFT

1.3s

Tok/s

65.2

Tok/s (adj)

73.5