← Leaderboard

Hy4

Tencent · open-weight
Evaluated 2026-11-08
Run by VetEval
Evaluation certificate (PDF)
VetEval Index

Rank 25–26 of 29 · 2 models too close to separate.

Guessing earns nothing: a wrong answer scores below zero. The Index weights six clinical categories by caseload, then applies four multipliers that can only reduce it. The interval is a bootstrap 95% CI. How this is measured →

Safety

Safety penalty ×0.99: 0.3% of answers on safety-critical questions were wrong, weighted by severity.

Harm rate: 2.70 per 1,000 answers on safety-critical questions, weighted by severity. Any wrong answer on a safety-critical question counts, at the severity veterinarians assigned to that question. Declined and cut-off replies do not.

Raw index 58.3, reduced by safety penalty ×0.99, consistency ×0.76, safety coverage ×0.72. Published index 31.5.

The safety penalty multiplies the Index rather than being averaged into it. How this is measured →

SUMMARISE WITH
SHARE

Vendor response

Tencent has not responded to this result. A vendor can respond to any published result, and the response is published here, beside the entry, as received. Send a response

Per-category profile

Each category on a common 0–100 axis with its 95% confidence interval, the honest alternative to a radar chart.

Clinical Diagnosis & Differential
62.3
Pharmacology & Dosing
52.3
Species-Specific Knowledge
52.1
Triage & Emergency
64.5
Preventive / Public Health / Zoonoses
50.9
Communication & Professionalism
77.1
Safety & Harm Avoidance
69.1
View as data table
Per-category scores with 95% confidence intervals
CategoryScore95% CI
Clinical Diagnosis & Differential62.357.1–67.4
Pharmacology & Dosing52.347.0–57.7
Species-Specific Knowledge52.144.9–59.3
Triage & Emergency64.558.2–70.9
Preventive / Public Health / Zoonoses50.942.6–59.2
Communication & Professionalism77.168.0–86.3
Safety & Harm Avoidance69.161.6–76.6

Cost · speed · reliability

Cost / case
$0.0401
the vendor's published price applied to this run's tokens
Median time / question
50 s
excluding retries and queueing
Reliability
100.0%
questions that came back with a usable answer

How it compares

Hy4 against every other published model. Switch the axis to compare on safety, harm rate, cost, latency or reliability.

Hy4 against the field

The weighted composite across every category. The line through each bar is the 95% interval: where two intervals overlap, the order between those models is not established. A model whose safety review is pending has no bar until a veterinarian finishes it.

View as a table
VetEval Index for every published model
ModelVendorVetEval Index95% interval
Claude Opus 5.5Anthropic76.874.8 to 78.8
Kimi K3.1 ProMoonshot AI71.669.6 to 73.4
GPT-6.2 AstraOpenAI71.469.3 to 73.6
GPT 5.6 SolOpenAI69.867.7 to 71.8
Gemini 3.7 FlashGoogle66.464.2 to 68.5
Gemini 4 CarbonGoogle66.264.3 to 68.1
Gemini 4 ArgonGoogle64.562.5 to 66.7
Claude Opus 5Anthropic63.962.2 to 65.7
GPT-6 SolOpenAI62.460.3 to 64.4
Gemini 4 HydrogenGoogle62.360.4 to 64.4
GPT-6.2 SolOpenAI61.859.8 to 63.9
Muse WonderMeta58.356.2 to 60.3
GPT-5.6 TerraOpenAI57.655.7 to 59.5
GPT 6 LunaOpenAI55.753.7 to 57.6
Kimi K3Moonshot AI55.553.9 to 57.0
Gemini 3.8 FlashGoogle55.153.1 to 57.0
GLM 5.3Z.AI54.152.2 to 56.0
Grok 4.6SpaceXAI54.052.2 to 56.0
Grok 4.7SpaceXAI48.646.7 to 50.5
GLM 5.3 FlashZ.AI48.546.9 to 50.2
Claude Sonnet 5Anthropic46.444.4 to 48.5
Mistral Large 4Mistral45.744.1 to 47.4
Minimax M3Minimax38.436.8 to 39.9
Llama 4 MaverickMeta38.136.4 to 39.8
Claude Haiku 5.5Anthropic32.731.1 to 34.4
Hy4Tencent31.530.1 to 33.0
Qwen3.8 2.4T A95BAlibaba25.324.3 to 26.3
Nemotron 3.5 LightningNVIDIA3.73.3 to 4.2
Granite 4.2 8bIBM3.43.1 to 3.7

Run settings

The settings this evaluation used. Every scored run uses the same fixed settings, and a run that changes them is refused.

Model identifier
tencent/hy4
Temperature
0
Seed
20260804
Max output tokens
2048
Retry budget
8192 tokens, for one retry of a reply that was cut off
Reasoning effort
minimal
Passes per question
3, with the answer choices reshuffled each pass
Run by
VetEval
Date evaluated
08 Nov 2026
Pricing
$0.0802 input, $2.44 output, per million tokens

Scope. VetEval measures model performance on veterinary examination items. It is not clinical advice, and no result here licenses a model for clinical use.