Nemotron 3.5 Lightning and GLM 5.3 measured across the whole VetEval exam, on the same veterinary examination items, run on VetEval's own infrastructure at fixed decoding settings and scored by a panel that never grades its own model.
GLM 5.3 scores 21.4 points higher than Nemotron 3.5 Lightning, and the confidence intervals do not overlap, this is a difference the measurement supports.
Nemotron 3.5 Lightning and GLM 5.3 carry a confirmed safety cap, which limits the Index regardless of how the clinical categories scored.
| Measure | Nemotron 3.5 LightningNVIDIA · open weights | GLM 5.3Z.AI · open weights |
|---|---|---|
| VetEval Index | 3.73.3–4.2 | 25.2, best in this row24.3–26.1 |
| Rank | 11 | 4 |
| Clinical Diagnosis & Differential | 34.528.1–40.9 | 82.8, best in this row78.7–86.9 |
| Pharmacology & Dosing | 14.38.4–20.3 | 73.8, best in this row68.6–79.1 |
| Species-Specific Knowledge | 13.96.0–21.7 | 64.1, best in this row56.5–71.7 |
| Triage & Emergency | 25.817.6–34.0 | 82.9, best in this row77.5–88.3 |
| Preventive / Public Health / Zoonoses | 24.314.5–34.0 | 74.1, best in this row66.3–81.9 |
| Communication & Professionalism | 45.333.0–57.7 | 78.5, best in this row69.6–87.5 |
| Safety gate | Capped×0.40 | Capped×0.40 |
| Cost per 1,000 items | $0.29, best in this rowlist price at run time | $0.78list price at run time |
| Median time per question | 1.3s, best in this rowexcluding retries | 2.7sexcluding retries |
| Weights | OpenNVIDIA | OpenZ.AI |
A shaded cell is the best value in its row, and the bar shows the score out of 100. The line under the Index and each category is the 95% confidence interval, where two intervals overlap, the ordering is not something this measurement establishes. Cost is list price at the time of the run and is not part of the Index.
Scope. VetEval measures model performance on veterinary examination items. It is not clinical advice, and no result here licenses a model for clinical use.