Gemini 3.7 Flash vs Llama 4 Maverick

Gemini 3.7 Flash and Llama 4 Maverick measured on clinical diagnosis & differential, on the same veterinary examination items, run on VetEval's own infrastructure at fixed decoding settings and scored by a panel that never grades its own model.

Gemini 3.7 Flash scores 7.2 points above Llama 4 Maverick on Clinical Diagnosis & Differential, but their confidence intervals overlap, on this evidence the two cannot be separated.

Gemini 3.7 Flash and Llama 4 Maverick carry a confirmed safety cap, which limits the Index regardless of how the clinical categories scored.

2 of 4 models. Press Compare to see the results.

Side-by-side comparison of Gemini 3.7 Flash, Llama 4 Maverick across the VetEval Index, each scoring category, the safety gate, cost and latency.
MeasureGemini 3.7 FlashGoogle · proprietaryLlama 4 MaverickMeta · open weights
VetEval Index28.2, best in this row27.2–29.119.018.1–19.8
Rank1–3shared rank8–9shared rank
Clinical Diagnosis & Differential86.6, best in this row83.0–90.379.575.2–83.8
Pharmacology & Dosing73.5, best in this row68.0–78.960.054.2–65.7
Species-Specific Knowledge72.0, best in this row65.0–79.160.253.0–67.5
Triage & Emergency83.0, best in this row77.3–88.767.460.4–74.5
Preventive / Public Health / Zoonoses82.7, best in this row76.8–88.569.161.1–77.2
Communication & Professionalism85.1, best in this row76.7–93.572.562.5–82.5
Safety gateCapped×0.40Capped×0.40
Cost per 1,000 items$6.80list price at run time$1.29, best in this rowlist price at run time
Median time per question2.8s, best in this rowexcluding retries26.9sexcluding retries
WeightsProprietaryGoogleOpenMeta

A shaded cell is the best value in its row, and the bar shows the score out of 100. The line under the Index and each category is the 95% confidence interval, where two intervals overlap, the ordering is not something this measurement establishes. Cost is list price at the time of the run and is not part of the Index.

What this comparison does not tell you

  • These scores describe performance on veterinary examination items. They are not a certification, and no result here licenses a model for clinical use.
  • The Index weights categories for a general caseload. Every per-category score is published above so you can weigh them for yours instead, or compare on a single category using the control above.
  • Cost and latency are measured at run time and move separately from the scores. A model that is cheaper today may not be next month.

Related comparisons

Gemini 3.7 Flash vs Llama 4 Maverick by category

Scope. VetEval measures model performance on veterinary examination items. It is not clinical advice, and no result here licenses a model for clinical use.