RUNNING AN EVALUATION

Public and private runs

The difference between a run that reaches the leaderboard and one only you can see.

Every run is declared public or private before it starts, and the choice cannot be changed afterwards.

PublicPrivate
Appears on the leaderboardYesNo
Visible to anybodyYesOnly to your organization
Counts towardsThe public meterThe private meter
Available on CommunityYes, one in totalNo
Available on LabYesYes

Why it is declared first

If visibility could be chosen after seeing the score, a vendor could run privately until a good number appeared and publish only that one. The board would then be a record of best attempts rather than of performance, which is a different and much less useful thing.

This is also why a Lab run costs the same whether or not you publish it. What the plan sells is the choice, not a discount for publishing.

What private runs are for

  • Checking a candidate before you commit to publishing it.
  • Tracking a training run week by week without adding noise to a public board.
  • Evaluating something you are not ready to talk about.

Questions we get asked

Was this page helpful?

Scope. VetEval measures model performance on veterinary examination items. It is not clinical advice, and no result here licenses a model for clinical use.