RUNNING AN EVALUATION
Public and private runs
The difference between a run that reaches the leaderboard and one only you can see.
Every run is declared public or private before it starts, and the choice cannot be changed afterwards.
Why it is declared first
If visibility could be chosen after seeing the score, a vendor could run privately until a good number appeared and publish only that one. The board would then be a record of best attempts rather than of performance, which is a different and much less useful thing.
This is also why a Lab run costs the same whether or not you publish it. What the plan sells is the choice, not a discount for publishing.
What private runs are for
- Checking a candidate before you commit to publishing it.
- Tracking a training run week by week without adding noise to a public board.
- Evaluating something you are not ready to talk about.
Questions we get asked
Was this page helpful?