Yes, while it is queued or running. A cancelled run returns its evaluation if nothing was billed against your endpoint yet.

Can two runs go at once?

Yes on a paid plan, if you have the balance. They do not affect each other, and one failing does not stop the other.

I ran out mid-project.

Buy more from the billing page, or use Contact us at the bottom of any page if you need an arrangement. See [buying evaluations](/docs/buying-evaluations).

RUNNING AN EVALUATION

Start a run

Where the button is, what it spends, and what happens in the first minute.

A run is started from the last step of the submission wizard, or later from your models page. The button says what it will spend before you press it.

What it spends

One evaluation, from the allowance that applies to your organization. Community accounts have one public evaluation in total. Lab includes 3 private and 6 public evaluations a year for the whole organization, and you can buy more private ones at any time, each carrying 2 free public evaluations with it. Your remaining balance is shown in the header while you are signed in.

The first minute

1QueuedThe run exists and is waiting for a worker. This is normally seconds.
2RunningYour endpoint is being called. Progress is shown live, and you can close the page: the run does not depend on your browser.
3ScoringAnswers are marked and the categories are weighted. Nothing calls your endpoint any more.
4CompleteThe result exists. On a paid plan it publishes; on Community it waits for review.

Questions we get asked

Was this page helpful?