The labelling budget is usually a guess
Labelling is expensive because someone who knows the work has to look at every image, and that person has a job of their own. Until a model has been tried on part of your data, nobody knows how many examples are really needed.
Two people also rarely see a defect the same way. One passes a fine scratch and the other rejects it. If that line is not drawn before labelling starts, the model learns from data that contradicts itself, and a better architecture cannot make up for it.



