Watch Tesla’s neural net labeling complexity for stop signs+
Insightful and interesting video from Andrej Karpathy on the challenges of tuning and labeling different situations for self-driving. The stop sign variables show how difficult a problem this is. Getting to 80% is probably not too difficult. Getting to 95% is very difficult. Getting the last 5% and then 1% is not only a massive challenge but you can see how labeling could introduce false positives and negatives and actually hurt system performance. For many applications, 95% is good enough but not here.