
Why neural networks fail on new data: overfitting
A neural network can perform well on training data and worse on examples it did not see during training. This is called overfitting: instead of learning useful general features, a model may memorize the training examples.