Introduction Recently while running some experiments on Bert and trying to reproduce the results across different experiments with the same hyperparameters, I encountered something strange. In my two experiments, the only thing that was different was that I was evaluating the model performance on the…