Wisdom of the Ensemble: Improving Consistency of Deep Learning Models
Deep learning classifiers are assisting humans in making decisions and hence the user’s trust in these models is of paramount importance. Trust is often a function of constant behavior...
From an AI model perspective it means given the same input the user would expect the same output, especially for correct outputs, or in other words consistently correct outputs. This paper studies a model behavior in the context of periodic retraining of deployed models where the outputs from successive generations of the models might not agree on the correct labels assigned to the same input. We formally