Neural network watchdog for out-of-distribution input mitigation.

Abstract

Neural networks have often been described as black boxes. The prevalence of publicly available neural networks and the application of transfer learning has allowed for the development of systems with minimal understanding of the data distribution. For example, a generic neural network trained to differentiate between kittens and puppies will classify a picture of a kumquat as either a kitten or a puppy, despite the kumquat residing outside the known data distribution. The neural network watchdog is a technique which screens trained classifier and regression machine input candidates to determine the distribution validity, and allows for methods of out-of-distribution removal with minimal performance impact.