Cross-entropy method

The Cross-Entropy (CE) method is a statistical technique used for optimization and solving rare-event problems. It is based on the concept of minimizing the difference (or cross-entropy) between two probability distributions: the distribution under which the rare event occurs and the distribution that we sample from in an attempt to generate that event.