Mining Flipping Correlations from Large Datasets with Taxonomies
In this paper, the authors introduce a new type of pattern - a flipping correlation pattern. The flipping patterns are obtained from contrasting the correlations between items at different levels of abstraction. They represent surprising correlations, both positive and negative, which are specific for a given abstraction level, and which "Flip" from positive to negative and vice versa when items are generalized to a higher level of abstraction. They design an efficient algorithm for finding flipping correlations, the Flipper algorithm, which outperforms naive pattern mining methods by several orders of magnitude. They apply Flipper to real-life datasets and show that the discovered patterns are non-redundant, surprising and actionable.