Recovery Guarantees for Kernel-based Clustering under Non-parametric Mixture Models

Equivalence

Abstract

Despite the ubiquity of kernel-based clustering, surprisingly few statistical guarantees exist beyond settings that consider strong structural assumptions on the data generation process. In this work, we take a step towards bridging this gap by studying the statistical performance of kernel-based clustering algorithms under non-parametric mixture models. We provide necessary and sufficient separability conditions under which these algorithms can consistently recover the underlying true clustering. This is the first analysis that provides guarantees for kernel clustering approaches without structural assumptions on the component distributions. Additionally, we establish a key equivalence between kernel-based data-clustering and kernel density-based clustering. This enables us to provide consistency guarantees for kernel-based estimators of non-parametric mixture models. Along with theoretical implications, this connection has practical utility, including in the systematic choice of the bandwidth of the Gaussian kernel in the context of clustering.

Publication
In The 24th International Conference on Artificial Intelligence and Statistics
Avatar
Leena C Vankadara
Ph.D. candidate

I am a Ph.D. candidate in the area of Statistical learning theory.

Related