Efficient hierarchical clustering for single-dimensional data using CUDA
Conference Publication ResearchOnline@JCUAbstract
Hierarchical clustering is a widely-used and well-researched clustering technique. The classical algorithm for agglomerative hierarchical clustering is prohibitively expensive for use with large datasets. Numerous algorithms exist to improve the efficiency of hierarchical clustering for various linkage metrics, and for large datasets. Recent research has proposed approaches for improving the efficiency of hierarchical clustering through parallelism. The newest approaches utilise GPGPU technologies, which facilitate massive parallelism on commodity consumer hardware. Existing GPGPU implementations fail to maximise the number of merges that can be performed in parallel, and feature high use of memory. These limitations prevent existing implementations from achieving the full performance offered by GPGPU. In this paper, we propose a novel GPGPU algorithm for hierarchical clustering of single-dimensional data. Our proposed algorithm exploits the unique characteristics of one-dimensional data to maximise merge parallelism and significantly reduce memory requirements. Validation demonstrates that our proposed algorithm produces equivalent results to the classical algorithm for both the single-linkage and complete-linkage metrics. Benchmarking results show that our algorithm scales well to large datasets, and offers a substantial speed-up over the classical algorithm. Future work will look to extend our proposed approach to larger datasets with higher dimensions.
Journal
N/A
Publication Name
Proceedings of the Australasian Computer Science Week Multiconference
Volume
N/A
ISBN/ISSN
978-1-4503-5436-3
Edition
N/A
Issue
N/A
Pages Count
10
Location
Brisbane, QLD, Australia
Publisher
Association for Computing Machinery (ACM)
Publisher Url
N/A
Publisher Location
New York, NY, USA
Publish Date
N/A
Url
N/A
Date
N/A
EISSN
N/A
DOI
10.1145/3167918.3167929