Document Type : Research Articles

Author

Department of Computer Engineering, Technical and Vocational University (TVU), Tehran, Iran.

Abstract

In many data mining problems, leveraging structural and local connectivity information can significantly improve clustering performance. This paper presents a novel semi-supervised clustering framework that integrates weighted feature information, Delaunay-based graph construction, and pairwise constraints. First, feature weights are computed based on within-class pairwise variability, emphasizing dimensions that contribute most to local cluster structure. Weighted distances between samples are then calculated, and a Delaunay graph is constructed and filtered using an influence radius, preserving meaningful local geometric relationships while removing redundant edges. To capture higher-order neighborhood information, a GraphSAGE-style embedding propagates feature information through the graph, generating enriched low-dimensional representations of the data. Pairwise constraints are incorporated into the similarity matrix to encode prior knowledge about sample relationships, guiding the clustering process. Finally, semi-supervised clustering is performed using constraint-based spectral clustering. Experiments on benchmark datasets demonstrate that the combination of structural graph information, feature weighting, and pairwise constraints substantially improves clustering accuracy. The proposed framework is flexible and can be effectively applied across diverse data domains.

Keywords

Main Subjects

[1] Pourbahrami S, Balafar MA, Khanli LM, Kakarash ZA. A survey of neighborhood construction algorithms for clustering and classifying data points. Computer Science Review. 2020 Nov 1;38:100315, https://doi.org/10.1016/j.cosrev.2020.100315.
[2] Xu Y, Huang D, Wang CD, Lai JH. Deep image clustering with contrastive learning and multi-scale graph convolutional networks. Pattern Recognition. 2024 Feb 1;146:110065, https://doi.org/10.1016/j.patcog.2023.110065.
[3] Ren L, Wang J, Li W, Guo M, Yu G. Single-cell RNA-seq data clustering by deep information fusion. Briefings in Functional Genomics. 2024 Mar;23(2):128-37, https://doi.org/10.1093/bfgp/elad017.
[4] Jadidoleslam M, Ghaseminejad M. Reliability-based Probabilistic Wind Power Planning Considering Correlation of Load and Wind. International Journal of Industrial Electronics Control and Optimization. 2022 Dec 1;5(4):304-15, https://doi.org/10.22111/ieco.2022.41531.1414.
[5] Lv Z, Wu Z, Zhu J. Clustering-Guided Contrastive Prototype Learning: Towards Semi-Supervised Medical Image Segmentation. Pattern Recognition. 2025 Aug 23:112321, https://doi.org/10.1016/j.patcog.2025.112321.
[6] You J, Hu C, Kamigaito H, Funakoshi K, Okumura M. Robust dynamic clustering for temporal networks. InProceedings of the 30th ACM International Conference on Information & Knowledge Management 2021 Oct 26 (pp. 2424-2433), https://doi.org/10.1016/j.jocs.2022.101877.
[7] Nie F, Zhang H, Wang R, Li X. Semi-supervised clustering via pairwise constrained optimal graph. InProceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence 2021 Jan 7 (pp. 3160-3166).
[8] Zeng G, Peng H, Li A, Liu Z, Yang R, Liu C, He L. Semisupervised clustering via structural entropy with different constraints. InProceedings of the 2024 SIAM International Conference on Data Mining (SDM) 2024 (pp. 208-216). Society for Industrial and Applied Mathematics. https://doi.org/10.1137/1.9781611978032.24 .
[9] Song Z, Yang X, Xu Z, King I. Graph-based semisupervised learning: A comprehensive review. IEEE Transactions on Neural Networks and Learning Systems. 2022 Mar 18;34(11):8174-94, DOI: 10.1109/TNNLS.2022.3155478.
[10] Elshakhs YS, Deliparaschos KM, Charalambous T, Oliva G, Zolotas A. A comprehensive survey on Delaunay triangulation: applications, algorithms, and implementations over CPUs, GPUs, and FPGAs. IEEE Access. 2024 Jan 15;12:12562-85, DOI: 10.1109/ACCESS.2024.3354709.
[11] Wang Y, Zou J, Wang K, Liu C, Yuan X. Semi-supervised deep embedded clustering with pairwise constraints and subset allocation. Neural Networks. 2023 Jul 1;164:310-22. https://doi.org/10.1016/j.neunet.2023.04.016
[12] Long Z, Gao Y, Meng H, Chen Y, Kou H. Semi-supervised clustering guided by pairwise constraints and local density structures. Pattern Recognition. 2024 Dec 1;156:110751. https://doi.org/10.1016/j.patcog.2024.110751  
[13] McQueen, James B. "Some methods of classification and analysis of multivariate observations." Proc. of 5th Berkeley Symposium on Math. Stat. and Prob.. 1967.
[14] MacQueen J. Multivariate observations. InProceedings ofthe 5th Berkeley Symposium on Mathematical Statisticsand Probability 1967 (Vol. 1, pp. 281-297).
[15] Ester M, Kriegel HP, Sander J, Xu X. A density-based algorithm for discovering clusters in large spatial databases with noise. Inkdd 1996 Aug 2 (Vol. 96, No. 34, pp. 226-231).
[16] Xu X, Ester M, Kriegel HP, Sander J. A distribution-based clustering algorithm for mining in large spatial databases. InProceedings 14th International Conference on Data Engineering 1998 Feb 23 (pp. 324-331). IEEE. DOI: 10.1109/ICDE.1998.655795
[17] Rodriguez A, Laio A. Clustering by fast search and find of density peaks. science. 2014 Jun 27;344(6191):1492-6.
[18] Du M, Ding S, Xu X, Xue Y. Density peaks clustering using geodesic distances. International Journal of Machine Learning and Cybernetics. 2018 Aug;9(8):1335-49. DOI https://doi.org/10.1007/s13042-017-0648-x.
[19] Opochinsky, Yaniv, et al. "K-autoencoders deep clustering." ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2020, DOI: 10.1109/ICASSP40776.2020.9053109.