TARU PUBLICATIONS
Journal of Discrete Mathematical Sciences and Cryptography cover

Journal of Discrete Mathematical Sciences and Cryptography

(Since 1998)
Hybrid ·Peer-reviewed·ISSN (Online): 2169-0065·ISSN (Print): 0972-0529

CiteScore 2025: 2.7 (Q1)

Powered by:Powered by

Monthly Journal: Publishes theoretical and applied research in all areas of Discrete Mathematical Sciences, Cryptography, Combinatorics, Elliptic Curves and Information Security.

Issues up to 2022 co-published with and available at:Taylor & Francis Online
submissions@tarupublications.com
Taru Online First Current IssueSpecial IssuesBrowse all Issues
Journal of Discrete Mathematical Sciences and Cryptography
Open Access Research Article

Finite discrete RGCN model for kinship verification

, *

* Corresponding author · click or hover a name for details

pp. 991–1005Vol. 28Issue 3April 2025DOI: 10.47974/JDMSC-2295 Crossmark XML
Received:
21 Mar 2025
Published Online:
18 Apr 2025
Article type:
Research Article
Language:
EN
Article no.:
JDMSC-2295
Pages:
991–1005

Abstract

Kinship verification has been a challenging problem for generations, technology has been trying to resolve the same last two decades, without any success. It determines the blood relation between two people with help of their given pair of images. This problem has attracted significant attention in various fields, such as biometrics, forensic research, and social media, but age and gender differences make this problem more complicated, especially when we want to find the relationship between Descendants with skipped levels like grandparents and grandsons/daughters. In this paper, we proposed a novel approach by formulating kinship data as a finite discrete structure (FDS), which provides a mathematical model of kinship relations. We represent the data as a graph, where nodes denote individuals, and edges determine the relationships among them. This structured representation serves as the foundation for learning relational patterns. Using this Finite Discrete Structure framework, we employ Relational Graph Convolutional Networks (RGCN) to extract and analyze the complex relational dependencies in kinship verification. Initially EfficientNet is used to extract facial features, these feature vectors along with relations, form the graph structure.  RGCN processes this graph to derive kin relations and effectively capture complex patterns within the discrete structured space. To improve model’s ability for enhancing Class-wise discriminability we used ArcFace and Center loss functions to enforce feature separability and robust kinship classification.  We evaluate our approach on the FIW dataset, achieving an accuracy of 89.45%, demonstrating that our method effectively addresses the kinship verification problem within the framework of finite discrete structures. This work highlights the potential of graph-based models in analyzing and classifying complex relationships in structured, discrete domains.

Keywords

Finite discrete structureKinship verificationRGCNFeature extraction face imageArcFace lossCenter loss

Subject Classifications

68R0168R1068U1068T1068T45

References

[1] S. Javed, A. Sattar, and M. Javaid, “Extremal unicyclic graphs with fixed leaves via Sombor index,” J. Discrete Math. Sci. Cryptogr., pp. 1–13 (2024), doi: 10.47974/JDMSC-1988.
[2] C. Thyagarajan, D. Chithra, J. W. Andrews, P. R. Subramanian, S. Balaji, and P. J. Sathishkumar, “Companion bot with voice and facial emotion detection with PID based computer vision,” J. Discrete Math. Sci. Cryptogr., vol. 25, no. 4, pp. 903–911 (May 2022), doi: 10.1080/09720529.2022.2075069.
[3] J. Lu, J. Hu, and Y.-P. Tan, “Discriminative deep metric learning for face and kinship verification,” IEEE Trans. Image Process., vol. 26, no. 9, pp. 4269–4282 (Sep. 2017), doi: 10.1109/TIP.2017.2717505.
[4] R. Fang, K. D. Tang, N. Snavely, and T. Chen, “Towards computational models of kinship verification,” in 2010 IEEE Int. Conf. Image Process., pp. 1577–1580 (Sep. 2010), doi: 10.1109/ICIP.2010.5652590.
[5] H. Yan, J. Lu, W. Deng, and X. Zhou, “Discriminative multimetric learning for kinship verification,” IEEE Trans. Inf. Forensics Secur., vol. 9, no. 7, pp. 1169–1178 (Jul. 2014), doi: 10.1109/TIFS.2014.2327757.
[6] L. B. Damahe, N. V. Thakur, S. R. Jain, and S. D. Kamble, “Image retrieval evaluation on smart phone using variant of histogram of gradient,” J. Discrete Math. Sci. Cryptogr., vol. 26, no. 5, pp. 1265–1275 (2023), doi: 10.47974/JDMSC-1738.
[7] X. Zhou, K. Jin, M. Xu, and G. Guo, “Learning deep compact similarity metric for kinship verification from face images,” Inf. Fusion, vol. 48, pp. 84–94 (Aug. 2019), doi: 10.1016/j.inffus.2018.07.011.
[8] J. Lu, X. Zhou, Y.-P. Tan, Y. Shang, and J. Zhou, “Neighborhood repulsed metric learning for kinship verification,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 331–345 (Feb. 2014), doi: 10.1109/TPAMI.2013.134.
[9] J. Zhou et al., “Graph neural networks: A review of methods and applications,” AI Open, vol. 1, pp. 57–81 (2020), doi: 10.1016/j.aiopen.2021.01.001.
[10] B. Yang, W. Yih, X. He, J. Gao, and L. Deng, “Embedding entities and relations for learning and inference in knowledge bases,” arXiv preprint arXiv:1412.6575 (2014).
[11] M. Wang, Z. Li, X. Shu, J. Feng, and J. Tang, “Deep kinship verification,” in 2015 IEEE 17th Int. Workshop Multimedia Signal Process. (MMSP), pp. 1–6 (Oct. 2015), doi: 10.1109/MMSP.2015.7340820.
[12] X. Chen, X. Zhu, S. Zheng, T. Zheng, and F. Zhang, “Semi-Coupled Synthesis and Analysis Dictionary Pair Learning for Kinship Verification,” IEEE Trans. Circuits Syst. Video Technol., pp. 1–1 (2020), doi: 10.1109/TCSVT.2020.3017683.
[13] S. Xia, M. Shao, and Y. Fu, “Toward kinship verification using visual attributes,” in Proc. 21st Int. Conf. Pattern Recognit. (ICPR2012), p. 549 (2012).
[14] G. Guo and X. Wang, “Kinship measurement on salient facial features,” IEEE Trans. Instrum. Meas., vol. 61, no. 8, pp. 2322–2325 (Aug. 2012), doi: 10.1109/TIM.2012.2187468.
[15] P. Alirezazadeh, A. Fathi, and F. Abdali-Mohammadi, “A Genetic Algorithm-Based Feature Selection for Kinship Verification,” IEEE Signal Process. Lett., vol. 22, no. 12, pp. 2459–2463 (Dec. 2015), doi: 10.1109/LSP.2015.2490805.
[16] H. Y. Patil and A. Chandra, “Deep Learning based Kinship Verification on KinFaceW-I Dataset,” in TENCON 2019 - 2019 IEEE Region 10 Conf., pp. 2529–2532 (Oct. 2019), doi: 10.1109/TENCON.2019.8929460.
[17] E. Dahan and Y. Keller, “A unified approach to kinship verification,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 8, pp. 2851–2857 (Aug. 2021), doi: 10.1109/TPAMI.2020.3036993.
[18] F. Dornaika, I. Arganda-Carreras, and O. Serradilla, “Transfer learning and feature fusion for kinship verification,” Neural Comput. Appl., pp. 1–13 (Apr. 2019), doi: 10.1007/s00521-019-04201-0.
[19] A. Chergui et al., “Kinship Verification Through Facial Images Using CNN-Based Features,” Traitement du Signal, vol. 37, no. 1, pp. 1–8 (Feb. 2020), doi: 10.18280/ts.370101.
[20] M. Wang, X. Shu, J. Feng, X. Wang, and J. Tang, “Deep multi-person kinship matching and recognition for family photos,” Pattern Recognit., vol. 105, p. 107342 (Sep. 2020), doi: 10.1016/j.patcog.2020.107342.
[21] S. Wang, Z. Ding, and Y. Fu, “Cross-Generation Kinship Verification with Sparse Discriminative Metric,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 41, no. 11, pp. 2783–2790 (2019), doi: 10.1109/TPAMI.2018.2861871.
[22] A. Nandy and S. S. Mondal, “Kinship Verification using Deep Siamese Convolutional Neural Network,” in 2019 14th IEEE Int. Conf. Autom. Face & Gesture Recognit. (FG 2019), pp. 1–5 (May 2019), doi: 10.1109/FG.2019.8756528.
[23] R. F. Rachmadi, I. K. E. Purnama, S. M. S. Nugroho, and Y. K. Suprapto, “Dual Convolutional Neural Network Classifier with Pyramid Attention Network for Image-Based Kinship Verification,” Acta Cybern. (Jun. 2023), doi: 10.14232/actacyb.296355.
[24] M. Sivalakshmi, K. R. Prasad, and C. S. Bindu, “Convolutional-based variational autoencoders for face privacy protection in video surveillance,” J. Discrete Math. Sci. Cryptogr., vol. 27, no. 4, pp. 1205–1214 (2024), doi: 10.47974/JDMSC-1975.
[25] H. Wu, J. Chen, X. Liu, and J. Hu, “Component-based metric learning for fully automatic kinship verification,” J. Vis. Commun. Image Represent., vol. 79, p. 103265 (Aug. 2021), doi: 10.1016/j.jvcir.2021.103265.
[26] G.-N. Dong, C.-M. Pun, and Z. Zhang, “Kinship Verification Based on Cross-Generation Feature Interaction Learning,” IEEE Trans. Image Process., vol. 30, pp. 7391–7403 (Aug. 2021), doi: 10.1109/TIP.2021.3104192.
[27] S. Wang and H. Yan, “Discriminative sampling via deep reinforcement learning for kinship verification,” Pattern Recognit. Lett. (Jun. 2020), doi: 10.1016/j.patrec.2020.06.019.
[28] M. Bessaoudi, A. Chouchane, A. Ouamane, and E. Boutellaa, “Multilinear subspace learning using handcrafted and deep features for face kinship verification in the wild,” Appl. Intell., vol. 51, no. 6, pp. 3534–3547 (Jun. 2021), doi: 10.1007/s10489-020-02044-0.
[29] M. Oruganti, T. Meenpal, S. Majumdar, and S. R. N. Kusu, “Deep learning model for facial kinship verification using childhood images,” in 2023 Int. Conf. for Advancement in Technology (ICONAT), pp. 1–6 (Jan. 2023), doi: 10.1109/ICONAT57137.2023.10080273.
[30] H. Li, X. Zhao, M. Wang, H. Song, and F. Sun, “ORNet: Online Re-weighting Relation Network for kinship verification,” Expert Syst. Appl., vol. 255, p. 124815 (Dec. 2024), doi: 10.1016/j.eswa.2024.124815.
[31] L. Backstrom and J. Leskovec, “Supervised random walks: Predicting and recommending links in social networks,” in Proc. 4th ACM Int. Conf. Web Search Data Mining (WSDM), New York, NY, USA, pp. 635–644 (Feb. 2011), doi: 10.1145/1935826.1935914.
[32] L. Akoglu, H. Tong, and D. Koutra, “Graph based anomaly detection and description: a survey,” Data Min. Knowl. Discov., vol. 29, no. 3, pp. 626–688 (May 2015), doi: 10.1007/s10618-014-0365-y.
[33] F. Monti, D. Boscaini, J. Masci, E. Rodola, J. Svoboda, and M. M. Bronstein, “Geometric deep learning on graphs and manifolds using mixture model CNNs,” in 2017 IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 5425–5434 (Jul. 2017), doi: 10.1109/CVPR.2017.576.
[34] L. Wu et al., “Graph neural networks for natural language processing: A survey,” Found. Trends Mach. Learn., vol. 16, no. 2, pp. 119–328 (2023), doi: 10.1561/2200000096.
[35] Y. Li, R. Yu, C. Shahabi, and Y. Liu, “Diffusion convolutional recurrent neural network: Data-driven traffic forecasting,” arXiv preprint arXiv:1707.01926 (2017).
[36] P. Reiser et al., “Graph neural networks for materials science and chemistry,” Commun. Mater., vol. 3, no. 1, p. 93 (Nov. 2022), doi: 10.1038/s43246-022-00315-6.
[37] C. Gao et al., “A survey of graph neural networks for recommender systems: challenges, methods, and directions,” ACM Trans. Recomm. Syst., vol. 1, no. 1, pp. 1–51 (Mar. 2023), doi: 10.1145/3568022.
[38] M. Narasimhan and S. Lazebnik, “Out of the box: Reasoning with graph convolution nets for factual visual question answering,” in Proc. IEEE Conf. Image Process. (ICIP) (2018).
[39] T. Yao, Y. Pan, Y. Li, and T. Mei, “Exploring visual relationship for image captioning,” in Computer Vision – ECCV 2018, Munich, Germany, pp. 711–727 (Sep. 2018), doi: 10.1007/978-3-030-01258-8_43.
[40] Q. Chen and V. Koltun, “Photographic Image Synthesis with Cascaded Refinement Networks,” in 2017 IEEE Int. Conf. Comput. Vis. (ICCV), pp. 1520–1529 (Oct. 2017), doi: 10.1109/ICCV.2017.168.
[41] M. Tan and Q. Le, “EfficientNet: Rethinking model scaling for convolutional neural networks,” in Proc. 36th Int. Conf. Mach. Learn., pp. 6105–6114 (2019).
[42] O. Laiadi, A. Ouamane, A. Benakcha, A. Taleb-Ahmed, and A. Hadid, “Kinship Verification based Deep and Tensor Features through Extreme Learning Machine,” in 2019 14th IEEE Int. Conf. Autom. Face & Gesture Recognit. (FG 2019), pp. 1–4 (May 2019), doi: 10.1109/FG.2019.8756627.
[43] O. Laiadi, A. Ouamane, A. Benakcha, A. Taleb-Ahmed, and A. Hadid, “Tensor cross-view quadratic discriminant analysis for kinship verification in the wild,” Neurocomputing, vol. 377, pp. 286–300 (Feb. 2020), doi: 10.1016/j.neucom.2019.10.055.
[44] R. F. Rachmadi, I. K. Purnama, S. M. Nugroho, and Y. K. Suprapto, “Image-based Kinship Verification Using Dual VGG-Face Classifier,” in 2020 IEEE Int. Conf. Internet Things Intell. Syst. (IoTaIS), p. 123 (2021).
[45] S. Wang, J. P. Robinson, and Y. Fu, “Kinship Verification on Families in the Wild with Marginalized Denoising Metric Learning,” in 2017 12th IEEE Int. Conf. Autom. Face & Gesture Recognit. (FG 2017), pp. 216–221 (May 2017), doi: 10.1109/FG.2017.35.

Views: 182Downloads: 78Citations: 0