IMAGE RETRIEVAL USING DEEP LEARNING AND GRAPH THEORY
DOI:
https://doi.org/10.30572/2018/KJE/170430Keywords:
Multilayer Perceptron (MLP), Content-Based Image Retrieval, Graph Theory, Graph Convolutional Networks (GCN), Yolov8, Image Graph Modelling, Smart Binary Matching System, Visual features Fusion System, HandcraftAbstract
The aim of this research is to retrieve a query image from a pre-defined database of images by extracting features based on similarity measures, taking into account the visual representation of the query image. This includes considerations such as color and orientation, which may vary due to rotation or changes in the viewing angle. In our research, we proposed a specialized Multilayer Perceptron (MLP) trained using Back propagation neural network algorithm designed to function as a visual feature fusion system to enhance the matching process. In addition, we have developed a custom binary matching system in Python to serve as a Content-Based Image Retrieval (CBIR) system, and precision in retrieval of the images. We used Graph Theory, where each image represented as a graph according to color histograms of separated areas. Based on Graph Convolutional Network (GCN), we obtained structural embedding to capture structural features pairing visual features with spatial connections. This type of graph-based algorithm supplements the neural network, and it gives a stronger matching in the images that possess complex structures. The joined system can enhance the overall retrieval effectively with features of pixel-level, relational, and the unification of information features
Downloads
References
Ali, A., & Baiee, W. R. (2025). A comprehensive study of deep learning approaches for predicting reciprocal traffic dynamics and climate variability. Kufa Journal of Engineering, 16(3), 22–42. https://doi.org/10.30572/2018/KJE/160302
Al-Jawadi, O. M. A. (2023). Enhancing drivers’ attention by a smart binary matching machine to avoid accidents. Al-Rafidain Engineering Journal, 28(2), 261–283. https://doi.org/10.33899/rengj.2023.138781.1240
Ashraf, R., Ahmed, M., Ahmad, U., Jabbar, S., & Naseer, K. (2020). MDCBIR-MF: Multimedia data for content-based image retrieval using multiple features. Multimedia Tools and Applications, 79(7), 8553–8579. https://doi.org/10.1007/s11042-018-5961-1
Bibi, R., Mehmood, Z., Munshi, A., Yousaf, R. M., & Ahmed, S. S. (2022). Deep features optimization based on transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval. PLOS ONE, 17(10), e0274764. https://doi.org/10.1371/journal.pone.0274764
Bibi, R., Mehmood, Z., Yousaf, R. M., Malik, S., & Lee, S. (2020). Query-by-visual-search: Multimodal framework for content-based image retrieval. Journal of Ambient Intelligence and Humanized Computing, 11(12), 5629–5648. https://doi.org/10.1007/s12652-020-01923-1
Bochkovskiy, A., Wang, C. Y., & Liao, H. Y. M. (2020). YOLOv4: Optimal speed and accuracy of object detection. Available at: https://www.semanticscholar.org/reader/2a6f7f0d659c5f7dcd665064b71e7b751592c80e.
Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., & Vandergheynst, P. (2017). Geometric deep learning: Going beyond Euclidean data. IEEE Signal Processing Magazine, 34(4), 18–42. https://arxiv.org/pdf/1611.08097
Chaidos, N., Dimitriou, A., Lymperaiou, M., & Stamou, G. (2025). SCENIR: Visual semantic clarity through unsupervised scene graph retrieval. arXiv preprint. Available at: https://arxiv.org/html/2505.15867v1.
Easa, M.J.و Ali, I.H. 2025. A new augmentation technique for improved bone fractures image classification using YOLO. Kufa Journal of Engineering, 16(4), 458-474. DOI: https://doi.org/10.30572/2018/KJE/160426 .
Ghaleb, M. S., Ebied, H. M., Shedeed, H. A., & Tolba, M. F. (2022). Image retrieval based on deep learning. Journal of System and Management Sciences, 12(2), 477–496. Available at: https://www.aasmr.org/jsms/Vol12/JSMS%20April%202022/Vol.12No.02.26.pdf .
Hadid, M. H., Hussein, Q. M., Al-Qaysi, Z. T., Ahmed, M. A., & Salih, M. M. (n.d.). An overview of content-based image retrieval methods and techniques. Tikrit University.
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 770–778). Available at: https://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html.
Jiang, D., & Kim, J. (2021). Image retrieval method based on image feature fusion and discrete cosine transform. Applied Sciences, 11(12), 5701. https://doi.org/10.3390/app11125701
Jocher, G., Chaurasia, A. and Qiu, J. (2023) YOLO by Ultralytics. Available at: https://github.com/ultralytics/ultralytics.
Johnson, J., Krishna, R., Stark, M., Li, L.-J., Shamma, D. A., Bernstein, M. S., & Fei-Fei, L. (2015). Image retrieval using scene graphs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 3668–3678). Available at: https://openaccess.thecvf.com/content_cvpr_2015/papers/Johnson_Image_Retrieval_Using_2015_CVPR_paper.pdf.
Keisham, N., & Neelima, A. (2022). Efficient content-based image retrieval using deep search and rescue algorithm. Soft Computing, 26(3), 1597–1616. Available at: https://doi.org/10.1007/s00500-021-06660-x
Khaleel, T. A., & Al-Shumam, A. A. (2020). A study of graph theory applications in IT security. Iraqi Journal of Science, 61(10), 2774–2789. https://doi.org/10.24996/ijs.2020.61.10.28
Kipf, T. N., & Welling, M. (2017). Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations (ICLR). Available at: https://arxiv.org/abs/1609.02907.
Mathew, A., et al. (2020). Deep learning techniques: An overview. In Advances in Intelligent Systems and Computing (pp. 599–608). Springer. https://doi.org/10.1007/978-981-15-3383-9_54.
Mohammed, M., Baiee, W. R., & Ali, A. (2022). Deep learning methods for digital image classification: Comparative study and medical image analysis applications. Kufa Journal of Engineering, 13(4), 101–120. https://doi.org/10.30572/2018/KJE/130405.
Muhanad, M. and Baiee, W.R., 2018. GPS trajectory clustering for spatio-temporal behavior analysis: The application of heatmap techniques and spatio-temporal dual graph neural network. Kufa Journal of Engineering, 9(1), pp.53–74. https://doi.org/10.30572/2018/KJE/160105
Ng, A. (2017). Deep learning specialization [Online course]. DeepLearning.AI. Available at: https://www.deeplearning.ai/.
Redmon, J., & Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv preprint arXiv:1804.02767. https://arxiv.org/abs/1804.02767.
Shabbir, A., Ali, N., Ahmed, J., Zafar, B., Rasheed, A., Sajid, M., Ahmed, A. and Dar, S.H. (2021) ‘Satellite and scene image classification based on transfer learning and fine tuning of ResNet50’, Mathematical Problems in Engineering, 2021, Article ID 5843816. https://doi.org/10.1155/2021/5843816 .
Shah, S., & Pradhan, R. (2020). A new method for image classification and image retrieval using graph-based features. Concurrency and Computation: Practice and Experience, 32(15), e6533. https://doi.org/10.1002/cpe.6533
Simonyan, K., & Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. In Proceedings of the International Conference on Learning Representations (ICLR). Available at: https://arxiv.org/abs/1409.1556.
Wang, J., Lu, S., Wang, S.-H., & Zhang, Y.-D. (2022). A review on extreme learning machine. Multimedia Tools and Applications, 81, 41611–41660. https://doi.org/10.1007/s11042-021-11007-7.
Xu, K., Hu, W., Leskovec, J., & Jegelka, S. (2019). How powerful are graph neural networks? In Proceedings of the International Conference on Learning Representations (ICLR). Available at: https://arxiv.org/abs/1810.00826.
Zhang, Y., Ma, Y., & Ling, H. (2022). Re-ranking person re-identification with graph convolution network. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Available at: https://arxiv.org/abs/1810.00826.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2026 Arjuwan M. A. Al-Jawadi, Ayhan A. K. Al-Shumam

This work is licensed under a Creative Commons Attribution 4.0 International License.












