tailieunhanh - SIR-DL: An architecture of semantic based image retrieval using deep learning technique and RDF triple language

In this paper, we propose the Semantic-Based Image Retrieval (SBIR) system based on the deep learning technique; this system is called as SIR-DL that generates visual semantics based on classifying image contents. Firstly, the color and spatial features of segmented images are extracted and these visual feature vectors are trained on the deep neural network to obtain visual words vectors. Then, we retrieve it on ontology to provide the identities and the semantics of similar images corresponds to a similarity measure. | Journal of Computer Science and Cybernetics, , (2019), 39–56 DOI SIR-DL: AN ARCHITECTURE OF SEMANTIC-BASED IMAGE RETRIEVAL USING DEEP LEARNING TECHNIQUE AND RDF TRIPLE LANGUAGE∗ VAN THE THANH1,a , DO QUANG KHOI2 , LE HUU HA1 , LE MANH THANH3 1 Faculty of Information Technology, HCMC University of Food Industry for Training and Fostering, Quang Nam University 3 Faculty of Information Technology, University of Science Hue University a vanthethanh@ 2 Center Abstract. The problem of finding and identifying semantics of images is applied in multimedia applications of many different fields such as hospital information system, geographic information system, digital library system, etc. In this paper, we propose the Semantic-Based Image Retrieval (SBIR) system based on the deep learning technique; this system is called as SIR-DL that generates visual semantics based on classifying image contents. Firstly, the color and spatial features of segmented images are extracted and these visual feature vectors are trained on the deep neural network to obtain visual words vectors. Then, we retrieve it on ontology to provide the identities and the semantics of similar images corresponds to a similarity measure. In order to carry out SIR-DL, the algorithms and diagram of this image retrieval system are proposed and after that we implement them on ImageCLEF@IAPR, which has 20,000 images. Based on experimental results, the effectiveness of our method is evaluated; these results are compared with some of the works recently published on the same image dataset. It shows that SIR-DL effectively solves the problem of SBIR and can be used to build multimedia systems in many different fields. Keywords. Bag of visual word; Deep learning; Ontology; SBIR; Similarity measure; Similar images. 1. INTRODUCTION Global digital data has been increasing rapidly and reaching enormous amounts. This leads to the need for a good method to solve the .