[1]范业嘉,孙 涵.基于轻量级深度哈希网络的细粒度图像检索[J].计算机技术与发展,2021,31(10):128-133.[doi:10. 3969 / j. issn. 1673-629X. 2021. 10. 022]
　FAN Ye-jia,SUN Han.Fine-grained Image Retrieval Based on Lightweight Deep Hash Network[J].,2021,31(10):128-133.[doi:10. 3969 / j. issn. 1673-629X. 2021. 10. 022]
点击复制

基于轻量级深度哈希网络的细粒度图像检索()
分享到：

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:
31
期数:
2021年10期
页码:
128-133
栏目:
应用前沿与综合
出版日期:
2021-10-10

文章信息/Info

Title:
Fine-grained Image Retrieval Based on Lightweight Deep Hash Network
文章编号:
1673-629X(2021)10-0128-06
作者:
范业嘉; 孙 涵
南京航空航天大学 计算机科学与技术学院 模式分析与机器智能工业和信息化部重点实验室,江苏 南京 211106
Author(s):
FAN Ye-jia; SUN Han
MIIT Key Laboratory of Pattern Analysis and Machine Intelligence,School of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
关键词:
深度哈希网络; 细粒度图像检索; 多尺度特征融合; 轻量级网络; 哈希编码层
Keywords:
deep hash network; fine-grained image retrieval; multi-scale feature fusion; lightweight network; hash coding layer
分类号:
TP31
DOI:
10. 3969 / j. issn. 1673-629X. 2021. 10. 022
摘要:
深度哈希利用端到端的框架同时进行特征学习及哈希编码, 两者相互促进,提取到合适的特征以及生成优质的哈希码。 然而, 深度哈希方法在图像检索研究中仍面临一些挑战: (1) 大多数现有的深度哈希方法使用复杂的神经网络作为基础网络,网络参数增多,模型越来越大,在一些移动端和嵌入式设备上很难写入几十甚至上百 MB 的模型。 (2) 目前,大多数深度哈希方法使用具有高时间复杂度的损失函数来保留原始数据空间和哈希编码之间的相似性,无法在时间和准确性上实现双赢。 针对上述问题, 文中利用轻量级网络作为主干网络,并针对细粒度图像类内距离大、类间距离小的特点, 提出跨层的多尺度 Non-Local 模块进行特征融合。 其次,在分类层之前加入哈希编码层,同时利用简单且有效的交叉熵损失代替复杂的成对相似性保留损失。 实验结果证明,在三个公开的细粒度图像数据集上,与其他先进的图像检索算法相比,文中提出的方法在检索性能上具有明显的优势,其 top1 的检索精度均可达 80% 以上,且超出第二名 10% 以上。
Abstract:
Deep hash uses an end-to-end framework to perform feature learning and hash coding at the same time,and the two promote each other to extract appropriate features and generate high-quality hash codes. However, deep hashing methods still face some challenges in image retrieval research. (1) Most of the existing deep hashing methods use complex neural networks as the basic network,with more network parameters and larger models,which is difficult to write tens or even hundreds of MB of models on some mobile terminals and embedded devices. (2) At present, most deep hashing methods use loss functions with high time complexity to preserve the similarity between the original data space and the hash coding space, and cannot achieve a win - win situation in terms of time and accuracy. In response to the above problems,we use a lightweight network as the backbone network and propose a cross-layer multi-scale feature fusion for the characteristics of fine-grained images with large intra-class distances and small inter-class distances.Secondly,a hash coding layer is added before the classification layer,and a simple and effective cross-entropy loss is used to replace the complex pairwise similarity preservation loss. The experiment proves that compared with other advanced image retrieval algorithms,the proposed method has obvious advantages in retrieval performance on three publicly available fine- grained image datasets,and its top1 retrieval accuracy can reach more than 80% , and exceed the second place by more than 10% .

相似文献/References:

[1]费东炜,孙 涵.基于深度哈希网络的车型识别方法[J].计算机技术与发展,2020,30(01):7.[doi:10. 3969 / j. issn. 1673-629X. 2020. 01. 002]
　FEI Dong-wei,SUN Han.A Vehicle Recognition Algorithm Based on Deep Hashing Network[J].,2020,30(10):7.[doi:10. 3969 / j. issn. 1673-629X. 2020. 01. 002]
[2]郎文溪,孙 涵.基于视觉一致性增强的细粒度图像检索[J].计算机技术与发展,2022,32(12):12.[doi:10. 3969 / j. issn. 1673-629X. 2022. 12. 003]
　LANG Wen-xi,SUN Han.Fine-grained Image Retrieval Based on Strengthened Visual Consistency[J].,2022,32(10):12.[doi:10. 3969 / j. issn. 1673-629X. 2022. 12. 003]
[3]殷梓轩,孙 涵.基于注意力金字塔与监督哈希的细粒度图像检索[J].计算机技术与发展,2023,33(03):20.[doi:10. 3969 / j. issn. 1673-629X. 2023. 03. 004]
　YIN Zi-xuan,SUN Han.Fine-grained Image Retrieval Based on Supervised Hashing with Attention Pyramid[J].,2023,33(10):20.[doi:10. 3969 / j. issn. 1673-629X. 2023. 03. 004]

更新日期/Last Update: 2021-10-10