[1]黄志伦,刘 俊,郑 萌.基于双线性特征融合的皮肤病分类研究[J].计算机技术与发展,2023,33(02):161-166.[doi:10. 3969 / j. issn. 1673-629X. 2023. 02. 024]
　HUANG Zhi-lun,LIU Jun,ZHENG Meng.Classification of Skin Diseases Based on Bilinear Feature Fusion[J].,2023,33(02):161-166.[doi:10. 3969 / j. issn. 1673-629X. 2023. 02. 024]

点击复制

基于双线性特征融合的皮肤病分类研究()

《计算机技术与发展》[ISSN:1006-6977/CN:61-1281/TN]

卷:

33

期数:

2023年02期

页码:

161-166

栏目:

人工智能

出版日期:

2023-02-10

文章信息/Info

Title:

Classification of Skin Diseases Based on Bilinear Feature Fusion

文章编号:

1673-629X(2023)02-0161-06

作者:

黄志伦¹; 2 ; 刘 俊¹; 2 ; 郑 萌³

1. 武汉科技大学 计算机科学与技术学院,湖北 武汉 430065;

2. 智能信息处理与实时工业系统湖北省重点实验室(武汉科技大学),湖北 武汉 430065;

3. 武汉理工大学 计算机科学与技术学院,湖北 武汉 430070

Author(s):

HUANG Zhi-lun1; 2 ; LIU Jun1; 2 ; ZHENG Meng3

1. School of Computer Science and Technology,Wuhan University of Science and Technology,Wuhan 430065,China;

2. Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System ( Wuhan University of Science and Technology) ,Wuhan 430065,China;

3. School of Computer Science and Technology,Wuhan University of Technology,Wuhan 430070,China

关键词:

肤病; 深度学习; 双线性特征融合; 注意力机制; 图像分类

Keywords:

skin disease; deep learning; bilinear feature fusion; attention mechanism; image classification

分类号:

TP391

DOI:

10. 3969 / j. issn. 1673-629X. 2023. 02. 024

摘要:

皮肤覆盖肌肉、骨骼和身体的每个部分,是人体中最大的器官。 由于其暴露于外界,所以感染更容易发生在皮肤上。 皮肤病作为一种常见疾病,利用计算机技术对其进行辅助诊断,有助于减轻医生负担。 针对常规卷积神经网络应用于皮肤病图像分类时由于不同种皮肤病图像之间的类间相似性以及同种皮肤病图像之间具有类内差异性导致分类困难的问题,提出一种改进双线性特征融合模型。 使用经过剪枝的 Inception-ResNet-v1 和 v2 版本作为特征提取器并行提取图像特征,对特征进行双线性融合,获取更多阶数的特征信息可以提高模型对图像细节的敏感度。 然后添加额外的软注意力模块,通过加权和的方式进行过滤或者加强,给图像每个位置给予不同的权重以达到对模型的加强效果。 在 skin -cancer-classesisic 数据集上的 7 种皮肤病图像上进行训练,与 S-CNN、MobileNet 和 Incremental CNN 的对比证明了该模型的有效性,在 Precision、Recall 和 F1-Score 指标上该模型均为最优。

Abstract:

Skin covers muscles,bones and every part of the body,which is the largest organ in the human body. Because it is exposed tothe outside world,the infection is more likely to occur on the skin. Skin disease is a common disease. Using computer technology todiagnose it will help to reduce the burden of doctors. In view of the difficulty of classification caused by the inter class similarity betweendifferent skin disease images and the intra class difference between the same skin disease images when the conventional convolutionalneural network is applied to the classification of skin disease images,an improved bilinear feature fusion model is proposed. Using thepruned version of Inception-ResNet-v1 and v2 as the feature extractor to extract image features in parallel,bilinear fusion of features andobtain more order feature information can improve the sensitivity of the model to image details. Then add an additional soft attentionmodule to filter or strengthen the image by weighted sum,and give different weights to each position of the image to achieve the effect ofstrengthening the model. Training on seven kinds of skin disease images on skin cancer classic dataset,the comparison with S-CNN,MobileNet and Incremental CNN proves the effectiveness of this model,which is the best in Precision,Recall and F1-Score.

常用功能