欢迎访问林草资源研究
技术应用

基于无人机影像的树种分割实践

  • 蒲涛 ,
  • 王妮 ,
  • 龚育红 ,
  • 王安
展开
  • 1.安徽理工大学 空间信息与测绘工程学院,安徽 淮南 232001
    2.安徽理工大学 矿山采动灾害空天地协同监测与预警安徽普通高校重点实验室,安徽 淮南 232001
    3.安徽理工大学 矿区环境与灾害协同监测煤炭行业工程研究中心,安徽 淮南 232001
    4.滁州学院 地理信息与旅游学院,安徽 滁州 239000
    5.安徽大学 资源与环境工程学院,合肥 230601
蒲涛(1998-),男,四川达州人,硕士研究生,主要研究方向为树种分类与制图、遥感场景分类等。Email:2021201639@Aust.edu.cn

收稿日期: 2022-11-18

  修回日期: 2023-02-01

  网络出版日期: 2023-05-05

基金资助

高校优秀青年人才支持计划一般项目(gxyq2021217);安徽省高校自然科学项目重点项目(KJ2021A1075);安徽理工大学研究生创新基金(2022CX2163)

Tree Species Segmentation Practice based on UAV Imagery

  • Tao PU ,
  • Ni WANG ,
  • Yuhong GONG ,
  • An WANG
Expand
  • 1. School of Geomatics,Anhui University of Science and Technology,Huainan,Anhui 232001,China
    2. Key Laboratory of Aviation-aerospace-ground Cooperative Monitoring and Early Warning of Coal Mining-induced Disasters of Anhui Higher Education Institutes,Anhui University of Science and Technology,KLAHEI (KLAHEI18015),Huainan,Anhui 232001,China
    3. Coal Industry Engineering Research Center of Mining Area Environmental and Disaster Cooperative Monitoring,Anhui University of Science and Technology,Huainan,Anhui 232001,China
    4. School of Geographic Information and Tourism,Chuzhou University,Chuzhou,Anhui 239000,China
    5. School of Resources and Environmental Engineering,Anhui University,Hefei 230601,China

Received date: 2022-11-18

  Revised date: 2023-02-01

  Online published: 2023-05-05

摘要

郁闭度超过60%的林地具有树种种类复杂、种内特征差距小及种间位置间距小等特点。虽然传统卷积神经网络(CNN)较其他分类方法具有精度高与自动化水平高等优势,但其存在学习效率低、识别精度提升困难及可解释性差等缺点。此外,传统规则分割绘制树种图的方法忽视了树种及遥感地物边界特征的变化,易在高郁闭度的林区产生椒盐现象。为解决上述问题,提出基于类激活映射及自注意力模型(ST)的新的树种分类方法(G-ST),它集成了迁移学习、ST分类模型与梯度下降的类激活映射,通过综合长距离特征、数据增强、其余领域的特征知识及预测训练关注度,提升G-ST分类精度、模型泛化能力及可解释性,结合简单线性迭代聚类方法生成树种专题地图。结果表明,该方法得到的树种图精度较传统CNN结合规则分割的制图方法更高,林木及遥感地物边界更趋近于矢量化结果,能有效为树种影像分割、制图及分布统计工作提供参考。

本文引用格式

蒲涛 , 王妮 , 龚育红 , 王安 . 基于无人机影像的树种分割实践[J]. 林草资源研究, 2023 , 0(1) : 115 -126 . DOI: 10.13466/j.cnki.lyzygl.2023.01.014

Abstract

The characteristics of the forest land with a canopy density of more than 60% include complex tree species,a narrow interspecific character gap,and modest interspecific distances.Traditional convolutional neural networks (CNN) are superior to other classification approaches in terms of accuracy and automation,but they also have a low learning efficiency,a tough time enhancing recognition accuracy,and poor interpretability.Additionally,the typical approach of creating maps of tree species through regular segmentation overlooks changes in tree species and boundary characteristics of remote sensing objects,making it simple to create the salt and pepper phenomenon in forest areas with dense canopies.Therefore,a Grad-Swin transformer (G-ST) based on class activation mapping and Swin transformer (ST) classification model was suggested as the solution to the aforementioned issues.It incorporates transfer learning,the ST classification model,and gradient descent class activation mapping,and by integratinglong-distance features,data enhancement,feature knowledge from other fields,and prediction training attention,it increases the G-ST classification accuracy as well as the model's generalization and interpretability abilities.Thematic maps of tree species are created by using a straightforward linear iterative clustering algorithm.The results demonstrated that the accuracy of the tree species map produced by this method was greater than that of the conventional CNN combined with regular segmentation,and the boundary between trees and remote sensing objects was closer to the vectorization result.This method can therefore serve as a useful reference for tree species image segmentation,mapping,and distribution statistics.

参考文献

[1] 戴鹏钦, 丁丽霞, 刘丽娟, 等. 基于FCN的无人机可见光影像树种分类[J]. 激光与光电子学进展, 2020, 57(10):36-45.
[2] 欧阳光, 荆林海, 阎世杰, 等. 基于卷积神经网络的高分遥感影像单木树种分类[J]. 激光与光电子学进展, 2021, 58(2):349-362.
[3] Xi Yanbiao, Tian Jia, Jiang Hailing, et al. Mapping tree species in natural and planted forests using Sentinel-2 images[J]. Remote Sensing Letters, 2022, 13(6):544-555.
[4] He Zhi, He Dan. Bilinear squeeze-and-excitation network for fine-grained classification of tree species[J]. IEEE Geoscience and Remote Sensing Letters, 2021, 18(7):1139-1143.
[5] 龚健雅, 宦麟茜, 郑先伟. 影像解译中的深度学习可解释性分析方法[J]. 测绘学报, 2022, 51(6):873-884.
[6] 滕文秀, 王妮, 施慧慧, 等. 结合面向对象和深度特征的高分影像树种分类[J]. 测绘通报, 2019(4):38-42.
[7] Deur M, Gasparovic M, Balenovici. An evaluation of Pixel-and object-based tree species classification in mixed deciduous forests using pansharpened very high spatial resolution satellite imagery[J]. Remote Sensing, 2021, 13(10):1868.
[8] Schieffr F, Kattenborn T, Frick A, et al. Mapping forest tree species in high resolution UAV-based RGB-imagery by means of convolutional neural networks[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 170:205-215.
[9] He Xin, Zhou Yong, Zhao Jiaqi, et al. Swin transformer embedding UNet for remote sensing image semantic segmentation[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60:1-15.
[10] 滕文秀, 温小荣, 王妮, 等. 基于深度迁移学习的无人机高分影像树种分类与制图[J]. 激光与光电子学进展, 2019, 56(7):277-286.
[11] Qin Haiming, Zhou Weiqi, Yao Yang, et al. Individual tree segmentation and tree species classification in subtropical broadleaf forests using UAV-based LiDAR,hyperspectral,and ultrahigh-resolution RGB data[J]. Remote Sensing of Environment, 2022, 280:113143.
[12] 夏爱梅, 聂乐群. 安徽植被带的划分[J]. 武汉植物学研究, 2004(6):523-528.
[13] Kawamura K, Asai H, Yasuda T, et al. Discriminating crops/weeds in an upland rice field from UAV images with the SLIC-RF algorithm[J]. Plant Production Science, 2021, 24(2):198-215.
[14] Homan D, Du Preez J A. Automated feature-specific tree species identification from natural images using deep semi-supervised learning[J]. Ecological Informatics, 2021, 66:101475.
[15] 赵霖, 张晓丽, 吴艳双, 等. 面向机载高光谱数据的3D-CNN亚热带森林树种分类[J]. 林业科学, 2020, 56(11):97-107.
[16] Zhang Cheng, Jiang Wanshou, Zhang Yuan, et al. Transformer and CNN hybrid deep neural network for semantic segmentation of Very-High-Resolution remote sensing imagery[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60:1-20.
[17] Huang Xin, Dong Mengjie, Li Jiayi, et al. A 3-D-Swin Transformer-Based hierarchical contrastive learning method for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60:1-15.
[18] Tu Jingzhi, Mei Gang, Ma Zhengjing, et al. SWCGAN:Generative adversarial network combining swin transformer and CNN for remote sensing image Super-Resolution[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022, 15:5662-5673.
[19] Selvaraju R R, Cogswell M, Das A, et al. Grad-CAM:Visual explanations from deep networks via Gradient-based localization[J]. International Journal of Computer Vision, 2020, 128(2):336-359.
[20] Su Hongjun, Yao Wenjing, Wu Zhaoyu, et al. Kernel low-rank representation with elastic net for China coastal wetland land cover classification using GF-5 hyperspectral imagery[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2021, 171:238-252.
文章导航

/