IS&T | Library

Optimized Multi-Class Urban Appearance Violation Detection Model in UAV Imagery

Abstract

This paper presents a self-supervised monocular visual odometry (VO) method guided by attention feature maps, aimed at effectively mitigating the impact of redundant pixels during network training. Existing self-supervised VO methods typically treat all pixels equally when computing photometric error, which can lead to increased sensitivity to noise from irrelevant pixels and, consequently, training errors. To address this issue, the authors adopt a soft-attention mechanism to generate attention feature maps that allow the model to focus on more relevant pixels while downweighting the influence of disruptive ones. This approach enhances the robustness and accuracy of depth estimation and pose tracking. The proposed method achieves competitive results on the KITTI dataset, with Sequences 09 and 10 demonstrating relative rotation errors of 0.022 and 0.032 and relative translation errors of 5.56 and 7.29, respectively.

Digital Library: JIST

FastTrack Article

IMETI 2024 Special Issue

13 0

urban appearance violation
UAV imagery
custom dataset
object detection
attention mechanism

Songlin Wei, Hua-Ching Chen, Hsuan-Ming Feng, Weiquan Li

Pages 1 - 9, © Society for Imaging Science and Technology 2025

DOI

10.2352/J.ImagingSci.Technol.2025.69.4.040405

Abstract

The detection of urban appearance violation in unmanned aerial vehicle imagery faces several challenges. To address this problem, an optimized YOLOv8n-based urban appearance violation detection model is proposed. A custom dataset including four classes is created owing to the lack of a sufficient dataset. The Convolutional Block Attention Module attention mechanism is applied to improve the feature extraction ability of the model. A small target detection head is added to capture the characteristics of small targets and context information more effectively. The loss function Wise Intersection over Union is applied to improve the regression performance of the bounding box and the robustness of detection. Experimental results show that compared with the YOLOv8n model, the Precision, Recall, mAP_0.5, and mAP_0.5−0.95 of the optimized method increase by 3.8%, 2.1%, 3.3%, and 4.8%, respectively. Besides, an intelligent urban appearance violation detection system is developed, which generates and delivers warning messages via the WeChat official account platform.

Digital Library: JIST

FastTrack Article

Automated Elimination of Non-Chromosome Objects for Metaphase Image Analysis

21 0

chromosome image
non-chromosome object
image feature analysis
classifier
computer-aided detection

Jain-Shing Wu, Ya-Ju Hsieh, Chien-Chih Ke, Wan-Chi Lin, Fang-Yu Ou Yang, E-Fong Kao

Pages 1 - 8, © Society for Imaging Science and Technology 2025

DOI

10.2352/J.ImagingSci.Technol.2025.69.6.060507

Abstract

For the automated analysis of metaphase chromosome images, the chromosomes on the images need to be segmented first. However, the segmentation results often contain several non-chromosome objects. Elimination of non-chromosome objects is essential in automated chromosome image analysis. This study aims to exclude non-chromosome objects from segmented chromosome candidates for further analysis. A feature-based method was developed to eliminate non-chromosome objects from metaphase chromosome images. In a metaphase chromosome image, the chromosome candidates were segmented by a threshold first. After segmenting the chromosome candidates, four classes of features, namely, area, density-based features, roughness-based features, and widths, of the segmented candidates were extracted to discriminate between chromosomes and non-chromosome objects. Seven classifiers were used and compared to combine the extracted features to perform classifications. The experimental results show the usefulness of the combination of extracted features in distinguishing between chromosomes and non-chromosome objects. The proposed method can effectively separate non-chromosome objects from chromosomes and could be used as the preprocessing procedure for chromosome image analysis.

Digital Library: JIST

FastTrack Article

Unveiling the Role of Color in Skin Segmentation: Analysis of Augmentation Techniques and Color Spaces

20 0

Mekides Assefa Abebe, Soroush Shahbaznejad, Alireza Rabbanifar, Elena Fedorovskaya

Pages 1 - 13, © Society for Imaging Science and Technology 2025

DOI

10.2352/J.ImagingSci.Technol.2025.69.5.050504

Abstract

Recent advancements in artificial intelligence have significantly impacted many color imaging applications, including skin segmentation and enhancement. Although state-of-the-art methods emphasize geometric image augmentations to improve model performance, the role of color-based augmentations and color spaces in enhancing skin segmentation accuracy remains underexplored. This study addresses this gap by systematically evaluating the impact of various color-based image augmentations and color spaces on skin segmentation models based on convolutional neural networks (CNNs). We investigate the effects of color transformations—including brightness, contrast, and saturation adjustments—in three color spaces: sRGB, YCbCr, and CIELab. To represent CNN models, an existing semantic segmentation model is trained using these color augmentations on a custom dataset of 900 images with annotated skin masks, covering diverse skin tones and lighting conditions. Our findings reveal that current training practices, which primarily rely on single-color augmentation in the sRGB space and focus mainly on geometric augmentations, limit model generalization in color-related applications like skin segmentation. Models trained with a greater variety of color augmentations show improved skin segmentation, particularly under over- and underexposure conditions. Additionally, models trained in YCbCr outperform those trained in sRGB color space when combined with color augmentation while CIELab leads to comparable performance to sRGB. We also observe significant performance discrepancies across skin tones, highlighting challenges in achieving consistent segmentation under varying lighting. This study highlights gaps in existing image augmentation approaches and provides insights into the role of various color augmentations and color spaces in improving the accuracy and inclusivity of skin segmentation models.

Digital Library: JIST

FastTrack Article

Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realization

11 0

diffusion model
image generation
prompt learning
document processing
seal generation

Mingfu Yan, Jiancheng Huang, Shifeng Chen

Pages 1 - 11, © Society for Imaging Science and Technology 2025

DOI

10.2352/J.ImagingSci.Technol.2025.69.5.050502

Abstract

Seal-related tasks in document processing—such as seal segmentation, authenticity verification, seal removal, and text recognition under seals—hold substantial commercial importance. However, progress in these areas has been hindered by the scarcity of labeled document seal datasets, which are essential for supervised learning. To address this limitation, we propose Seal2Real, a novel generative framework designed to synthesize large-scale labeled document seal data. As part of this work, we also present Seal-DB, a comprehensive dataset containing 20,000 labeled images to support seal-related research. Seal2Real introduces a prompt prior learning architecture built upon a pretrained Stable Diffusion model, effectively transferring its generative capability to the unsupervised domain of seal image synthesis. By producing highly realistic synthetic seal images, Seal2Real significantly enhances the performance of downstream seal-related tasks on real-world data. Experimental evaluations on the Seal-DB dataset demonstrate the effectiveness and practical value of the proposed framework.

Digital Library: JIST

FastTrack Article

Optimization of Region Detection for Magnetic Induction Tomography of Cerebral Hemorrhage based on Stacked Autoencoder Algorithm

20 0

magnetic induction tomography
cerebral hemorrhage
stacked autoencoder
region detection

Ruijuan Chen, Xinlei Zhu, Yalin Du, Zhuangzhuang Zhao, Hongsheng Sun, Huiquan Wang

Pages 1 - 10, © Society for Imaging Science and Technology 2025

DOI

10.2352/J.ImagingSci.Technol.2025.69.4.040508

Abstract

Cerebral hemorrhage is a common cerebrovascular disease, and magnetic induction tomography (MIT), a new electromagnetic imaging technique is used as a good auxiliary method for preoperative and postoperative bedside monitoring, and supplement computed tomography (CT) and magnetic resonance imaging (MRI) studies. In practical applications, space constraints limit the number of coils set up by the MIT system, which in turn limits the imaging information obtained from the detection coils. In order to reduce the number of coils while ensuring imaging accuracy and explore the relationship between the relative positions of coil arrays and lesions so as to obtain better reconstruction results, a regional detection method of MIT for cerebral hemorrhage based on the stacked autoencoder (SAE) neural network algorithm is proposed. Based on the complex brain model, simulation experiments were carried out to divide into different regions according to the position of the coils and compare the reconstruction effect of the lesions. Results showed that the reconstruction effect of the lesions near the excitation coil was poor, and the reconstruction effect of the lesions near the detection coil was better. Phantom experiments were carried out to further verify the results. The sensitive region detection approach provides a novel idea for MIT optimization in detecting cerebral hemorrhage.

Digital Library: JIST

FastTrack Article

Accurate Tomato Leaf Disease Identification Method based on Improved Swin Transformer

11 0

tomato leaf disease identification
Swin Transformer
Local Feature Perception
Spatial Texture Attention

Yue Cao

DOI

10.2352/J.ImagingSci.Technol.2025.69.5.050503

Work presented at ICCSCT2024

Abstract

The tomato leaf is a significant organ that reflects the health and growth of tomato plants. Early detection of leaf diseases is crucial to both crop yield and the income of farmers. However, the global distribution of diseases across tomato leaves coupled with fine-grained differences among various diseases poses significant challenges for accurate disease detection. To tackle these obstacles, we propose an accurate tomato leaf disease identification method based on an improved Swin Transformer. The proposed method consists of three parts: the Swin Transformer backbone, a Local Feature Perception (LFP) module, and a Spatial Texture Attention (STA) module. The backbone can model long-range dependencies of leaf diseases for representative features while the LFP module adopts a multi-scale aggregation strategy to enhance the capability of the Swin Transformer in local feature extraction. Moreover, the STA module integrates hierarchical features from different stages of the Swin Transformer to capture fine-grained features for the classification head and boost overall performance. Extensive experiments are conducted on the public LBFtomato dataset, and the results demonstrate the superior performance of our proposed method. Our proposed model achieves the scores of 99.28% in Accuracy, 99.07% in Precision, 99.36% in Recall, and 99.24% in F₁-score metrics.

Digital Library: JIST

FastTrack Article

11 0

Integrating 3D Face Alignment with Head Pose Estimation

3D face alignment
deep learning
head pose estimation
multi-scale residual network
multi-task learning

Jing Zhang, Yijie Tong

DOI

10.2352/J.ImagingSci.Technol.2025.69.6.060402

Abstract

We propose an efficient multi-scale residual network that integrates 3D face alignment with head pose estimation from an RGB image. Existing methods excel in performing each task independently but often fail to acknowledge the interdependence between them. Additionally, these approaches lack a progressive fine-tuning process for 3D face alignment, which could otherwise require excessive computational resources and memory. To address these limitations, we introduce a hierarchical network that incorporates a frontal face constraint, significantly enhancing the accuracy of both tasks. Moreover, we implement a multi-scale residual merging process that allows for multi-stage refinement without compromising the efficiency of the model. Our experimental results demonstrate the superiority of our method compared to state-of-the-art approaches.

Digital Library: JIST

FastTrack Article

Implementing Instance Segmentation for Image Recognition Based on YOLOv8: A Case Study on Canine Fecal Matter

13 0

YOLOv8
LabVIEW
Bristol Stool Scale
image recognition
data augmentation
instance segmentation

Kai-Chao Yao, Tao-Shuo Wang

DOI

10.2352/J.ImagingSci.Technol.2025.69.6.060501

Erratum: Influence of Display Sub-pixel Arrays on Roughness Appearance

Abstract

As pets now outnumber newborns in households, the demand for pet medical care and attention has surged. This has led to a significant burden for pet owners. To address this, our experiment utilizes image recognition technology to preliminarily assess the health condition of dogs, providing a rapid and economical health assessment method. By collaboration, we collected 2613 stool photos, which were enhanced to a total of 6079 images and analyzed using LabVIEW and the YOLOv8 segmentation model. The model performed excellently, achieving a precision of 86.805%, a recall rate of 74.672%, and an mAP50 of 83.354%. This proves its high recognition rate in determining the condition of dog stools. With the advancement of technology and the proliferation of mobile devices, the aim of this experiment is to develop an application that allows pet owners to assess their pets’ health anytime and manage it more conveniently. Additionally, the experiment aims to expand the database through cloud computing, optimize the model, and establish a global pet health interactive community. These developments not only propel innovation in the field of pet medical care but also provide practical health management tools for pet families, potentially offering substantial help to more pet owners in the future.

Digital Library: JIST

FastTrack Article

Erratum

22 0

DOI

10.2352/J.ImagingSci.Technol.2025.69.4.040601