RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Wenjun Gu, Mengfang Sun, Bingyao Liu, Ke Xu, Mingxiu Sui, Adaptive Spatio-Temporal Aggregation for Temporal Dynamic Graph-Based Fraud Risk Detection , Journal of Computer Technology and Software: Vol. 3 No. 5 (2024)
- Kaelen Rivera, Liner Chen, Xiaofei Wang, Leveraging GANs for Financial Fraud Detection: A Paradigm Shift , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Ziyu Cheng, Enhancing Intelligent Anomaly Detection in Cloud Backend Systems through Contrastive Learning and Sensitivity Analysis , Journal of Computer Technology and Software: Vol. 3 No. 4 (2024)
- Ruili Jiang, Yiwen Shi, SCDF-Net: Research on a Multi-Source Feature Fusion Binary Classification Prediction Network Algorithm for Supply Chain Delay Delivery Risk , Journal of Computer Technology and Software: Vol. 4 No. 7 (2025)
- Caspian Thorne, Deep Asymmetric Convolutional Encoder for Enhanced Network Intrusion Detection , Journal of Computer Technology and Software: Vol. 1 No. 3 (2022)
- Yi Yang, Markus Nagel, Alan Li, Consistency-Aware Unified Modeling for Multi-Source System Anomaly Detection , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
- Zhihao Wang, A Hierarchical Encoding and Selective Attention Enhancement Framework Based on Large Language Models for Long-Document Text Classification , Journal of Computer Technology and Software: Vol. 4 No. 11 (2025)
- Qingquan Wang, Xiaopei Zhang, Xingang Wang, Multimodal Integration of Physiological Signals Clinical Data and Medical Imaging for ICU Outcome Prediction , Journal of Computer Technology and Software: Vol. 4 No. 8 (2025)
- Zhaoyue Peng, Cross-Period Financial Statement Anomaly Detection via Contrastive Representation Learning , Journal of Computer Technology and Software: Vol. 3 No. 8 (2024)
- Thayer Winslow, Lightweight Attention-Enhanced Deep Learning for Flower Species Recognition , Journal of Computer Technology and Software: Vol. 4 No. 9 (2025)
You may also start an advanced similarity search for this article.
