RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Honghui Xin, Ray Pan, Self-Attention-Based Modeling of Multi-Source Metrics for Performance Trend Prediction in Cloud Systems , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
- Elliot Greaves, Maura Linton, A Robust Domain Adaptation Method Based on Class-Level Alignment and Gradient Penalty , Journal of Computer Technology and Software: Vol. 4 No. 5 (2025)
- Femi Ayeola, AI-Driven Anomaly Detection for Industrial Data , Journal of Computer Technology and Software: Vol. 5 No. 1 (2026)
- Chihui Shao, Multi-Scale Temporal Deep Learning with Transformers for Microservice Backend Anomaly Detection , Journal of Computer Technology and Software: Vol. 3 No. 9 (2024)
- Yuhan Wang, Stock Prediction with Improved Feedforward Neural Networks and Multimodal Fusion , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Shaorui Pi, Intelligent Backend Latency Forecasting with Multi-Scale Convolution and Adaptive Attention Mechanisms , Journal of Computer Technology and Software: Vol. 3 No. 5 (2024)
- Zylaren Cove, Lirien Voska, Enhanced Apple Quality Detection Algorithm Based on Improved YOLOv5 with Coordinate Attention Mechanism , Journal of Computer Technology and Software: Vol. 4 No. 2 (2025)
- Xin Su, Deep Forecasting of Stock Prices via Granularity-Aware Attention Networks , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- John Doe, Enhancing Efficiency and Accuracy in Video Surveillance Systems: A Target Detection Model Utilizing Open Pose Algorithm , Journal of Computer Technology and Software: Vol. 1 No. 1 (2022)
- Yun Yang, Chenfeiyu Wen, Hengguang Cui, Yilin Sun, Yibo Liu, Learning Unified Multi-Granularity Representations for Backend Anomaly Detection and Causal Localization , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
You may also start an advanced similarity search for this article.
