RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Anzhuo Xie, Deep Representation Learning for Risk Prediction in Electronic Health Records Using Self-Supervised Methods , Journal of Computer Technology and Software: Vol. 5 No. 7 (2026)
- Yuchen Liu, AI-Driven Performance Degradation Identification via Self-Supervised Spatiotemporal Graph Modeling in Microservice Systems , Journal of Computer Technology and Software: Vol. 5 No. 4 (2026)
- Netra Awate, Ziang Chen, Research on Multi-scale Dynamic Evolution Time Series Modeling Methods for Predicting Backend System Load Change Trends , Journal of Computer Technology and Software: Vol. 4 No. 10 (2025)
- Ananya Patel, Modernizing Field Surveying: The Role and Impact of GNSS-RTK Technology in Digital Mapping , Journal of Computer Technology and Software: Vol. 3 No. 1 (2024)
- Dan Li, Muzi Li, Abu Kowshir Bitto, Exploring Artificial Intelligence-driven Image Recognition Technology , Journal of Computer Technology and Software: Vol. 3 No. 1 (2024)
- Wilson Martinez, Brown Williams, Image Super-Resolution Using Gradient Guidance and Generative Adversarial Networks , Journal of Computer Technology and Software: Vol. 3 No. 2 (2024)
- Maverick Asher, Improving Crude Oil Price Prediction with CEEMDAN-Hilbert Transform and LSTM Models , Journal of Computer Technology and Software: Vol. 2 No. 1 (2023)
- Lysander Cole, Improving Medical Diagnosis with Artificial Intelligence: Naive Bayesian Classification Algorithms , Journal of Computer Technology and Software: Vol. 2 No. 3 (2023)
- Arden Wilder, Enhancing Data Visualization Analysis with Artificial Intelligence , Journal of Computer Technology and Software: Vol. 2 No. 3 (2023)
- Robert Miller, Integrating Natural Language Processing for Sophisticated Semantic Parsing and Context Management in Dialogue Systems , Journal of Computer Technology and Software: Vol. 3 No. 4 (2024)
You may also start an advanced similarity search for this article.
