RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Sanjay Patel, Enhancing Image Super-Resolution with Deep Gradient Guidance and Multi-Scale Residual Blocks in a GAN Framework , Journal of Computer Technology and Software: Vol. 1 No. 3 (2022)
- Lysander Vale, Archer Lee, Advancing Medical Diagnosis: Enhancing Sentiment Analysis in Electronic Medical Records with Transformer Models , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Yun Zi, Time-Series Load Prediction for Cloud Resource Allocation Using Recurrent Neural Networks , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Yunfei Nie, Corporate Cash Flow Forecasting Based on Counterfactual Time Series and Strategy Simulation , Journal of Computer Technology and Software: Vol. 3 No. 1 (2024)
- Zephyrus Callen, Corwin Thayer, Auden Merrick, Enhancing Financial Credit Assessment Accuracy with Deep Learning: A Multi-Layer Perceptron Approach , Journal of Computer Technology and Software: Vol. 4 No. 3 (2025)
- Zhihao Xue, Graph Learning Framework for Precise Anomaly Localization in Distributed Microservice Environments , Journal of Computer Technology and Software: Vol. 3 No. 4 (2024)
- Maelle Trenton, A Comprehensive Survey on Multilingual and Multimodal Automatic Speech Recognition Systems , Journal of Computer Technology and Software: Vol. 4 No. 10 (2025)
- Eldon Vierre, Integrating Graph Neural Networks and Transformer Models for Financial Risk Assessment in Dynamic Markets , Journal of Computer Technology and Software: Vol. 4 No. 10 (2025)
- Linnea Carrow, Torin Belgrave, Neuro-Symbolic Synergy for Deep Adaptive Intelligence: A Hierarchical Framework for Explainability and Reasoning , Journal of Computer Technology and Software: Vol. 4 No. 10 (2025)
- Tiarnan Keenan, Design of an Indoor Navigation Robot Based on ROS , Journal of Computer Technology and Software: Vol. 4 No. 11 (2025)
You may also start an advanced similarity search for this article.
