RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Rudra Kesavan, Leveraging Artificial Intelligence for Enhanced Diagnostics in Healthcare: A Comprehensive Approach , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Anaya Leelavati, Edith Marlowe, Advances in Artificial Intelligence: A Comprehensive Review of Applications, Challenges, and Future Directions , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Bradyn Turner, Analysis of Aircraft Flight Safety Based on Random Forest Model and Its Broader Applications , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Elias Sorensen, Development of a Virtual Simulation System for Industrial Robot Kinematics Based on Unity 3D , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Elara Vandermeer, Kairav Mahadevan, Disease Prediction Using Electronic Health Records with Long Short-Term Memory Networks , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Ronan Hawke, Multi-Objective Optimization Scheduling of Microgrids Using an Improved Crow Search Algorithm with Levy Flight Strategy , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Jinsong Liu, Multimodal Data-Driven Factor Models for Stock Market Forecasting , Journal of Computer Technology and Software: Vol. 4 No. 2 (2025)
- Drayden Lorne, Elric Maves, Integrating Artificial Intelligence and CFD to Analyze Inlet Parameter Effects in Vortex Pilot Gas Heaters , Journal of Computer Technology and Software: Vol. 4 No. 3 (2025)
- Zhen Xu, Qiuliuyang Bao, Yixian Wang, Hanrui Feng, Junliang Du, Qiuwu Sha, Reinforcement Learning in Finance: QTRAN for Portfolio Optimization , Journal of Computer Technology and Software: Vol. 4 No. 3 (2025)
- Elowen Hartley, Computational Urgency: Real-Time Computing Models and Architectures , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
You may also start an advanced similarity search for this article.
