RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Wanyu Cui, Ankai Liang, Diffusion-Transformer Framework for Deep Mining of High-Dimensional Sparse Data , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
- Anneliese Wren, Callum Hargreaves, Elodie Farnsworth, High-Concurrency Distributed Task Scheduling with Fault Tolerance and Load Balancing , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
- Xin Su, Predictive Modeling of Volatility Using Generative Time-Aware Diffusion Frameworks , Journal of Computer Technology and Software: Vol. 4 No. 5 (2025)
- Soren Halbrook, Unified AI Framework for Scientific Simulation: Multimodal Modeling and Cross-Domain Transfer , Journal of Computer Technology and Software: Vol. 4 No. 6 (2025)
- Caspian Blythe, Enhancing Financial Sentiment Analysis with BERT and Data Augmentation for Market Impact Prediction , Journal of Computer Technology and Software: Vol. 4 No. 7 (2025)
- Eulalie Merrick, Toward Safe and Scalable Intelligent Transportation Systems: A Survey of AI Methodologies and Deployment Challenges , Journal of Computer Technology and Software: Vol. 4 No. 9 (2025)
- Yue Xing, Enhancing Advertising Recommendation Performance via Integrated Causal Inference and Exposure Bias Correction , Journal of Computer Technology and Software: Vol. 2 No. 3 (2023)
- Dorothea Bradeen, Danyang Tong, Intelligent Task Scheduling Framework for Cloud Platforms Based on Improved Particle Swarm Optimization , Journal of Computer Technology and Software: Vol. 5 No. 1 (2026)
- Théon Valcourt, An IoT-Based Solution for Power Information Acquisition and Remote Monitoring , Journal of Computer Technology and Software: Vol. 5 No. 3 (2026)
- Weican Wang, Jiajia Cheng, Trustworthy LLM-Agent-Oriented Enterprise ETL Orchestration via Neural Execution Verification , Journal of Computer Technology and Software: Vol. 3 No. 4 (2024)
You may also start an advanced similarity search for this article.
