RT-DETR-Based Multimodal Detection with Modality Attention and Feature Alignment
- Authors
-
-
Yujia Lou
-
- Keywords:
- Array
- Abstract
-
Infrared-visible fusion object detection plays a vital role in visual perception under complex environments. However, existing methods still face challenges in feature alignment, modality complementarity, and detection accuracy. To address these issues, this paper proposes a multimodal object detection method based on an improved RT-DETR. A dual-branch feature extraction network is designed to process infrared and visible images separately, and a modality attention mechanism is introduced to enhance cross-modal information interaction. In addition, a feature alignment loss is employed to optimize the fusion process and improve the model's adaptability to different modalities. Experimental results show that the proposed method achieves superior performance on multiple benchmark datasets. Compared to traditional single-modal approaches, the improved RT-DETR shows higher mAP@50 and mAP@95 scores and demonstrates greater robustness under challenging lighting conditions. Compared with existing multimodal detection methods, the proposed model maintains high detection accuracy while improving class discrimination and reducing false positives and missed detections, validating its effectiveness in multimodal visual perception tasks.
- References
- Downloads
- Published
- 2024-08-30
- Issue
- Vol. 3 No. 5 (2024)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Similar Articles
- Danyi Gao, Deep Graph Modeling for Performance Risk Detection in Structured Data Queries , Journal of Computer Technology and Software: Vol. 4 No. 5 (2025)
- Arjun Venkatesh, Multimodal Representation Learning for Robust Clinical Risk Prediction from Heterogeneous Electronic Health Records , Journal of Computer Technology and Software: Vol. 4 No. 10 (2025)
- Zhengyi Liu, Zili Zhang, Graph-Based Discovery of Implicit Corporate Relationships Using Heterogeneous Network Learning , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Fatih Demir, Enhanced Deep Learning Framework for Steel Surface Defect Detection under Class Imbalance , Journal of Computer Technology and Software: Vol. 5 No. 1 (2026)
- John Wilson, Alvin York, Enhancing Road Traffic Surveillance: Deep Learning Techniques for Vehicle Detection and Tracking , Journal of Computer Technology and Software: Vol. 3 No. 1 (2024)
- Ruibing Shi, Dhritiman Vaikuntan, Recent Advances in Flame Detection Using Convolutional Neural Networks: A Review , Journal of Computer Technology and Software: Vol. 4 No. 1 (2025)
- Michael Thompson, Data Fusion Techniques for Enhanced UAV Near-Ground Distance Measurement Using Point and Surface Sensors , Journal of Computer Technology and Software: Vol. 1 No. 1 (2022)
- Kang Yang, Zirui Liu, Distributed Data Anomaly Detection Algorithm Integrating Federated Learning and Dynamic Representation Alignment Mechanism , Journal of Computer Technology and Software: Vol. 4 No. 5 (2025)
- Yihan Xue, State-Space Temporal Modeling and Feature Representation Learning for Anomaly Detection in Backend Microservice Systems , Journal of Computer Technology and Software: Vol. 3 No. 8 (2024)
- Shirui Zhang, Secure Parameter Aggregation and Distributed Anomaly Detection in Cross-Cloud Data Center Networks , Journal of Computer Technology and Software: Vol. 3 No. 4 (2024)
You may also start an advanced similarity search for this article.
