Diffusion-Transformer Framework for Deep Mining of High-Dimensional Sparse Data
- Authors
-
-
Wanyu Cui
-
Ankai Liang
-
- Abstract
-
This paper addresses the problems of information loss and weakened structural representation in high-dimensional sparse data, particularly in feature expression and semantic modeling. A deep data mining method is proposed, which integrates a diffusion model with a Transformer architecture. Based on the diffusion process, the method performs structural completion and noise suppression through forward perturbation and reverse reconstruction. It also incorporates multi-layer Transformer modules to enhance global dependency modeling and multi-scale semantic extraction. The model forms a unified "generation-enhancement" architecture. It enables effective extraction of discriminative latent representations under conditions of significant feature sparsity. The proposed method is systematically evaluated on the Reuters-21578 text dataset. Results show that it outperforms existing mainstream deep mining models in terms of accuracy, precision, and recall. It also demonstrates strong robustness and stability. Further experiments on sparsity sensitivity and training process visualization confirm the model's capability in feature learning and convergence under high-dimensional sparse settings.
- References
- Downloads
- Published
- 2025-04-30
- Issue
- Vol. 4 No. 4 (2025)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Most read articles by the same author(s)
- Ankai Liang, Enhancing Recommendation Systems with Multi-Modal Transformers in Cross-Domain Scenarios , Journal of Computer Technology and Software: Vol. 3 No. 7 (2024)
- Lipeng Zhu, Wanyu Cui, Yue Xing, Yang Wang, Collaborative Optimization in Federated Recommendation: Integrating User Interests and Differential Privacy , Journal of Computer Technology and Software: Vol. 3 No. 8 (2024)
