Perception-Guided Structural Framework for Large Language Model Design
- Authors
-
-
Fan Guo
-
Lin Zhu
-
Yichen Wang
-
Guohui Cai
-
- Abstract
-
This paper proposes a structural optimization method for large language models based on a perception-representation integration mechanism. The goal is to enhance semantic construction and contextual consistency under complex language scenarios. The method introduces perceptual feature extraction modules and perception-guided attention mechanisms. This enables dynamic semantic modeling of language input and multi-level structural-perception interaction. It addresses the disconnect between representation and structure in traditional language models. In implementation, the method integrates a perception-driven representation update strategy into the GPT architecture. It constructs a perception graph to regulate attention distribution. This design improves the model's structural expressiveness. Experiments on the WikiText-103 dataset show that the proposed method outperforms mainstream language models in key metrics, including Perplexity, BLEU, and Semantic Consistency. Additionally, a series of hyperparameter sensitivity experiments and comparative analyses of perception injection strategies are conducted. These evaluate the impact of structural components on model performance. The results confirm the stability and effectiveness of the proposed mechanism under different training configurations.
- References
- Downloads
- Published
- 2025-05-30
- Issue
- Vol. 4 No. 5 (2025)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Most read articles by the same author(s)
- Yichen Wang, Structured Compression of Large Language Models with Sensitivity-aware Pruning Mechanisms , Journal of Computer Technology and Software: Vol. 3 No. 9 (2024)
- Lin Zhu, Fan Guo, Guohui Cai, Yumeng Ma, Structured Preference Modeling for Reinforcement Learning-Based Fine-Tuning of Large Models , Journal of Computer Technology and Software: Vol. 4 No. 4 (2025)
