Perception-Guided Structural Framework for Large Language Model Design

Authors
  • Fan Guo

  • Lin Zhu

  • Yichen Wang

  • Guohui Cai

Abstract

This paper proposes a structural optimization method for large language models based on a perception-representation integration mechanism. The goal is to enhance semantic construction and contextual consistency under complex language scenarios. The method introduces perceptual feature extraction modules and perception-guided attention mechanisms. This enables dynamic semantic modeling of language input and multi-level structural-perception interaction. It addresses the disconnect between representation and structure in traditional language models. In implementation, the method integrates a perception-driven representation update strategy into the GPT architecture. It constructs a perception graph to regulate attention distribution. This design improves the model's structural expressiveness. Experiments on the WikiText-103 dataset show that the proposed method outperforms mainstream language models in key metrics, including Perplexity, BLEU, and Semantic Consistency. Additionally, a series of hyperparameter sensitivity experiments and comparative analyses of perception injection strategies are conducted. These evaluate the impact of structural components on model performance. The results confirm the stability and effectiveness of the proposed mechanism under different training configurations.

References
Cover Image
Downloads
Published
2025-05-30
Section
Articles
License
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.

How to Cite

Guo, F., Zhu, L., Wang, Y., & Cai, G. (2025). Perception-Guided Structural Framework for Large Language Model Design. Journal of Computer Technology and Software, 4(5). https://doi.org/10.5281/zenodo.15580063

Most read articles by the same author(s)