Instruction Alignment and Risk Calibration in Large Language Models for Safe Human-AI Interaction
- Authors
-
-
Linnea Forsberg
-
- Abstract
-
Large language models (LLMs) have shown remarkable proficiency in performing complex language tasks across diverse domains. However, their widespread deployment in real-world settings is constrained by safety concerns, including hallucinations, inappropriate advice, and misalignment with user intent. In this paper, we propose a unified framework for instruction alignment and risk calibration that enhances the safety and controllability of LLM outputs. The framework integrates three core components: risk-conditioned instruction tuning, real-time risk-aware response calibration, and reinforcement learning with a composite reward based on both human preferences and automated risk estimations. Experimental results across healthcare, finance, legal, and general dialogue tasks demonstrate that our model significantly improves helpfulness and calibrated refusal accuracy compared to instruction-tuned and RLHF baselines. Furthermore, case studies confirm its robustness in high-stakes applications, with better content moderation and user trust. The proposed approach provides a scalable and modular solution for building LLMs that are not only capable and coherent, but also responsible and safe in deployment.
- References
- Downloads
- Published
- 2025-06-30
- Issue
- Vol. 4 No. 6 (2025)
- Section
- Articles
- License
-

This work is licensed under a Creative Commons Attribution 4.0 International License.
Academic Scholar Hub Press also operates under the Creative Commons Licence CC-BY 4.0. This allows for copy and redistribute the material in any medium or format for any purpose, even commercially. The premise is that you must provide appropriate citation information.
How to Cite
Most read articles by the same author(s)
- Linnea Forsberg, Callum Whitmore, A Modular Framework for Robust Multimodal Representation Learning via Dynamic Modality Weighting , Journal of Computer Technology and Software: Vol. 4 No. 6 (2025)
