Analysis of the Effectiveness of Large Language Models in Industrial Knowledge Management: A Systematic Literature Review

Penulis

  • Jeronimo Malaquias Department of Information System, Universidad Internacional Isabel I de Castilla, Burgos, Spain

Kata Kunci:

Large Language Models, Knowledge Management, Artificial Intelligence, Industrial Innovation, Organizational Learning

Abstrak

The increasing adoption of Large Language Models (LLMs) has transformed the way organizations manage, access, and utilize knowledge in industrial environments. As industries continue to generate vast amounts of information, LLMs have emerged as powerful tools for enhancing knowledge management processes through advanced natural language understanding, information retrieval, and intelligent decision support capabilities. This study aims to analyze the effectiveness of LLMs in supporting industrial knowledge management and to evaluate their contributions, benefits, and challenges across organizational contexts. A Systematic Literature Review (SLR) approach was employed to examine relevant studies published between 2020 and 2026, with data collected from major scientific databases, including Scopus, Web of Science, IEEE Xplore, and ScienceDirect. The selected literature was analyzed using thematic, content, and comparative analysis techniques to identify patterns, applications, and implementation outcomes. The findings indicate that LLMs significantly enhance knowledge creation through automated report generation, technical documentation support, and lessons-learned extraction. Furthermore, LLM adoption contributes to increased organizational productivity by reducing information search time, supporting decision-making, and improving employee access to critical knowledge resources. However, several challenges remain, including hallucination, data inconsistency, model bias, integration complexity, security and privacy concerns, and issues related to transparency, accountability, and explainability. To maximize their benefits, organizations should implement robust AI governance frameworks, adopt secure knowledge retrieval architectures, and invest in employee AI literacy and training programs. Future research should focus on real-world industrial evaluations, comparative analyses of LLM platforms, and long-term assessments of organizational impacts.

Referensi

Adinath, D. R., & IS, S. (2025). From Competition to Collaboration: Integrating 2025’s Leading LLMs-ChatGPT, Claude, Gemini, Perplexity, Grok, and DeepSeek-Through a Sequential Multi-Model Workflow Framework (S-MMWF). Claude, Gemini, Perplexity, Grok, and DeepSeek-Through a Sequential Multi-Model Workflow Framework (S-MMWF)(November 12, 2025).

Amin, M., Rezaei, S., & Abolghasemi, M. (2014). User satisfaction with mobile websites: the impact of perceived usefulness (PU), perceived ease of use (PEOU) and trust. Nankai Business Review International, 5(3), 258–274.

Aujirapongpan, S., Vadhanasindhu, P., Chandrachai, A., & Cooparat, P. (2010). Indicators of knowledge management capability for KM effectiveness. Vine, 40(2), 183–203.

Balaganski, A. (2015). API Security Management. KuppingerCole Report, 70958, 20–27.

Bouncken, R. B., Ratzmann, M., & Kraus, S. (2021). Anti-aging: How innovation is shaped by firm age and mutual knowledge creation in an alliance. Journal of Business Research, 137, 422–429.

Chen, P.-T., & Kuo, S.-C. (2017). Innovation resistance and strategic implications of enterprise social media websites in Taiwan through knowledge sharing perspective. Technological Forecasting and Social Change, 118, 55–69.

Glanville, J., Kendrick, T., McNally, R., Campbell, J., & Hobbs, F. D. R. (2011). Research output on primary care in Australia, Canada, Germany, the Netherlands, the United Kingdom, and the United States: bibliometric analysis. BMj, 342.

Hackos, J. T. (2007). Information development: Managing your documentation projects, portfolio, and people. John Wiley & Sons.

Knafl, K. A., Webster, D. C., Benoliel, J. Q., & Morse, J. M. (1988). Managing and analyzing qualitative data: A description of tasks, techniques, and materials. Western Journal of Nursing Research, 10(2), 195–218.

Kringos, D. S., Boerma, W. G. W., Hutchinson, A., Van der Zee, J., & Groenewegen, P. P. (2010). The breadth of primary care: a systematic literature review of its core dimensions. BMC Health Services Research, 10(1), 65.

Ma, Y., Dong, M., Zhou, K., Mita, C., Liu, J., & Wayne, P. M. (2016). Publication trends in acupuncture research: a 20-year bibliometric analysis based on PubMed. PloS One, 11(12), e0168123.

Moenks, N., Penava, P., & Buettner, R. (2025). A Systematic Literature Review of Large Language Model Applications in Industry. IEEE Access.

Montoya, F. G., Alcayde, A., Baños, R., & Manzano-Agugliaro, F. (2018). A fast method for identifying worldwide scientific collaborations using the Scopus database. Telematics and Informatics, 35(1), 168–185.

Ojokoh, B., & Adebisi, E. (2018). A review of question answering systems. Journal of Web Engineering, 17(8), 717–758.

Olan, F., Arakpogun, E. O., Suklan, J., Nakpodia, F., Damij, N., & Jayawickrama, U. (2022). Artificial intelligence and knowledge sharing: Contributing factors to organizational performance. Journal of Business Research, 145, 605–615.

Pius, F., & Wurster, P. (2026). Knowledge Management in Manufacturing: Current Practices, Barriers, and Automation Potential for LLM-Supported Systems. Computers, 15(5), 305.

Sanfilippo, F., Tigano, S., Palumbo, G. J., Astuto, M., & Murabito, P. (2020). Importance of inclusion criteria in systematic reviews. British Journal of Anaesthesia, 125(5), e398–e399.

Schmitt, U. (2020). Designing decentralized knowledge management systems to effectuate individual and collective generative capacities. Kybernetes, 49(1), 22–46.

Serrado, C. H., Xexéo, G., Barbosa, C. E., Argôlo, M., Nóbrega, L., Martinez, L. F., & de Souza, J. (2025). Accelerating Knowledge Acquisition with Help from Large Language Models: From Digital Documents to Database Models. Proceedings of the 25th European Conference on Knowledge Management (2 Vols).

Singh, H. (2021). AI-Powered Chatbots Transforming Customer Support through Personalized and Automated Interactions. Available at SSRN 5267858.

Teevan, J., Collins-Thompson, K., White, R. W., Dumais, S. T., & Kim, Y. (2013). Slow search: Information retrieval without time constraints. Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval, 1–10.

Watson, S., & Hewett, K. (2006). A multi‐theoretical model of knowledge transfer in organizations: Determinants of knowledge contribution and knowledge reuse. Journal of Management Studies, 43(2), 141–173.

Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., & Kasirzadeh, A. (2021). Ethical and social risks of harm from language models. ArXiv Preprint ArXiv:2112.04359.

Yang, J.-T., & Wan, C.-S. (2004). Advancing organizational effectiveness and knowledge management implementation. Tourism Management, 25(5), 593–601.

Zhao, H., Wu, L., Shan, Y., Jin, Z., Sui, Y., Liu, Z., Feng, N., Li, M., & Zhang, W. (2015). A comprehensive survey of large language models in management: Applications, challenges, and opportunities. JOURNAL OF LATEX CLASS FILES, 14(8).

Diterbitkan

2025-10-30

Cara Mengutip

Malaquias, J. (2025). Analysis of the Effectiveness of Large Language Models in Industrial Knowledge Management: A Systematic Literature Review. Jurnal Mekintek : Jurnal Mekanikal, Energi, Industri, Dan Teknologi, 16(2), 75–88. Diambil dari https://www.ejournal.isha.or.id/index.php/Mekintek/article/view/537