Web interfaces for working with large language models

This bachelor’s thesis focuses on free tools for deploying large language models (LLMs) on local hardware. The theoretical section surveys related technologies and presents the foundational theory necessary for creating an understanding of the area. Three main directions were identified: application development, model development, and infrastructure technologies. Relevant publicly available software projects are briefly introduced to provide an overview. In the practical section, selected tools were deployed using the Llama 3 model and their basic functionalities were demonstrated. Additionally, a demonstrative web application was implemented to validate statements with a given internet source. The application is based on an existing validation script which was adapted for the purpose of this paper. The application integrates the deployed LLM tools, illustrating concepts that can be encountered in applications using LLMs. The university’s local infrastructure was utilized. Finally, a brief qualitative comparison of the deployed technologies was conducted, and their most suitable use case was identified.