Local LLM Clients or Models
Chat Applications There are a number of applications that can be installed locally on your computer that offer a ChatGPT- or Notebook LM-inspired interface. Some also allow you to create your own local knowledge database using Retrieveal-augmentated Generation (RAG). A RAG typically allows you to “chat with your documents”. DTU have no explicit licenses to these tool and have not evaluated their risks and potential applicability. Some tools allow you to run the entire LLM model offline, i.e. on your own computer (provided you have enough memory and enough compute power and memory for practical use). Note, however, that if the application uses an external online LLM model through it’s application programming interface (API), some of your data will leave your computer and be sent to the LLM model for processing. ...