Local LLM Clients or Models

Chat Applications There are a number of applications that can be installed locally on your computer that offer a ChatGPT- or Notebook LM-inspired interface. Some also allow you to create your own local knowledge database using Retrieveal-augmentated Generation (RAG). A RAG typically allows you to “chat with your documents”. DTU have no explicit licenses to these tool and have not evaluated their risks and potential applicability. Some tools allow you to run the entire LLM model offline, i.e. on your own computer (provided you have enough memory and enough compute power and memory for practical use). Note, however, that if the application uses an external online LLM model through it’s application programming interface (API), some of your data will leave your computer and be sent to the LLM model for processing. ...

Notebook LM

Notebook LM is Google’s Note-taking and Reseach Assistant tool based on the Gemini 2.0 platform (as of the time of writing, pi-day (March 14th) 2025). DTU have no licenses to the tool and have not evaluated it’s risk and potential applicability. Some other services, like ChatGPT, Copilot or Le Chat are general tools that have been trained on vast amounts of data, and therefore embed a lot of general knowledge, although they may additionally be able to search for, and include, more recent information from “the internet” in the replies. ...