Speaker
Description
Until recently, self-hosting a large language model (LLM) required knowledge of the command-line and the setting up of special environments in order to install the AI systems. All this changed with the release of the Ollama app. The Ollama application can be installed to Windows or Mac machines in the same way as any other application. Thereafter, LLMs can be downloaded for use locally on the machine (free, no internet required), or used to connect with and use more powerful models hosted on ollama.com. The most difficult part is choosing which LLM to run out of the many that are freely available. This poster will guide participants through the application's installation, and then what to consider when selecting which LLM to run given the hardware and intended objectives of installing the LLM. Additional information regarding model creation will also be available. Participants are encouraged to bring their laptops along and try out installing their own LLM during the presentation. After all, it's easy!
| Presentation location | In person (Kumamoto) |
|---|