How to run your first local LLMs
Within the past twelve months (as I am writing this in 2024), large language models (or LLMs) have transformed the professional environment and how we carry tasks out.
- Copied!
Within the past twelve months (as I am writing this in 2024), large language models (or LLMs) have transformed the professional environment and how we carry tasks out.
You certainly are familiar with Chat GPT and their Chat version. You may be a Chat GPT Plus user (OpenAI’s paid plan). Or may have used other similar providers, such as Anthropic, or Google Bard. And you may even be a developer who has used some LLMs via an API (like OpenAI’s API and Python client — I wrote about it before — or using LangChain). All these options are great, they provide ready-to-go access to LLMs and to infrastructure that is able to handle them.
- Copied!