DailyRNG

Local LLMs

Local LLMs

Every lesson in order, step by step. No difficulty tiers. Just follow the arrows.

9 lessons, about 13 min of reading

1

What is a local LLM? →

Step 1 · Basic

2

Getting started with Ollama →

Step 2 · Basic

3

What is a GGUF model file →

Step 3 · Basic

4

Quantization: smaller models, less memory →

Step 4 · Advanced

5

Adding knowledge with RAG →

Step 5 · Advanced

6

Finetuning a local model →

Step 6 · Advanced

7

Choosing hardware for local models →

Step 7 · Master

8

Optimising speed and memory →

Step 8 · Master

9

Deploying a private model safely →

Step 9 · Master