Building Large Language Models

AI
LLM
programming

Examples

TI-84 GPT4All and Youtube


Libraries

Run a variety of LLMs locally using Ollama

Oolama main site

Ollama models supported

Collecting Data

Scripts to convert Libgen to txt (see also Explaining LLMs)

Technical Details

from my question to Metaphor.systems

https://jalammar.github.io/illustrated-transformer/ https://huggingface.co/

Google’s free BERT model, a small-sized model for language

OpenAI Cookbook a Github repo of examples of using the OpenAI API.

GPT in 60 lines of NumPy via HN