Latest Updates

Unfiled grab bag of interesting content

AI
Published

2024-02-03T07:08:38-08:00

2023 summary from Simon Willison: a good list of resources for how to build your own LLM.

Rodney Brooks AI Scorecard 2024

Strange Loop Canon explains why it’s hard to evaluate LLMs: the same reason it’s hard to make a general-purpose way to Evaluations are all we need

OpenAI History and principles

Check out this “Animate Anyone

AI that animates still images! How to

add custom GPTs to any website in minutes.

Snap’s My AI chatbot is the most widely used AI tool by 7-to 17-year-olds in the UK.

ChatGPT is pretty bad at making predictions, according to dynomight, who compared its predictions to those from the Manifold prediction market.

A good predictor would follow the dotted line

At a high level, this means that GPT-4 is over-confident. When it says something has only a 20% chance of happening, actually happens around 35-40% of the time. When it says something has an 80% chance of happening, it only happens around 60-75% of the time.

2024-01-26 7:08 AM

An informal twitter survey by David Song on the near-term development interests among AI users:

David Song survey results ***

2023-10-29 6:21 AM

Tyler Cowen’s new generative AI book https://econgoat.ai/en/chat

and how it was constructed using LLPhant for chunking for the RAG, with queries passed along to GPT-4.

Sample interaction with Tyler Cowen’s GOAT AI-generated book

SchoolXpress lets you make your own AI-conversational book by uploading your content.

Make your own GPTs with https://chat.openai.com/create

AWS has a Hugging Face Page that includes Amazon Sagemaker integrations with Mistral and more.

Capsule is an app that curates zillions of sources to help find mega-trends blog post

LLMs are fundamentally incapable of inference as proven in The Reversal Curse

Berglund et al. (2023)

AI Plagiarism

PromptPack Chantal Smith explains how to use GPT for knowledge management in Notion (and Notion AI):

He generates a database with pages that include sources and properties (link to the article, along with AI summaries). He has two AI auto-fill properties: a 5-bullet summary and a short 1-2 sentences on why it’s relevant.

References and Todo Followup

The Generalist lengthy summary of AI startups Jul 2023

TheNeuron lists the 27 top AI applications for business

Lamini: a tailored (private) LLM engine

Jay Alammar: The Illustrated GPT-2 (Visualizing Transformer Language Models)

References

Berglund, Lukas, Meg Tong, Max Kaufmann, Mikita Balesni, Asa Cooper Stickland, Tomasz Korbak, and Owain Evans. 2023. “The Reversal Curse: LLMs Trained on "A Is B" Fail to Learn "B Is A".” arXiv. http://arxiv.org/abs/2309.12288.