"What Is ChatGPT Doing … and Why Does It Work?—Stephen Wolfram Writings” by Stephen Wolfram, 2023

This reading is important to begin to understand how LLMs and ChatGPT work. The LLM underlying ChatGPT is simply generating text by repeatedly predicting the next token, given a history of tokens. What types of text do you think would be challenging to generate well in this way?

This book, and all H2O books, are Creative Commons licensed for sharing and re-use with the exception of certain excerpts. Any excerpts from the Restatements of the Law, Principles of the Law, and the Model Penal Code are copyright by The American Law Institute. Excerpts are reproduced with permission, not as part of a Creative Commons license.