how does ChatGPT work?
ChatGPT breaks your text into small pieces called tokens, then predicts the next token one at a time based on patterns it learned from a huge amount of training text — autocomplete on steroids, not a system that reasons the way a person does.
Includes a live tokenizer demo — type anything, watch it get chopped into pieces.