Data Storage and Reverse Engineering

Sunny Madra and Jason Calacanis discuss the storage of data in language models and the potential for reverse engineering. They explore how data is turned into embeddings and probabilities, and the possibility of proving the origin of words generated by the model. The conversation also touches on OpenAI's handling of tweet history and the potential need to remove certain content.