Ronen discusses how basic reasoning in language models involves applying logic and grammar rules to generate text. By analyzing examples, he illustrates how models like GPT-2 xl can make informed predictions based on contextual cues and basic elimination techniques.