Pablo discusses the innovative approach of using two transformer models to generate lyrics with specific rhyming structures. The first model focuses on parts of speech and syllable counts, while the second enriches the output with diverse vocabulary. They are currently exploring methods to enhance the rhyming capabilities beyond simply repeating words, aiming for more creative and varied lyrical compositions.
