Johann discusses the intricacies of real-world neural networks and the challenges of extracting computation graphs. He also introduces a novel approach to batch Bayesian optimization for optimizing permutations, emphasizing its efficiency in parallel evaluations. The conversation touches on the emerging field of equivariant deep learning, highlighting recent advancements at neurips.
