Existing defense techniques struggle significantly against novel attack vectors, often achieving near 0% accuracy under certain conditions. The introduction of the unforeseen attack robustness (UAR) metric aims to encourage researchers to evaluate defenses more comprehensively, pushing for a deeper understanding of how well these defenses can generalize against various adversarial attacks. The hope is that this will foster a more robust approach to defending against evolving threats in the field.
