AI Hardware Agnosticism

Pytorch 2.0 is designed to be hardware agnostic, allowing seamless operation across various platforms, including AMD. Custom chips are anticipated for high-volume applications, while diverse AI engines will cater to different needs, from large GPUs for training to specialized ASICs for narrow applications. The future of AI programming lies in higher-level frameworks that simplify integration for cloud services.