As AI applications become increasingly diverse, the scale of deep learning models is also growing rapidly. From language models and visual recognition to generative AI, the compute resources required to