This Gavranovic et al. wrote something extremely meaningful on how categorical deep learning is an algebraic theory of all architectures. It's a good read and I am agreeing with them. They leaned toward geometric deep learning and architecture implementations that have plenty of jargons I'm still getting used to, but yeah. It's an easy read and I hope you give it a go.