Discussion about this post

User's avatar
JP's avatar

The inference shift you're flagging is the thing I keep coming back to. Training was always going to be Nvidia's stronghold; inference is where the competitive pressure actually opens up. What I find interesting is that Nvidia isn't sitting still on it either: the Grace CPU-only deployments at Meta suggest they're trying to own the full server stack, not just the GPU tile. Wrote about that angle recently: https://reading.sh/the-gpu-king-is-coming-for-intels-crown-64f2a8421bd7

No posts

Ready for more?