Amazon is taking its biggest shot at Nvidia yet with new TorchNeuron dev tool

Amazon Web Services released TorchNeuron, a tool that allows AI startups to run PyTorch-based applications on Amazon's Trainium chips by changing just one line of configuration, with no code rewrite. Since roughly 85% of AI apps are built with PyTorch, and Nvidia's CUDA software has long been deeply embedded in that ecosystem by default, the move represents Amazon's most direct challenge yet to Nvidia's software advantage. Amazon argues that porting to Trainium is not only easy but also gives startups access to AWS's full cloud infrastructure, making it a better choice than Nvidia-tied neoclouds like Coreweave, Nebius, and Firmus. AWS VP Colin Brace emphasized that Trainium offers both training and inference on one platform, improving economics across full workloads, and cited Deepgram as a customer processing 70% more audio per dollar. Beyond its own hardware, Amazon is contributing upstream changes to PyTorch to remove code tying the framework to specific chips, aiming to make it more hardware-agnostic. While this could give developers more choice and affordable options, it remains to be seen whether it reduces configuration headaches or simply shifts them. If Amazon succeeds in decoupling PyTorch from Nvidia, it could have far bigger ramifications for the GPU giant than chip competition alone.

(Source：TechCrunch)