A.I Compiler Technologies

Interesting information about A.I Compilers

SHARK: The fastest PyTorch runtime – 3x over Torchscript, 1.6x over TF/XLA, 76% faster than ONNXRuntime

SHARK Introducing SHARK – A high performance PyTorch Runtime that is 3X faster than the PyTorch/Torchscript , 1.6X faster than Tensorflow+XLA and 76% faster than ONNXRuntime on the Nvidia A100.  All of this is available to deploy seamlessly in minutes. Whether you are using Docker, Kubernetes or plain old `pip […]

Read More

torch-mlir: Bridging PyTorch and LLVM/MLIR ecosystems

We presented the torch-mlir project today at the LLVM/MLIR Open Design Meeting with more than 125 attendees from the industry. This is an important piece of the next generation A.I Software stack to bridge the ubiquity of the PyTorch eco-system to the LLVM/MLIR ecosystem and unlock building performant, reusable and […]

Read More