Sachin Kotwani’s Post

Google AI Edge already enables you to deploy several popular LLMs on-device such as Gemma, Phi, Falcon, and StableLM. And now, with the Torch Generative API, you can author custom LLMs using PyTorch. These models can then be seamlessly deployed on mobile and web devices with the TensorFlow Lite (TFLite) runtime. Learn more in this blogpost by Cormac Brick and Haoliang Zhang.

AI Edge Torch Generative API for Custom LLMs on Device

AI Edge Torch Generative API for Custom LLMs on Device

developers.googleblog.com

Oh PyTorch!

To view or add a comment, sign in

Explore topics