Skip to content

repositories Search Results · repo:google/JetStream language:Python

Filter by

0 files
 (80 ms)

0 files

ingoogle/JetStream (press backspace or delete to remove)

google/JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
gpu
inference
pytorch
transformer
llama
  • Python
  • 167
  • Updated
    14 hours ago
Star
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Package icon

Sponsor open source projects you depend on

Contributors are working behind the scenes to make open source better for everyone—give them the help and recognition they deserve.Explore sponsorable projects
ProTip! 
Press the
/
key to activate the search input again and adjust your query.