Running AI inference directly on client machines reduces latency, improves privacy by keeping all data on the client, and saves server costs. To accelerate these workloads, WebAssembly and WebGPU are evolving to incorporate new low-level primitives. Learn how these new additions unlock fast hardware capabilities to significantly speed up AI inference and enable highly tuned inference libraries and frameworks to efficiently run large AI models.
Speakers: Deepti Gandluri, Austin Eng
Watch more:
Check out all the Web videos at Google I/O 2024 → https://goo.gle/io24-web-yt
Check out all the AI videos at Google I/O 2024 → https://goo.gle/io24-ai-yt
Subscribe to Google Chrome Developers → https://goo.gle/ChromeDevs
#GoogleIO
Event: Google I/O 2024