Vibeleaderboard
← All Intel
Intel / article

Gpu Passthrough Macos Vms

Source
cua.ai
Author
Cua editorial sitemap
Date

Context

Cua reports that changing the graphics capabilities advertised inside a macOS virtual machine made one language-model workload substantially faster. Its compatibility layer changes what the graphics interface tells the application it supports, allowing llama.cpp to select faster GPU routines. In the reported M1 Ultra experiment, TinyLlama processed prompts 11.08 times faster and generated output 16.36 times faster than in the same unmodified VM.

Those figures are medians from ten samples. Output generation still reached only about 72% of the host computer's speed. The technique uses the existing virtual GPU connection and depends on private, version-sensitive behavior, so the result applies to the tested hardware, software and workload.

More from Cua editorial sitemap
Recommended reads
Comments

Checking sign-in…

Loading comments…