Vibeleaderboard
← All Intel
Intel / article

Convolutional Multi Hybrids For Edge Devices

Source
liquid.ai
Author
Liquid AI
Date

Context

Liquid AI designed Hyena Edge around the hardware it would run on. Its architecture search used measurements from a Samsung S24 Ultra phone to weigh response speed and memory use alongside language-model quality. The resulting model replaced two-thirds of a comparison ’s operations with gated convolutions, an alternative way to process the text sequence. In reported tests, both models had matched parameter counts and trained on the same amount of text. Hyena Edge used less memory across tested sequence lengths and generated text faster for sequences longer than 256 . The result supports designing models around a target device; it does not establish the same advantage on every phone.

Terms in this piece · Glossary
  • transformer — The neural network architecture behind modern AI models, built on attention — letting every word directly consider every other word in parallel.
  • attention — The mechanism that lets a model weigh which earlier words matter for the word it's currently processing — the core operation of a transformer.
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Read the source www.liquid.ai
More from Liquid AI
Recommended reads
Comments

Checking sign-in…

Loading comments…