Vibeleaderboard
← All Intel
Intel / article

Language Models for Text Classification: From Bag-of-Words to Jev

Source
magazine.sebastianraschka.com
Author
Sebastian Raschka, PhD
Date

Context

Jev lets users describe a text-classification task and its possible answers without training a separate model for that task. In Sebastian Raschka's hands-on evaluation, TypeSafe AI's model received movie reviews with descriptions of positive and negative sentiment. Its Choice interface achieved 96.47% accuracy on 25,000 test reviews at a reported API cost of about $0.65. That is a concrete example of ready-made classification, although Raschka could not establish whether those reviews had appeared in training. His proposed explanations of Jev's architecture remain educated guesses.

Terms in this piece · Glossary
  • eval — A repeatable test for AI quality — a set of tasks plus scoring — used the way software teams use test suites, because model output is too variable to judge by eyeballing.
Read the source magazine.sebastianraschka.com
More from Sebastian Raschka, PhD
Recommended reads
Comments

Checking sign-in…

Loading comments…