Vibeleaderboard
← All Intel
Intel / article

Teaching An Open Model To Do Science

Source
arcee.ai
Author
Arcee AI
Date

Context

An open model can be trained to seek biomedical evidence and leave a checkable record of its work. In a case study written by Loka with Arcee AI and AWS, Arcee's open Trinity Mini model was post-trained with rewards for choosing appropriate tools, retrieving supporting facts and completing a concise synthesis. In the reported experiment, the selected checkpoint's score on 200 held-out Drug Tool tasks rose from 70.8% to 81.2% during training. The team also inspected tool traces and citations, and tested the model inside a working application, before promoting it. These results support better behavior in the specified research workflow; they do not measure successful drug discovery or clinical outcomes.

Terms in this piece · Glossary
  • inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
Read the source www.arcee.ai
More from Arcee AI
Recommended reads
Comments

Checking sign-in…

Loading comments…