Participants in Runway's video study identified real and generated clips correctly 57.1% of the time overall. Each of 1,043 participants classified 20 five-second clips, evenly split between real footage and generated video. The generated clips came from Runway's own Gen-4.5 model, each made from the first frame of the corresponding real footage with one generation attempt per clip. Only 99 participants reached at least 15 correct answers, the study's threshold for performance statistically above chance. The headline about more than 90% of viewers concerns that threshold; the overall accuracy figure shows how close judgments were to guessing in this particular test. Results and methodology
