o1-preview

Score051015202527Size (bn params, log scale)0.5110101001000o1-preview

Score:

0

0.0%

Strict score:

0

0.0%

Family:

o1

Size:

220B parameters

License:

Proprietary

Quant type:

FP

Question

Correct

Strict Correct

Response

RCS4

A

RCS4

A

RCS5

B

SC1

offered to lend her one of her swimsuits.

SC2

He placed his hat where the pawn should be.

SC4

"Our phones are dead," she whispered anxiously.

SC5

She suggested they check the storage building's roof for the missing balls.

RCS4

A

RCS5

E