Futurology

2588 readers

32 users here now

founded 2 years ago

MODERATORS

Hugging Face is open-sourcing the improved reasoning ability of OpenAI’s o1 model, that the latter expects to make money off. (huggingface.co)

submitted 5 months ago by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 4 points 5 months ago (1 children)

Do these open source models have access to the same volume of training data that the commercial models have?

[–] [email protected] 2 points 5 months ago* (last edited 5 months ago)

Paradoxically their approach is to use less training data. HF are saying they have reverse engineered some of the capabilities of OpenAI’s o1 model, by using an approach called 'Test-time compute scaling' which OpenAI have acknowledged using, but not disclosed exactly how.

https://the-decoder.com/study-shows-test-time-compute-scaling-is-a-path-to-better-ai-systems/