this post was submitted on 09 Jun 2024
6 points (75.0% liked)

Machine Learning

1998 readers
1 users here now

founded 5 years ago
MODERATORS
 

Imagine AI giving offsprings...

top 5 comments
sorted by: hot top controversial new old
[–] [email protected] 7 points 1 year ago

Not directly no.

It may be able to code one (the code is relatively short and well known) and give training program, and then you would need to spend a few trillion tokens to make it generate data.

[–] [email protected] 5 points 1 year ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

[–] [email protected] 2 points 1 year ago

Yep, this is called model distillation.

[–] [email protected] 3 points 1 year ago (1 children)

Don't give them any ideas.. 😂

[–] wargreymon 0 points 1 year ago