Well, since llms need matterial for self-education, someone still had to be inteligent enough. Or llms will freeze their “intelect” at some point.
Why would it freeze if they can create more training material. Its already been shown synthetic training data is just as good if not better.
> Its already been shown synthetic training data is just as good if not better.Source, please! I'm a machine learning layperson but how can this not be overfitting?
hyperionultra · · focus · HN ↗
BenzeneDream · · focus · HN ↗
timcobb · · focus · HN ↗
Source, please! I'm a machine learning layperson but how can this not be overfitting?
aaron695 · · focus · HN ↗
[dead]