- The Curse of Recursion: Training on Generated Data Makes Models Forget. "What will happen to GPT-{n} once LLMs contribute much of the language found online? We find that use of model-generated content in training causes irreversible defects in the resulting models" [abstract + link to PDF, 18pp] https://arxiv.org/abs/2305.17493v2 27 comments compsci
Linking pages
- AI feedback loop will spell death for future generative models | TechSpot https://www.techspot.com/news/99064-ai-feedback-loop-spell-death-future-generative-models.html 155 comments
- AI-Generated Data Can Poison Future AI Models | Scientific American https://www.scientificamerican.com/article/ai-generated-data-can-poison-future-ai-models/ 88 comments
- Is artificial intelligence a threat to journalism or will the technology destroy itself? | Samantha Floreani | The Guardian https://www.theguardian.com/commentisfree/2023/aug/05/is-mutant-news-headed-our-way-or-will-ai-chatbots-eat-their-own-tails 9 comments
Would you like to stay up to date with Computer science? Checkout Computer science
Weekly.
Related searches:
Search whole site: site:arxiv.org
Search title: [2305.17493v2] The Curse of Recursion: Training on Generated Data Makes Models Forget
See how to search.