When ChatGPT Broke an Entire Field: An Oral History
a year ago
- #AI
- #NLP
- #LLMs
- Natural language processing (NLP) has undergone significant changes, especially with the emergence of large language models (LLMs).
- The introduction of the transformer model in 2017 marked a turning point, though its impact wasn't immediately recognized.
- BERT and GPT models shattered performance records, leading to a 'benchmark boom' and debates about their capabilities.
- The release of GPT-3 in 2020 was a pivotal moment, showcasing the potential of LLMs and causing existential crises among researchers.
- ChatGPT's launch in 2022 disrupted the field, making many traditional NLP research areas obsolete and shifting focus to LLM applications.
- The field has seen divisions over the ethical and practical implications of LLMs, with debates around understanding, scale, and corporate influence.
- Researchers are now grappling with the societal impact of LLMs, their limitations, and the future direction of NLP and AI.