Tiny Language Models Thrive With GPT-4 as a Teacher | Quanta Magazine

Tiny Language Models Thrive With GPT-4 as a Teacher | Quanta Magazine

Machine learning researchers have embraced this lesson. GPT-3.5, the large language model that powers the ChatGPT interface, has nearly 200 billion …