OpenAI CEO Expresses Fondness for GPT-2
OpenAI CEO Sam Altman has expressed his affection for the GPT-2 language model, despite his previous criticism of all models before GPT-5, which is yet to launch.
In a recent post on X, formerly Twitter, Altman confessed his fondness for GPT-2, saying, "I do have a soft spot for GPT2." This statement stands in contrast to his earlier comments in an interview with the Korean publication Maeil Business Newspaper, where he described GPT-2, GPT-3, and GPT-4 as "very bad," "pretty bad," and "pretty bad," respectively.
A History of Improvement
GPT-1 (June 2018): This model comprised 117 million parameters and established the groundwork for ChatGPT. It demonstrated the effectiveness of unsupervised learning in comprehending language.
This model boasted 1.5 billion parameters and displayed remarkable progress in text generation. However, concerns about its potential misuse led to its delayed public release.
This model, trained on 175 billion parameters, revolutionized text generation with its sophisticated capabilities. It found applications in drafting emails, composing articles, crafting poetry, and even generating programming code.
Currently available only for ChatGPT Plus subscribers, this model features new image- and text-understanding capabilities, lower likelihood of dangerous output, and the ability to follow users' intentions and search the internet in real-time.
This upcoming model is poised to offer a substantial improvement over GPT-4, with select enterprise clients already receiving previews of its features. CEO Altman described it as "really good, like materially better."
Conclusion
OpenAI's GPT models have come a long way since their inception, with each iteration offering significant improvements in capabilities and performance. While Altman's initial criticism of earlier models may seem harsh, it highlights the company's commitment to continuous improvement and its pursuit of truly exceptional language models. The upcoming GPT-5 promises to be a significant leap forward, further solidifying OpenAI's position as a leader in the field of artificial intelligence.