Released in 2018, GPT-1 demonstrated the potential of unsupervised pre-training for language understanding.