GPT2 Explained!

This video explores the GPT-2 paper "Language Models are Unsupervised Multitask Learners". The paper has this title because their experiments show how massive language models trained on massive datasets can perform tasks like Question Answering and Translation by carefully formatting them as language modeling inputs. Paper Links GPT-2 Paper: https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf AllenNLP GPT-2 Demo: https://demo.allennlp.org/next-token-lm?text=Joel%20is The Illustrated GPT-2: http://jalammar.github.io/illustrated-gpt2/ Combining GPT2 and BERT to make a fake person: https://www.bonkerfield.org/2020/02/combining-gpt-2-and-bert/ Thanks for watching! Please Subscribe!