Image GPT: Generative Pretraining from Pixels (Paper Explained)
Published June 18, 2020
Views 30.7K | Likes 963 | Comments 75
At a glance
Views
30,730
Likes
963
Comments
75
Performance vs. channel
Outlier score
Engagement rate
More features coming
We're working on new analytics and tools. Stay tuned.
About
BERT and GPT-2/3 have shown the enormous power of using generative models as pre-training for classification tasks. However, for images, pre-training is usually done with supervised or self-supervised objectives. This paper investigates how far you can get when applying the principles from the world of NLP to the world…
- Published
- June 18, 2020
- Made for kids
- No
More features coming
We're working on new analytics and tools. Stay tuned.