AI in 2020
2 milestones in artificial intelligence
ResearchThe Transformer Era
GPT-3: The 175 Billion Parameter Leap
OpenAI released GPT-3 with 175 billion parameters — 100x larger than GPT-2. Without any fine-tuning, GPT-3 could write essays, code, poetry, translate languages, and answer questions through 'few-shot learning' (learning from just a few examples in the prompt). The API launched in beta, enabling thousands of applications.
Tom BrownOpenAI
ResearchThe Transformer Era
AlphaFold 2: Protein Folding Solved
DeepMind's AlphaFold 2 solved the 50-year-old protein structure prediction problem, achieving accuracy comparable to experimental methods at CASP14. It could predict how proteins fold from their amino acid sequences — a problem that had stumped biologists for half a century.
John JumperDemis HassabisDeepMind