AI in 2017
2 milestones in artificial intelligence
ResearchDeep Learning Breakthrough
Attention Is All You Need: The Transformer
Eight researchers at Google published 'Attention Is All You Need,' introducing the Transformer architecture. It replaced recurrence with self-attention mechanisms that could process entire sequences in parallel. The paper's title was deliberately bold — and proved prescient.
Ashish VaswaniNoam ShazeerGoogle BrainGoogle Research
ResearchDeep Learning Breakthrough
AlphaGo Zero: Learning From Scratch
AlphaGo Zero achieved superhuman Go performance with ZERO human knowledge — no training data from human games, no hand-crafted features. It learned entirely through self-play, and within 40 days surpassed all previous versions, including the one that beat Lee Sedol.
David SilverDeepMind