Residual network skip connection block diagram

ResNet: Deeper Than Ever

Research Breakthroughs Deep Learning Breakthrough

Impact

At a glance

Date: December 2015
Era: Deep Learning Breakthrough (2012–2017)
Category: Research Breakthroughs
Impact: 4 / 5
Key people: Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun
Organizations: Microsoft Research

What Happened

Microsoft Research introduced ResNet with skip connections (residual connections), enabling the training of networks with 152+ layers — 8x deeper than previous networks. ResNet won ImageNet 2015 with 3.57% error, surpassing human-level performance (5.1%) for the first time.

Why It Mattered

First AI system to beat humans at large-scale image recognition. Residual connections became a fundamental building block in virtually all deep architectures, including Transformers.

Key People

Organizations

Microsoft Research

Frequently asked questions

When did ResNet: Deeper Than Ever happen?+

ResNet: Deeper Than Ever took place in December 2015.

Who was behind ResNet: Deeper Than Ever?+

For ResNet: Deeper Than Ever, key people included Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun and organizations involved were Microsoft Research.

Why was ResNet: Deeper Than Ever important?+

First AI system to beat humans at large-scale image recognition. Residual connections became a fundamental building block in virtually all deep architectures, including Transformers.

Which era of AI history does ResNet: Deeper Than Ever belong to?+

ResNet: Deeper Than Ever is part of the Deep Learning Breakthrough era (2012–2017) — a major breakthrough in the research breakthroughs category.

Related Milestones

2012.09Research

AlexNet: The ImageNet Moment

AlexNet, a deep convolutional neural network, won the ImageNet competition by a staggering margin — reducing the error rate from 26% to 16%. Trained on two NVIDIA GTX 580 GPUs, it was dramatically deeper and more powerful than previous entries. The AI community was stunned.

Alex KrizhevskyIlya SutskeverUniversity of Toronto

2013.12Research

DeepMind's DQN Masters Atari Games

DeepMind demonstrated a deep reinforcement learning agent (Deep Q-Network) that learned to play Atari 2600 games directly from pixel inputs, achieving superhuman performance on many games with no task-specific engineering. Google acquired DeepMind for ~$500 million shortly after.

Volodymyr MnihDemis HassabisDeepMind

2017.06Research

Attention Is All You Need: The Transformer

Eight researchers at Google published 'Attention Is All You Need,' introducing the Transformer architecture. It replaced recurrence with self-attention mechanisms that could process entire sequences in parallel. The paper's title was deliberately bold — and proved prescient.

Ashish VaswaniNoam ShazeerGoogle BrainGoogle Research

1989Research

LeNet: Convolutional Neural Networks

Yann LeCun demonstrated that convolutional neural networks (CNNs) could be trained with backpropagation to recognize handwritten digits. The refined LeNet-5 (1998) achieved 99%+ accuracy on MNIST and was deployed by banks to read checks — running in ATMs for years.

Yann LeCunAT&T Bell Labs

2013Research

Word2Vec: Words as Vectors

Google researchers published Word2Vec, showing that relatively small neural networks could efficiently learn meaningful vector representations of words from large text corpora. The famous example `king - man + woman ≈ queen` made the idea vivid: semantic relationships could be captured geometrically in vector space.

Tomas MikolovGoogle

Get the latest AI milestones as they happen

Join the newsletter. No spam, just signal.