GPU Computing for Neural Networks

Infrastructure & Compute Deep Learning Dawn

Impact

At a glance

Date: 2009
Era: Deep Learning Dawn (2006–2011)
Category: Infrastructure & Compute
Impact: 4 / 5
Key people: Andrew Ng
Organizations: Stanford University, NVIDIA

What Happened

Researchers including Andrew Ng demonstrated that GPUs (graphics processing units) could train neural networks 10-70x faster than CPUs. NVIDIA's CUDA platform made GPU programming accessible. This hardware breakthrough removed the computational bottleneck that had held back deep learning.

Why It Mattered

Without GPUs, deep learning would have remained impractical. This hardware democratization was as important as any algorithmic breakthrough. NVIDIA would become the most valuable company in the world partly because of this shift.

Key People

Andrew Ng

Organizations

Frequently asked questions

When did GPU Computing for Neural Networks happen?+

GPU Computing for Neural Networks took place in 2009.

Who was behind GPU Computing for Neural Networks?+

For GPU Computing for Neural Networks, key people included Andrew Ng and organizations involved were Stanford University and NVIDIA.

Why was GPU Computing for Neural Networks important?+

Which era of AI history does GPU Computing for Neural Networks belong to?+

GPU Computing for Neural Networks is part of the Deep Learning Dawn era (2006–2011) — a major breakthrough in the infrastructure & compute category.

Related Milestones

2009Infrastructure

ImageNet: The Dataset That Changed Everything

Fei-Fei Li and her team created ImageNet, a dataset of over 14 million hand-labeled images in 20,000+ categories. Starting in 2010, the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) became the benchmark for computer vision progress.

Fei-Fei LiStanford UniversityPrinceton University

1958Infrastructure

LISP Programming Language

John McCarthy created LISP (LISt Processing), a programming language designed specifically for AI research. Its features — recursion, dynamic typing, garbage collection, and homoiconicity — were decades ahead of their time.

John McCarthyMIT

2011.02Competition

IBM Watson Wins Jeopardy!

IBM's Watson system defeated the two greatest Jeopardy! champions, Ken Jennings and Brad Rutter, in a televised match. Watson used natural language processing, information retrieval, and machine learning to understand nuanced questions with puns and wordplay.

Ken JenningsBrad RutterIBM

2011.10Product

Apple Launches Siri

Apple introduced Siri as a built-in feature of the iPhone 4S — the first major voice assistant integrated into a mainstream consumer device. Users could ask questions, set reminders, and control their phone with natural speech.

Apple

1982Infrastructure

Japan's Fifth Generation Computer Project

Japan's Ministry of International Trade and Industry launched a 10-year, $850 million project to build 'fifth generation' computers with AI capabilities — parallel processing machines that could understand natural language and reason like humans.

MITI (Japan)

Get the latest AI milestones as they happen

Join the newsletter. No spam, just signal.