NVIDIA CUDA GPU computing logo

GPU Computing for Neural Networks

What Happened

Researchers including Andrew Ng demonstrated that GPUs (graphics processing units) could train neural networks 10-70x faster than CPUs. NVIDIA's CUDA platform made GPU programming accessible. This hardware breakthrough removed the computational bottleneck that had held back deep learning.

Why It Mattered

Without GPUs, deep learning would have remained impractical. This hardware democratization was as important as any algorithmic breakthrough. NVIDIA would become the most valuable company in the world partly because of this shift.

Key People

Organizations

Tags

Related Milestones

Fei-Fei Li, creator of ImageNet
Infrastructure

ImageNet: The Dataset That Changed Everything

Fei-Fei Li and her team created ImageNet, a dataset of over 14 million hand-labeled images in 20,000+ categories. Starting in 2010, the ImageNet Large Scale Visual Recognition Challenge (ILSVRC) became the benchmark for computer vision progress.

Fei-Fei LiStanford UniversityPrinceton University
Lisp programming language logo
Infrastructure

LISP Programming Language

John McCarthy created LISP (LISt Processing), a programming language designed specifically for AI research. Its features — recursion, dynamic typing, garbage collection, and homoiconicity — were decades ahead of their time.

John McCarthyMIT
IBM Watson computer system
Competition

IBM Watson Wins Jeopardy!

IBM's Watson system defeated the two greatest Jeopardy! champions, Ken Jennings and Brad Rutter, in a televised match. Watson used natural language processing, information retrieval, and machine learning to understand nuanced questions with puns and wordplay.

Ken JenningsBrad RutterIBM
Apple Siri voice assistant logo
Product

Apple Launches Siri

Apple introduced Siri as a built-in feature of the iPhone 4S — the first major voice assistant integrated into a mainstream consumer device. Users could ask questions, set reminders, and control their phone with natural speech.

Apple
Infrastructure

Japan's Fifth Generation Computer Project

Japan's Ministry of International Trade and Industry launched a 10-year, $850 million project to build 'fifth generation' computers with AI capabilities — parallel processing machines that could understand natural language and reason like humans.

MITI (Japan)

Get the latest AI milestones as they happen

Join the newsletter. No spam, just signal.