Implementation Overview

Typical cluster:

• 100s/1000s of 2-CPU x86 machines, 2-4 GB of memory
• Limited bisection bandwidth
• Storage is on local IDE disks
• GFS: distributed file system manages data (SOSP'03)
• Job scheduling system: jobs made up of tasks, scheduler assigns tasks to machines