« Flattening the Technology Adoption Lifecycle |
Main
| Social Networks and Academic Communities »
April 4, 2004
FlashMob meets the Grid, part way
Posted by Clay Shirky
We wrote about the attempt to build a
Flashmob supercomputer here
, back in February.. The event took place earlier this week, and succeeded in networking nearly 700 computers on the spot; however, they failed at their goal of getting a spot on the list of the Top 500 hundred supercomputers because of (all together now) problems of scale:
Results:
FlashMob I was very successful and a lot of fun. Over 700 computers came into the gym and we were able to hook up 669 to the network. Our best Linpack result was a peak rate of 180 Gflops using 256 computers, however a node failed 75% through the computation. Our best completed result was 77 Gflops using 150 computers. The biggest challenge was indentifying flakely computers...
Dealing with, uh, flakeley nodes is one of the big design challenges of the era, in all sorts of systems.
If we're going big and distributed (which we are) then you cannot _ever_ assume things will go your way, certainly not at all points in the system at the same time. Big distributed anything -- supercomputing, file sharing, social networks -- all has the same core challenge: assume flakeliness, then design systems that can withstand it.
Comments (0)
+ TrackBacks (0) | Category: social software
- RELATED ENTRIES
- Spolsky on Blog Comments: Scale matters
- "The internet's output is data, but its product is freedom"
- Andrew Keen: Rescuing 'Luddite' from the Luddites
- knowledge access as a public good
- viewing American class divisions through Facebook and MySpace
- Gorman, redux: The Siren Song of the Internet
- Mis-understanding Fred Wilson's 'Age and Entrepreneurship' argument
- The Future Belongs to Those Who Take The Present For Granted: A return to Fred Wilson's "age question"
TrackBack URL:
http://www.corante.com/cgi-bin/mt/teriore.fcgi/1500.
Listed below are links to weblogs that reference FlashMob meets the Grid, part way: