What We Need

Good compilers
But not too many people working on them

Good networking
Most people use JNI or compile down to C

Good I/O
Relatively little work so far

Good memory management
GC's don't get you all the way there

Remember: Web servers aren't CPU limited!