But Shawn, they're called The Olympic "Games"!
I know what you mean though. They're supposed to be the best athletes, and as such should require the best conditioning, not just a particular skill. However, if the Olympics was just the decathalon there wouldn't be very much to tune into. Money drives the bus, unfortunately.