Watch just one match at the elite level and you will see how much effort the players put into 'sweeping' ahead of the rock. Their knowledge of the ice surface is crucial in assuring the rock gets to where it's suppose to be. You try doing that for two hours and see how your arms and shoulders feel. Those at the top of their game are athletes complete with trainers and sports psychologists.
The game also requires balance and finesse to not only throw the rocks properly but to avoid slipping on the ice and cracking your head open. For a neophyte it is not easy.
We don't mind the joking about it because we know the reality. It's a wicked fun game to play and often a nail biter to watch. Be careful you don't get hooked and charmed from watching it.

John Scalzi: ” You know, I haven’t been following the Olympics at all, because I don’t much actually care, but I have to say the Norwegian Olympic Curling Team’s pants deserve a medal. For something.”

These pants worn by Norway's Olympic curling team do not invalidate my arguments.
http://gilmoure.tumblr.com/