What exactly is the difference between horsepower and torque?

There's a battle of words that occurs when a group of people begin arguing over who has the fastest machine. All sorts of performance metrics are thrown around, and it can quickly become a miasma of uninformed soup. Some think they're going to win a race because they have more horsepower, while others scream from the hilltops that torque is king...