To properly kill an Immortal, you need to chop off his head, and the best device ever made for severing heads is a sword. For that reason, nearly every Immortal carries a sword at all times.