The Yarrow plant is also used for divination in Chinese culture. The proper name Achillea is taken from Achilles, the Ancient Greek hero who was immortal and invulnerable except for his heel.
If possible, use wood or concrete containers ... You could even follow Martha Stewart's tip for overwintering potted plants and move your yarrow containers to a protected hoop house.