Because the Vedas have said so. It is also mentioned in the Vedas that they must wear colored clothes that are not white. It is said so for them to appear pleasing and auspicious. Since Kunkumam is derived from turmeric, it is also considered to be specially auspicious.