From the way people discuss camo clothing, it seems a choice that is more political than sartorial.
It's about breaking up your "outline". You could replace the background color on camo with blaze orange, but there has to be a camo pattern involved. They see solid blocks of color that look out of place. I have hunted my entire life, these are things that I know.