Yes, it matters, but it matters more the lighter the color. In order to become light struck (skunky) it needs to be light penetrable, have hops and have a byproduct of fermentation (riboflavin).
I cut a small hole in the bottom of a brown paper shopping bag and cover my carboy with it. (With the bag, not the hole.)