Just like with batiks, if you can't tell the difference then it shouldn't matter. Nobody else will be able to tell the difference, either. And if you can tell the difference between the two sides but just can't decide which is "right", then you just have to be consistent in which side you use. I made a pillow once with corduroy and accidentally put it wrong side out, but the wrong side looked good with a different texture, so I left it and I still love it to this day.
Nancy