If you're talking about passing, then no that won't affect it.
For the purposes of photography, then yes relative sizing can affect things. If you want to appear shorter, get a taller friend and avoid dresses since a dress elongates your silhouette and give the illusion of greater height; if you want to appear taller, wear a long garment, especially one with vertical-running stripes, and a shorter friend. Black makes you look slimmer, white makes you look bigger, etc etc.
Keep in mind these tips have rather minor effects - you might gain or lose at most an illusory inch or so when people are looking at the photo, without taking steps to arrange the scene to produce an actual optical illusion.
