I can't bind over the weekends. It sucks, but oh well. It didn't bother me all that much before I started binding for the first time, but since I have it's become increasingly bothersome not to bind. For me what bothers me the most is when I accidentally touch my chest, I think that annoys me more than looking down on my chest. But yes, I try to wear baggy-ish stuff, a sports bra, and I just avoid looking at or touching my chest. Just the feel of wearing a bra feels really awkward to me now though.
You shall survive though and the uncomfortable experience will come to an end!