Heya before my surgery I used to wear 2 layers of binders (a normal binder and a thin binder) the thin binder gave it that extra flatness.
Not that I recommend it, but what i used to do is wear the 2 binders to school and when I got home I took the thin one off and when I went to bed the other one too.
For exercise I wore 1 binder too.
So basically i wore a binder all day.
(it didn't hurt me, and that's very important, if a binder hurts you you should look for another one since it can be really harmful, my friend actually has gotten Tietze syndrome due to wearing multiple binders day and night, don't want that happening

)
BUT all of this of course depends on what kind of binder you wear, with a good binder you should be able to wear it through out the day without pain or so.
If you have no pain or any problems I wouldn't worry too much, just take it off when you can.