I have worn a few different surgical binders and they were all very itchy. I could not wear them as a base layer. Had to wear a tank top or t-shirt underneath, otherwise I'd chafe and get a rash along the hems.
If you were going to go that route, I'd try the Underworks surgical binder. I imagine the material is similar to the rest of their binding products and would hopefully be less irritating.