If you're young, 4 weeks sounds doable, but I think it might depend on the type of surgery. I had my original penile inversion surgery on my 26th birthday, and then a colon graft revision more than ten years later. I recovered very quickly from the penile inversion, and if it weren't for the need to dilate every two hours, I think going to work only two weeks later would have been doable. When I had the revision, I only took two weeks off, but it turned out to be a much more difficult recovery than the original one. I regretted going back to work after only two weeks. That one took a lot longer to recover from.
So if you feel up to it, maybe you can return to work early, and wear a stent and sit on one of those inflatable donuts. You should take one of those with you anyway on your trip, especially for the trip home.