Hollister 7730...medical grade adhesive for a lot of things. Odor-free, a single can ($25US) is good for a month of daily use with breast forms....assuming one beard = 1/2 breast in terms of bonding needed, it may be good for you.
There are YouTube videos on how to use it, clean it from prosthetics, etc.
ETA: Hollister 7730 is the adhesive, 7731 is the remover.