No, the condition is almost always related to a hormonal disturbance and occurs in males with excess female sex hormones in the bloodstream.  Cause unknown but some feel that disease plays a part i.e. Liver, thyroid, pituitary, testes, usually among pubescent boys and men over 50 and is often as a side effect of medications for varied conditions, poor diet, excess alcohol, misuse of drugs and environmental factors.
A full medical examination is needed to find the cause and to determine any treatment if resulting breast enlargement is a major cause of discomfort.  
     Information above  from British Medical Association, Complete medical encyclopedia, Dorling 
     Kindersley Limited, London 1990  ISBN 0-86319-438-3  and was rewritten by me for ease
     of reading.