I've definitely been losing my "natural strength" over the past couple months. My backpack has become nearly unbearable, and brute forcing doors with my arms/shoulders causes pain and cramping - planting my feet and pulling with my hips, thankfully, came pretty naturally.
This is with no workout routine (aside from walking at night) and an attempt at a high-fat diet. Working out can help, but...is it really worth it? The drop-off is exponential - it becomes significantly harder for less overall results. Not to mention that it may or may not elevate testosterone (I've seen studies that have gone both ways), which, assuming it does, would put you on a higher dose of AA's, requiring more of a workout to get the same results, which...would require a higher does of AA's.