It's been my experience that any "Take with Food" directions are just there to avoid the potential for stomach related side-effects. Sometimes a cracker or two, or half a granola bar, is enough to stave off any stomach upset that might be looming. If those aren't consistent for you, if you are not experiencing any related stomach issues, should be all good.
The ones that get me are the "Take with food, but not dairy, and not too much food, between 7 and 8, daily, standing on one foot, gazing East, while not operating any heavy machinery..."

-Miki