I would say it all depends on how much of a gentleman he is, how respectful he is toward you, what you think of him and about a thousand other things.

He may indeed interpret it as an ivitation for sex and then again he may not. All guys are different as to how they may take the invitation.
I definatley agree with kelley at establishing boundries. I see no problem inviting him over or he inviting you over as long as the boundries are clear. And then if you two both want to break those boundries then it can be a spontaeous consensual thing. Or just kissing and cuddling.