Great sex makes me go loco

So I had sex with Mr. X again. A week and a half ago. Will I fuck him again? That's a negatory. The sex was fan-fucking-tastic. However, I'm gone from where I was for the summer with no real plans to go back (it'd be ridiculously easy to go back though...he's under the impression that I am coming back in 2 weeks, though not for him [but he's allegedly waiting for me]). Plus, the problem with Mr. X is that he makes me want a boyfriend. He's a guy that I enjoy getting physical with and can have a decent conversation with. Not to mention, he's a non-judgmental audiophile. The guy I lost my V-card to was always criticizing my taste in music, total music snob. It was annoying as hell. Maybe I should have run in the other direction once we started creating inside jokes (there's 3 currently that I can think of). I even have a nickname (one of the inside jokes). That's not how things are supposed to go down when it's just sex. Keep business strictly business. People get hurt when you don't. I tried to end things, but he wouldn't let me. It sucks because I can't just slip into something vaguely resembling a casual relationship based entirely on sex, but I can't seem to put the final nail in the coffin. I need to do the latter, though, for both our sake.