Cheapest Name

He never paid me any attention, but would occasionally contact me to ask how I was, and that would lead on to him asking if I wanted to “hang out” — read: sex.
I was crazy about him, and texted him a lot. I would try to call him, but he never took calls. He never took my calls anyway…except on rare occasion…and he never wanted to talk. He was always disinterested on the phone. On the other hand, we would also have phone conversations about nothing, like friends do. That’s what I thought we were. (And he said so too. When I asked, “Are we friends?” He said, “Yes.”)
When I called him on Saturday, he made me feel bad, saying, “Great. My brother drives 10 hours to Melbourne, and I’m stuck her talking to you. So…after you…” He was basically asking me to piss off. I told him I wanted a clear rejection, and he said, “Don’t you get it?” He never gave me a clear rejection, even though I had asked him for one many times to date. What don’t I get then?
He asks to hang out, he thinks I owe it to him to have sex with him, and then recently, when I said “No more sex”, he has simply been totally and completely disinterested.
What I don’t get is: Why was he unable to give me a clear rejection? Why couldn’t he say “Look, I’m not interested.”? Wouldn’t that have been much easier to stop all the text messages and calls from me? (Personally I would be annoyed to receive so many calls and text messages.)
Yet he would continue to meet for sex, when he is just not interested.
On the same phone call, he said “I tried.” I don’t know what he “tried” for…what he ever “tried” to do. On the same phone call, I told him, “I would do anything, I just want to see you.” We established that no sex would happen…but he said, “Okay, then next time…just give me a chance.”
I don’t know what he wants me to “give him a chance” for.
Why does he have to be this way? I saw the light yesterday, and decided to walk away. But I simply cannot understand his actions.
P.S. * Our casual sex ’saga’ went on for 6 months.
* He said right from the start that he didn’t want a relationship. I understood that right from the start, and told him I didn’t want him to do anything he didn’t want to.
*He liked having sex, and I liked seeing his face every once in a while.
Why could he not give me a clear rejection since I was being so annoying? Why not just tell me to buzz off? Why ignore me? (And cause me so much anguish?)