I think it was an unsubtle way of saying that if you actually were a horrible friend then people wouldn't tolerate you, want to be with you, hang out, give gifts, but since you are not a horrible friend people do want to be with you, hang out and give gifts.
So, he's saying that you're a good friend.