Will my boyfriend of 4 years eventually miss me and want me back because we have had great times?

If you have been together that long, he obviously does care about you.. the question to you is do you want to be with someone who could say they really don't know if they love you or not..? Whether he does or not, you do not say something like that to someone you love. He shouldn't be playing mind games anymore and the fact that he is makes it seem like he isn't a genuine person. Reconsider whether you really want this type of relationship because there are a lot of other great guys out there and just because you have been with him for a long time doesn't mean you are stuck.