Is it my fault that we're not together anymore?

Does it matter whose "fault" it is? I've only heard your side of the story, but it sounds like he didn't have his priorities straight and is blaming it on you. You can try to be together again and ask him what specifically he'd like from you so things work. If you do that, what he says, but things still aren't working, you know it's his "fault". Of course.. he should do what you ask of him as well for the relationship to work. It's give and take, communication, etc. Good luck. Are you sure you want the long distance thing though? Be sure.