You neglected to say how old you are. That would make a difference in what I can say to you.
Let me remind you that you did not "fall" in love (as if something outside of you made you love this man), but you have chosen to call your feelings love. There is a difference, and partly it has to do with not giving away your powers to outside agencies (such as fate).
I am not here to do advice to the lovelorn, but to deal with psychological issues. In your case, I would say there are several, the major one being that you have let yourself in for a lot without your really knowing it. This many has, as some would say, "many issues." If his age is anything over 12 years, they are major and you will NOT (repeat: NOT) be able to change him. You will need to decide, before you go too much further with him, whether you wish to go along with all his quirks and oddness.
If so, good luck...you will need it. If not...break it off soon. You are not obligated to tell him all the whys of breaking up. It would be enough to say that you have thought a lot about things, and have decided you do not seem to be compatible. (But be prepared...he sounds like the kind of guy who is going to want, even demand, specifics. And do it by email or phone. From what you describe, I don't see him as being very civil about the break-up, and it could get rough. Best wishes... -- Dr. Bob