Should i go to his house? 10 points?

So I'm alittle scared this Saturday I'm going to my friends house he's a guy and he has alittle bit of problems everyone thinks he's weird but I don't judge people, but I'm scared cause 1. He always says I love you I tell him to stop but he dosnt (were just friends) I don't like him like that 2. Every week he asks me do you want to go out with me I say no thanks but he won't stop asking he puts his arm around me and hugs and I hate pbeing touched and ii tell him to stop and he dosnt so I move away he kkinda mays me feel uncomfturble he's always near me and and I don't like it but everyone makes fun of him and I feel bad also once you get to no him he's cool but its just this problem that I'm having I mean I wanna go to his house but its only going to be me and him and his mom who's an alcoholic so I'm kinda scared on what's he's going to do he asked me to this hang out no me but I agreed now he called it a date but I told him no he said a date for friends? The other day in class one of the other kids came in and said (one of the boys in da class) came in and said that he was looking at him go to the bathroom now all the guys are scared of him Wtf so I'm kinda scared but I wanna go should I go? 10 points thanks