Thanks again to everyone for commenting. I have been walking to the station with my housemate for the past few days. I do end up being late, but I told my boss about the problem and he has been very understanding about it. Hopefully the guy won't try again, after the shouting match, but I will definitely keep everyone's advice in mind.
Thanks!