Feeling guity about affair with a married man......?

You should feel guilty about it, and he should too. It's unlikely at this point that you will be able to 'stay platonic friends'. End the relationship and then see a counselor about your ‘daddy' issues, because that needs to be dealt with before you find yourself in yet another relationship of this type.