What would you do if...?

I would just tell him the truth if you dont like him that much. Its not good to have a relationship, where only one person loves the other.