wow wow wow...DH and I would both be livid!!!! We put our fence inside our property at our old house for those same reasons.....so no one else could mess with the fence................
I would think you could get it professionaly removed.....DH powerwashed our deck (which was painted) and removed a lot of the paint....so I would think a professional could clean it off....and maybe cleaning the whole fence would have it looking the same......
He absolutely tresspassed onto your property and vandalized your fence......if he would pay to fix it the way "you" want it (not him)...I would get a lawyer involved...........and I don't think I'd trust him to do it himself either.....I would get a professional no matter what gets done!!!
Good luck...........not what you needed!!!