You have no income tax liability, but depending upon the size of the remaining balance you may face federal gift tax issues. Your son has no tax liability; your generosity in paying off his mortgage is a gift to him.
The additional amount paid over the face amount of an obligation that may be deducted.