Tough...

... you made the
"unique" mistake, and if it took you three years to uncover it, then that's not the fault of the pensioner.

Stop the payments now, but the remaining debt is your mistake - he shouldn't pay for it.