No, you do not need to notify passports of change of address. I have moved house twice since getting this one, and used it several times and there has never been any question. The only thing to be sure of is the time remaining on it after your return, sometimes up to 6 months or so might be required.