What I want to know is will I be able to up sticks and move to a different town/city in the same province and keep the same residence permit taking into account that I would need to register at a police station/PSB in that different place?

You have to apply for your RP at the PSB office in your Chinese wife's family register area. You can live in another province if you like provided you submit the accommodation form from the other provinc to that PSB office in your wife's hometown. Obviously in such a situation fortnightly interviews won't occur.

It is rather annoying that there could be lengthy journeys involved so that you can present yourself at the PSB for RP renewals, and have to hang around there awaiting your passport return as they will retain your passport after you apply, and it will take at least 10 days before you can get it back, and then travel to your accommodation in the other province.

That's my assessment - it doesn't make pleasant reading, but I could be mistaken.