I love animals

I need help. I’ve been caring for a stray for almost 3 years. He’s a city cat. Super friendly, knows the houses & people around here, he’s street smart, has multiple houses he visits but doesn’t have a “home”. He comes in my house all the time, stays the night, has a heated house on my porch, always has food & water available to him & I truly LOVE him & I know he loves me too.
He has even gotten use to my 3 dogs & 2 cats in the house. Every now and then he will disappear for a few days but if I walk the streets near me, I always find him. I’ve given neighbors that i know he visits my phone number bc I would be devastated if something happened to him & I didn’t know. I even tell them to call me if they ever notice he needs medical help or just anything for that matter. I know he goes in other peoples homes but from what I’ve gathered, no one cares like i do. Hes been TNR’d btw!
So my problem is…. Im moving. I want to take him soooooo bad but im terrified to do something that would make him unhappy or put him in harms way. My husband says I should (I think he’s attached too) but he also says that as he ages, he will need more of a home base like he has with us. Everyone else in my family says it would be cruel to take him from his area that he’s use to & the other people that know him. I’m extremely torn.
Please lmk what you all think I should do. Btw, I love this cat as much as I love my other animals. We’ve spent so much time together & he also protected me from a raccoon that was charging after me once. It was unbelievable. But i want to make sure i do whats right for HIM, not me. Anyways, here’s a pic of my Jasper boy. Thanks for the help.

Source