"You'll still have contact with them. Even if they can't be with you physically, you'll have contacts. A support system." Really, he should know this. Then again, Falcon had similar doubts...

"Your younger self has benefited greatly from his connections. I'm sure you would too, if you let yourself. And that's not factoring in the possibility that your Ren could arrive any day."