Yeah, I'd try and plan it as a mini vacation, and he's just one of the attractions. Fill up your itinerary and make seeing him one of the first things, then if it works out, he can tag along, and if it doesn't, then you just don't invite him along for the rest.
