Hey,
I did the same thing when I had gotten Basil. I had to stop at parents house for the night before the journey home. He was fine, and didn't get very stressed, I kind of locked myself in the room with him stayed with him almost the entire time (except for dinner and bathroom of course). He explored the room but I only allowed him to stay in the room I was in at parents house, and did not let him roam their house. When I got him home, I also kept him in my room for 2 days before allowing him to acclimate to the rest of the house (there were no other pets living in my apartment around the time I brought Basil home).
Things are new for him, and obviously the more comfortable he is the better so try to just keep things in the room that will be familiar to him. For me, I gave him a toy when I first picked him up and put it in his carrier with him, I made sure he had it in my room at my parents house, and then in his carrier on the way to my apartment. I tried to make sure he has familiar things with him so that he may feel a little more confident. That was one of his favorite toys for awhile, until he totally destroyed it 5 months later.
As for you going away a week later, I wouldn't say its the best idea, and to avoid doing it if possible because the first few weeks are important bonding time, and I wouldn't want to miss that for the world.
I think during that time he is trying to get to know you, and you disappearing may confuse him. Him staying at your house for a week and then having to travel again I feel may confuse him too because he's just getting use to an environment.
Do you live in your home alone? or do you live with someone? If there is someone there, I'd say that you and that person spend alot of time with him, and request that person spend alot of extra time with the kitten while you are away. Obviously its not the most desirable decision, but I think that if the kitten has someone familiar with him while you are away, and spends a lot of time with them while you are gone, he won't worry as much where you are for the short time because he'll have someone there for him.
I think that is a lot better of an option than taking him with you, because you will be exposing him to a lot of things (some that could stress him out physically as well) in all the different environments.