I would feel the same as you but I would not let it stop me from going and enjoying. You deserve 7 days of R&R and cutting loose after 10 straight months of giving yourself day in and day out to your DD (not to mention the 9 months before that you spent brewing her).
And not that its required, but the old 'absence makes the heart grow fonder' is never a bad thing!
Have a great time.