I'll bite my tongue on my overall thoughts on your dh (based on your posts).
Dh and I have different travel styles. I spring break without him each year. :) He stays home and works, I take the kids somewhere drivable. It works really well for our family.
But I do think there are ways to compromise. If he isn't up when you want to be doing something, take dd. But, maybe somedays just plan to chill and not try and be on a schedule or get annoyed with his sleeping in. It can be done (finding the balance).