I think it's definitely worth a visit. I don't regret going at all, it was enjoyable, and if it were closer, I'd go again. But from Virginia, it's a long drive.
I think I'm like you, I don't really remember a destination that I thought "well that was a waste." I like seeing different parts of the world.