No, you're not crazy. Here's how we used ours for both girls. For the first few weeks DH and I took turns "sleeping" and feeding in the guest room with the baby while the other slept. We have a big house so it was used as the changing table downstairs for a few weeks as well. After that, it has been used a handful of times as crib when we go to my sister for Thanksgiving and it has been used exactly once as a playpen. You can always get one later if you find you need it.
Carrie
DD#1 September 2005
DD#2 October 2007
The good thing about science is that it's true whether or not you believe in it.
-Neil deGrasse Tyson