Yes, I do and have done the same. My non napper is pretty quiet so it's not an issue but if he was a screamer, I don't know what I'd do!!