Declaring I Won't Wake You Up in the Morning

My husband often doesn't wake up in the morning and frequently doesn't even set an alarm. I used to wake him up, but he said something ridiculous like he wanted to be woken up by my voice, which annoyed me. So, I declared that I'd force him to set an alarm and I wouldn't wake him up anymore. Lately, he's been waking up properly, but today he woke up right when I was leaving the house. He asked why I didn't wake him, and I shot back, 'Didn't I say I wouldn't wake you up?' He then said, 'Why would you say something so mean?' Huh? I thought to myself, 'What is this nearly 30-year-old man talking about?' But I just went to work as usual.