He does not imagine what if they had, because he's too old for pointless dreams. In fact, if he feels anything from her defensive response, it doesn't show at all.

"Yeah," he says. "That's what I thought."

And he turns his back on her like it doesn't matter, going back to preparing that cup of coffee so he can get the hell out of here.