Somehow, he finds it in him to have patience. When the situation isn't so dire as to have someone's life on the line, he can bide his time until they come around, until the situation smooths itself over or becomes a problem enough for him to intervene. But he doesn't stop Tim as he moves to leave, not putting himself as a barrier between himself and the door. He needs some space, and Kravitz doesn't know how he'd assist at this stage any further.

So perhaps, it is better that way. But the door, literally and metaphorically, remains open for him should he need or want it.