“Let’s give this a few more days or weeks, but after that, let’s go back to work and go back to living,” he says