I think the joke here is that a government employee is going in on a holiday to work, which is rare enough to warrant historical note.

“Take care of some unfinished business” often has an ominous portent to it, but in this case he looks like he’s just literally working