If you're quick, you might be able to generate some process snapshots while the delay is happening, which we could use to see which code is being run at the time:
It's most likely a toolbar button or script add-in doing something slow (they get updated when the window is activated), or maybe a spun-down HDD, as a guess.