There's some info on tracking this down in this FAQ, however it sounds like you've already got a good idea of what's causing it.
If you disable the Movie plugin the problem should go away but the underlying problem is probably caused by a video codec misbehaving, perhaps due to something particular in some of the video files. If you can track down which files cause the problem then you should be abel to work out which codec is causing the problem and disable/remove/update/replace or bug-report it.
By the way, plugins will still be called to extract information while in Details mode if you have the Description column turned on, or one of the other columns like Dimensions and so on.