Probably means the metadata thread is getting stuck on a file, which is usually (although not always) due to a bad video codec/splitter encountering a file it doesn't like.
If you send us some process snapshots made while the problem is happening, we may be able to tell you which component is going wrong, and possibly which file is causing it as well.