With multiple numbers, it might be getting confused trying to figure out what it should sort on.
You would have better success creating a custom column, pulling out the number you care about and sorting by that. There is a script for this RegexColumnsReloaded (easily add regex columns or any kind of column).
I had a problem, I decided to solve it with regexp, now I have two problems ;).