File Move speed is slow

This thread was about moving data ("File Move speed is slow"), which would be an instant rename operation if the source and destination were the same device, so I did not even consider copying from and to the same NAS.

Explorer (via the Shell file-copy API) may be telling the NAS to do the copy itself, without any of the data going over the network at all. What does Task Manager's network bandwidth graph show while the copy is happening in Explorer? I believe there is a very low-level API for doing that with newer versions of SMB (or iSCSI apparently*) if the server supports it.

(*Edit: From doing some research, SMB and iSCSI both have different but similar features which were recently added to do this, circa WIndows 8.)

That is not something Opus or many other programs support, but you can call the shell file copy APIs from Opus in cases where you want do that kind of operation, which would give you the same result as in Explorer or other programs that use those APIs. You'd lose extra functionality when doing that, but most of the extra functionality would not be compatible with a file copy which the NAS was basically performing by itself anyway;

Somehow this went unnoticed.

It's bi-directional. Copy from/to combined. Each side is around 1GBps.

I would guess that the "peaks" of 2.5 were probably something wonky with the calculations...but I can only report the numbers. I can say that it's real as I just copied a 44GB file and it took right about 25 seconds.

The copy most likely is not going over the network at all, which probably accounts for all the differences. See my previous post above.

(Copy speed also would not combine from/to speeds together. It would be the maximum of the two, at most. With a normal copy, it's the round-trip speed, always, as that is how fast data is copied from A to B. But in this case, it's probably not a normal copy and the network is probably not relevant to the 2GB/s speed you're seeing.)

I don't know enough to agree/disagree with you Leo, you are probably right, it's possible that it's not using the. That doesn't change the challenge I'm facing however. I just want to get Opus to do these with the same kind of numbers as Explorer.

Unfortunately I don't have a fast M2 drive on the server that's connected to the NAS over 10GB so I can't easily validate if it's doing the transfer completely within the NAS or not. I'm going to see if I can use Aida64 to monitor LAN utilization on the NIC with Opus and Explorer and see if Opus is using the LAN vs Explorer not (ie the iSCSI commands being processed only on the NAS.) Be an interesting test...

Lot to learn here for me at least!

Leo, just validated your theory.

Opus copy of ~40GB file from/to the iSCSI drive used the LAN fully ~125-150MBps transfer with LAN at 125000-150000KB/s.

Explorer at 2-2.5GB/s transfer speed but LAN was... about a few KB so NO LAN traffic at all on the 10GB connections. Interesting! Note: There is traffic when copying to another drive...I need to get those numbers as well. But for now this narrows it down for sure.

So it seems the issue is related to how Opus is handling iSCSI based file transfers maybe? At least when to/from the same iSCSI connection?

See my post #22 above: File Move speed is slow

Try using the linked button to do the copy from Opus (via nircmd.exe) and it should give the same results as in Explorer, bypassing the network.

I'm a Synology user as well.

And i would really really appreciate built in support for

:cry:

I can set that up... just consider this a formal request to add an option in Opus to completely bypass the Opus copy routines...somehow. :slight_smile:

Thanks.

So, hey people, I recently installed dopus and was faced with the same problem. I have samsung qvo 860 and the copy/move speed was around 50MB/s, I did 2 things, I enabled Rapid mode through samsung magician and gave the program full admin rights by default. this fixed it and now dopus is faster than FExplorer and the speed hangs around 220MB/s. I hope this helps some people who face the problem. Though I do nothing crazy and I'm a complete normal user.
I tested by moving multiple files with the total size being 50GB.

Disclaimer: Remember I am an idiot.

Try this program that someone suggested to me. I said sure and I tried it and Directory Opus started go blazing fast with respect to network stuff. It's called MSI Mode Utility Version 2. After installing it and trying it, I was like What the F....

Maybe it doesn't work for everyone and my computer was just so misaligned or something. Evidently, I know nothing about computers.

I do know that previously, when I would press the network button on the side, it would take minutes for the process to end. Now it takes seconds. And, when I access my NAS, it opens up everything right away. It's not a virus or anything like that. That was my first suspicion but evidently a lot of gamers use it to speed up something or another.

I don't have the link. You'll have to find a safe copy yourself. Actually, I might have a copy which I'll see if I can attach to this post.

I didn't do the following but the guy had said it works better if you disable fast boot and hibernation. I think I did this (I can't remember really), I don't think it made much difference. Or maybe he was saying that you need to turn it off to work. I don't know because I AM AN IDIOT. Anyway, try it out. It seems that everything on my computer goes faster. What I am wondering was why didn't people tell others about this small program years before? Maybe they did but I never knew because I am stupid.

Here is the link to the Github page for the tool. Link.

And, here is a white paper from Intel that explains what it does. Link

You'll see that everything on your computer just opens cleaner and snappier. It's pretty cool. Wondering why Windows doesn't license from Intel and incorporate it in their system.

It'd be better to link to the tool's homepage than to upload a 7z of it where no one can know where it came from, if it's safe, or if it's up to date.

Please edit your post to replace to 7z with a link to the tool's website.

If it doesn't have a website then please just delete the post. No useful, legitimate tool would not have a site about it somewhere.

Yes, Your Eminence.

1 Like

A Reddit post is still not a great source for a utility like that. The home of the project is here. I'm happy with my computer, so I'm not going to install it. The post I linked goes into how to do this stuff manually if you wish.