Slow transfer speeds to and from my nas

Hello, i have a weird problem as well close to this one.

Thanks for the 500kb tip , who improved the speed (not a lot, i have a synology 410j) but i can't use (yet) because it make an another issue worst ..

my issue is when i copy or move something from my computer (i5 3570k / windows 8 pro x64) with directory opus 10 to my Nas.

when i do this, directory opus display or way to act is almost not responding anymore or run slow very very very much during the file process copy, almost like if he's freezing. i have this issue since the beginning, never asked to the support, but now, i start to be a bit tired of it :slight_smile:

it's of course only happening when i copy a file from my computer to a network of the Nas.

Thank you for any help !

Try setting copy_nonbufferio_threshold to zero, and make sure the NAS firmware is up to date.

i alrady did that yesterday. trying again now. 500kb and zero at copy_nonbufferio and directory opus is completly freezinguntil the "move" of the file is done, and then, it's working again normally.

What type of files are you copying, and how large are they?

What happens if you set copy_nonbufferio_threshold back to 1MB?

Was "copy_nonbufferio" a typo or are you using an older version of Opus?

Have you checked your NAS firmware? (It is really worth checking. It has helped other people as there have been massive bugs in some versions of some NAS firmware which didn't affect how Explorer writes data but made things go badly wrong with other programs.)

Which antivirus scanner are you using?

[quote="leo"]What type of files are you copying, and how large are they?

What happens if you set copy_nonbufferio_threshold back to 1MB?

Was "copy_nonbufferio" a typo or are you using an older version of Opus?

Have you checked your NAS firmware? (It is really worth checking. It has helped other people as there have been massive bugs in some versions of some NAS firmware which didn't affect how Explorer writes data but made things go badly wrong with other programs.)

Which antivirus scanner are you using?[/quote]

  1. issue happen on Big File, not small file. copying avi, Mkk, iso file = issue. copying small files (like fontes, .txt, or anything who is small) = no issues. it's happening on any drive.
  2. same issue if i set threshold to 1MB. the issue start after few seconds after the copying/moving start. around 4 o 5 seconds after.
  3. it was a typo :slight_smile: i'm using 10.2.0.4 (x64)
  4. the Firmware of my 410j syno Nas is up to date and has always been.i reinstalled the NAS completly from scratch last week. issue was happening before and after.
  5. i use the builtin antivirus from microsoft included in windows 8 pro, Windows Defender.

issue is of course not happening if i do a transfer via FTP, (but it's slower via FTP than Share Network, so i never use it), and there is no NFS protocol included in Windows 8 pro :frowning: ...

still me (sorry)

  1. issue is not happening if i use the powershell command for copying to the network, using this command :
    @sync:"C:\Program Files\NirCmd\nircmd.exe" shellcopy {filepath$} {destpath$}
    but it does only copy. is there a command who does Move as well ? not perfect, but it can be a temporary workaround
  2. another issue, while doing a copy/move file, in directory opus, the directory is not refreching in real time. if i move several files. after finishing to move the first move, and doing it with the second one, the first file doesnt disappear. to see it disapearing, i must go a step up in the directory structure and come back in the folder to see that the file has disapeared.

So you've got DSM 4.1-2668 on the NAS?

It was only released very recently:

synology.com/releaseNote_enu ... hp?lang=us

[quote="leo"]So you've got DSM 4.1-2668 on the NAS?

It was only released very recently:

synology.com/releaseNote_enu ... hp?lang=us[/quote]

yes

In that case, I would report the problem to Synology. They have responded in the past with fixes for different drives/firmwares which became really slow/unresponsive when anything other than Explorer (or things that just call Explorer's copy function, like nircmd.exe) are reading/writing data to them, and that's all Opus is doing at the end of the day.

ok, thank you, but the issue is not happening with the explorer's copy fonction , with the shell command as said above, the issue is only happening inside directory opus when using the network share. with the shell command used inside directory opus, no problem.

i hope it's an issue on their side. is there, maybe, for making my life a bit more easier, a shell command for "move" instead of copy, can you tell it to me please ? because i rarely use copy, always move.

thanks !

It's not surprising that the problem doesn't happen with the shell file copy as that's the one thing everyone tests against (if they test at all).

I couldn't see a NirCmd.exe argument to make it move instead of copy, though I'm no expert on that tool and there may be others you could use in its place.

[quote="leo"]It's not surprising that the problem doesn't happen with the shell file copy as that's the one thing everyone tests against (if they test at all).

I couldn't see a NirCmd.exe argument to make it move instead of copy, though I'm no expert on that tool and there may be others you could use in its place.[/quote]

ok, thanks for the info ! do you know any other tool maybe who can do that ? (i'm very new at this). thx.

I'm thinking I have a similar issue going on here. New Windows 8 x64 box, copying file from network I get 1.2-1.5MB/s, Windows Explorer same file copy 80-90Mb/s (so about 9-10MB/s), thats 10x slower.. I've tweaked the buffers and tried everything I can think of.. Copying files is a basic need and 10x slower is beyond acceptable. And switching to Explorer to copy files every time isn't really a choice unless I just stop using DOPUS all together.

Can I simply disable DOPUS's copy dialog and just use the default?

What kind of NAS is it?

Have you checked for firmware updates or reports of similar problems (slow speed when using things other than Explorer)?

Have you checked in case your antivirus or firewall is treating Opus differently?

Which buffer settings did you try changing, and what to?

Have you tried any other programs to see what their speeds are like? (Ones which don't use the shell's file copy code, of course. The DOS Copy command is a quick way to test that, or a tool like TeraCopy.)

You can't disable Opus's copy routines, but you can configure Opus to do something else instead, in most cases. Commands for copying via the shell can be found here and via TeraCopy can be found here.

Exactly the same problem I am having since I start using DOPus few years ago. It happened to earlier QNAP TS-439 Pro and current Synology 3611xs
Now using Win8 x64 Pro. No jumboframe.

Copy 20Gb file to the NAS:
DOPus = 45-55 MB/s
Windows explorer = 100-108 MB/s
Teracopy = 100-108 MB/s
DOS = 100-115 MB/s

Adjusted the copy_buffer_size from default 64kb to 1Mb, DOPus speed improved to 77-84 MB/s. Still far from 100 MB/s.
Tried with 2MB, speed is the same. 4MB, speed dropped to 70-75 MB/s.

with 1MB, copy to NAS speed improved (although not to the max). However 1mb setting has adverse impact on file copy between internal HDD !!

Copy from 2 internal HDD Intel 520 to OWC Extreme pro 6Gb
DOPus = 245-250 MB/s with 64kB, but only 197-210 MB/s with 1MB !
Windows explorer = 450 MB/s for the first 10sec, then down to about 230 MB/s constant.
Teracopy = 230 MB/s constant.

So I believe there is nothing to do with NAS firmware, it is the DOPus file copy setting / mechanism.

Amendment for the internal HDD transfer speed data.
DOPus = 245-250 MB/s with 64kB for first 10sec, then down to about 230 MB/s constant
with 1Mb is constant 197-210 MB/s

Did you try the copy_nonbufferio_threshold setting, setting it to zero in particular (other values may also be worth a try)? (It is separate from the copy_buffer_size setting you mentioned.

When testing, did you time things (reported speed may vary from program to program), and ensure that the files were completely flushed to the network/disk (not just written to a writeback buffer) before stopping the timer?

Tried with antivirus turned off?

And made sure nothing which was being copied was buffered by a previous copy attempt in another program?

Have you checked the NAS firmware is up to date? You may not believe it will make a difference, but it really has made a difference for several people in the past.

At the end of the day, Opus is just calling ReadFile and WriteFile in a loop (and from two separate threads), so there is not a lot, other than the two settings, which should influence what happens unless it is external to Opus.

not with copy_nonbufferio_threshold yet, will do it later when I have access to NAS.

NAS firmware is always up to date. As I mentioned, not only NAS is affected, even internal HDD to HDD is affected. There must be something to do within DOPus setting.
After the post yesterday, I tried other copy_buffer_size and found the optimum (so far) is at 256kb. With this setting, I get about 82-87MB/s to the NAS and 220MB/s between HDD. None of them are at maximum potential, but at least closer for both.

1 strange behavior I noticed was copy_buffer_size at 512kb, the DOPus will "freeze" intermittently. The copy indicator bar is not smooth, it is like stop-move-stop-move. File transfer rate varies significantly from 0.00 (ZERO) MB/s to 117MB/s (NAS). Not sure if this is similar to what reported by martyprod earlier. set it to 256kb or 1mb the problem is gone.

If teracopy is installed, does it replace DOPus file copy mechanism? I ask this because there is an option in teracopy for integration.
Does that completely take over DOPus file copy mechanism including drag-and-drop? If so I might just enable that.

[quote="iieeann"]not with copy_nonbufferio_threshold yet, will do it later when I have access to NAS.

1 strange behavior I noticed was copy_buffer_size at 512kb, the DOPus will "freeze" intermittently. The copy indicator bar is not smooth, it is like stop-move-stop-move. File transfer rate varies significantly from 0.00 (ZERO) MB/s to 117MB/s (NAS). Not sure if this is similar to what reported by martyprod earlier. set it to 256kb or 1mb the problem is gone.

If teracopy is installed, does it replace DOPus file copy mechanism? I ask this because there is an option in teracopy for integration.
Does that completely take over DOPus file copy mechanism including drag-and-drop? If so I might just enable that.

[/quote]

WOOOOOOOOOOw ! i have the exactly same problem ! the freezing happens since so many time that it make me crazy ... wow, damn, it's because i changed the buffer size to 512 ? :frowning: ??? thanks i'll change the setting immediatly. i wrote 2 days ago to synology support team, but as someone is reporting the same issue with an another brand of NAS, i don't think it's a synology issue. maybe more a DO or windows issue. about teracopy, i tried it, during a long time now (since someone suggested it here), and the issues are the same and even worst ! so i uninstalled it. i used the trick to have it integrated with the "copy code" in directory opus and ... frezzing or stop copying, continue, stop etc ... the issue is when the the copy "crash", and don't continue anymore, it's a hell pain to kill the process (fortunatly Windows 8 x64 kill process much faster than Windows 7). it's even crashing the network to the Nas and i must wait a bit to access to it again. i installed the 10.5.2.2 beta (x64) from DO some days ago, i did some test, copy or move didn't crashed yet. but i didn't do more test yet.