That might be a small factor but it's a lot faster than that for me, so I think something else must be slowing it down.
For example, this gif from the release notes / highlights was not sped up in any way:
We may need to add a diagnostic mode here, so we can get a log of operations and how long they take, to work out where the slowdown is.
@Leo: It looks the same for me, the size is shown instantly without any higher CPU load on DOpus or Everything. However, basically all my folders (with their size) are already indexed in my Everything database, so there isn't much work to do for Everything or DOpus in that case. I have a not included network share where the calculation also takes quite long, but since it's a network share, I guess this is expected behavior.
I think this is probably not an issue because the system used in the GIF doesn't seem to have many files on it (20 GiB). My Everything index has many terabytes, millions of files. @NewRaven, I also have folder and file size indexed with Everything. When I look at the Everything debug console, I can see how long it takes to process all these IPC queries.
Also, there seem to be two queries for every folder. I'll attach the Everything debug log with the IPC lines and timings. This is what happens when I open the folder shown in the video.
When I add up all the timings, the total duration is 11.206274 seconds.
IPC: execute query: "C:\Example\17-11\"
found 0 folders with 8 threads in 0.015919 seconds
found 41 files with 8 threads in 0.092777 seconds
finished sort, time taken 0.001251 seconds
DB_WAIT: _db_ready_proc waited 0.000506 seconds
IPC: execute query: infolder:"C:\Example\17-11"
found 0 folders with 8 threads in 0.007612 seconds
found 41 files with 8 threads in 0.066760 seconds
finished sort, time taken 0.001019 seconds
DB_WAIT: _db_ready_proc waited 0.000513 seconds
IPC: execute query: "C:\Example\17-12\"
processed 1 usn records in 0.000029 seconds
DB_WAIT: db_query_create waited 0.000972 seconds
found 0 folders with 8 threads in 0.020197 seconds
found 30 files with 8 threads in 0.111050 seconds
finished sort, time taken 0.000899 seconds
DB_WAIT: _db_ready_proc waited 0.002189 seconds
IPC: execute query: infolder:"C:\Example\17-12"
found 0 folders with 8 threads in 0.007679 seconds
found 30 files with 8 threads in 0.064947 seconds
finished sort, time taken 0.001450 seconds
DB_WAIT: _db_ready_proc waited 0.000395 seconds
IPC: execute query: "C:\Example\18-01\"
found 0 folders with 8 threads in 0.014321 seconds
found 17 files with 8 threads in 0.085973 seconds
finished sort, time taken 0.001049 seconds
DB_WAIT: _db_ready_proc waited 0.000478 seconds
IPC: execute query: infolder:"C:\Example\18-01"
found 0 folders with 8 threads in 0.006460 seconds
found 17 files with 8 threads in 0.056835 seconds
finished sort, time taken 0.000714 seconds
DB_WAIT: _db_ready_proc waited 0.000376 seconds
IPC: execute query: "C:\Example\18-02\"
found 0 folders with 8 threads in 0.012940 seconds
found 50 files with 8 threads in 0.089148 seconds
finished sort, time taken 0.000863 seconds
DB_WAIT: _db_ready_proc waited 0.000427 seconds
IPC: execute query: infolder:"C:\Example\18-02"
found 0 folders with 8 threads in 0.006974 seconds
found 50 files with 8 threads in 0.058331 seconds
finished sort, time taken 0.000904 seconds
DB_WAIT: _db_ready_proc waited 0.000626 seconds
IPC: execute query: "C:\Example\18-03\"
found 0 folders with 8 threads in 0.011522 seconds
found 20 files with 8 threads in 0.085874 seconds
finished sort, time taken 0.000721 seconds
DB_WAIT: _db_ready_proc waited 0.000374 seconds
IPC: execute query: infolder:"C:\Example\18-03"
found 0 folders with 8 threads in 0.006721 seconds
found 20 files with 8 threads in 0.058861 seconds
finished sort, time taken 0.000747 seconds
DB_WAIT: _db_ready_proc waited 0.000358 seconds
IPC: execute query: "C:\Example\18-04\"
found 0 folders with 8 threads in 0.011804 seconds
found 6 files with 8 threads in 0.076631 seconds
finished sort, time taken 0.000800 seconds
DB_WAIT: _db_ready_proc waited 0.000361 seconds
IPC: execute query: infolder:"C:\Example\18-04"
found 0 folders with 8 threads in 0.006622 seconds
found 6 files with 8 threads in 0.056516 seconds
finished sort, time taken 0.000803 seconds
DB_WAIT: _db_ready_proc waited 0.000388 seconds
IPC: execute query: "C:\Example\18-05\"
found 0 folders with 8 threads in 0.013221 seconds
found 63 files with 8 threads in 0.088715 seconds
finished sort, time taken 0.000790 seconds
DB_WAIT: _db_ready_proc waited 0.000455 seconds
IPC: execute query: infolder:"C:\Example\18-05"
found 0 folders with 8 threads in 0.006361 seconds
found 63 files with 8 threads in 0.063778 seconds
finished sort, time taken 0.000738 seconds
DB_WAIT: _db_ready_proc waited 0.000405 seconds
IPC: execute query: "C:\Example\18-06\"
found 0 folders with 8 threads in 0.013381 seconds
found 198 files with 8 threads in 0.086756 seconds
finished sort, time taken 0.000789 seconds
DB_WAIT: _db_ready_proc waited 0.000366 seconds
IPC: execute query: infolder:"C:\Example\18-06"
found 0 folders with 8 threads in 0.006041 seconds
found 198 files with 8 threads in 0.064331 seconds
finished sort, time taken 0.000914 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: "C:\Example\18-07\"
found 0 folders with 8 threads in 0.012298 seconds
found 33 files with 8 threads in 0.088182 seconds
finished sort, time taken 0.001064 seconds
DB_WAIT: _db_ready_proc waited 0.000469 seconds
IPC: execute query: infolder:"C:\Example\18-07"
found 0 folders with 8 threads in 0.007307 seconds
found 33 files with 8 threads in 0.088982 seconds
finished sort, time taken 0.001116 seconds
DB_WAIT: _db_ready_proc waited 0.000380 seconds
IPC: execute query: "C:\Example\18-08\"
found 0 folders with 8 threads in 0.016018 seconds
found 2 files with 8 threads in 0.089752 seconds
finished sort, time taken 0.001167 seconds
DB_WAIT: _db_ready_proc waited 0.000548 seconds
IPC: execute query: infolder:"C:\Example\18-08"
found 0 folders with 8 threads in 0.007141 seconds
found 2 files with 8 threads in 0.068821 seconds
finished sort, time taken 0.001042 seconds
DB_WAIT: _db_ready_proc waited 0.000526 seconds
IPC: execute query: "C:\Example\18-09\"
found 0 folders with 8 threads in 0.012667 seconds
found 3 files with 8 threads in 0.085335 seconds
finished sort, time taken 0.000983 seconds
DB_WAIT: _db_ready_proc waited 0.000474 seconds
IPC: execute query: infolder:"C:\Example\18-09"
found 0 folders with 8 threads in 0.006337 seconds
found 3 files with 8 threads in 0.065532 seconds
finished sort, time taken 0.002001 seconds
DB_WAIT: _db_ready_proc waited 0.000546 seconds
IPC: execute query: "C:\Example\18-10\"
found 0 folders with 8 threads in 0.012288 seconds
found 9 files with 8 threads in 0.091261 seconds
finished sort, time taken 0.000960 seconds
DB_WAIT: _db_ready_proc waited 0.000366 seconds
IPC: execute query: infolder:"C:\Example\18-10"
found 0 folders with 8 threads in 0.005981 seconds
found 9 files with 8 threads in 0.070746 seconds
finished sort, time taken 0.001896 seconds
DB_WAIT: _db_ready_proc waited 0.000896 seconds
IPC: execute query: "C:\Example\18-11\"
found 0 folders with 8 threads in 0.015850 seconds
found 7 files with 8 threads in 0.093190 seconds
finished sort, time taken 0.002680 seconds
DB_WAIT: _db_ready_proc waited 0.000436 seconds
IPC: execute query: infolder:"C:\Example\18-11"
processed 4 usn records in 0.000185 seconds
DB_WAIT: db_query_create waited 0.010716 seconds
found 0 folders with 8 threads in 0.006742 seconds
found 7 files with 8 threads in 0.067177 seconds
finished sort, time taken 0.001621 seconds
DB_WAIT: _db_ready_proc waited 0.001545 seconds
IPC: execute query: "C:\Example\18-12\"
processed 11 usn records in 0.000222 seconds
DB_WAIT: db_query_create waited 0.000595 seconds
found 0 folders with 8 threads in 0.013375 seconds
found 3 files with 8 threads in 0.089293 seconds
finished sort, time taken 0.001637 seconds
DB_WAIT: _db_ready_proc waited 0.000432 seconds
IPC: execute query: infolder:"C:\Example\18-12"
found 0 folders with 8 threads in 0.006454 seconds
found 3 files with 8 threads in 0.072888 seconds
finished sort, time taken 0.000866 seconds
DB_WAIT: _db_ready_proc waited 0.000369 seconds
IPC: execute query: "C:\Example\19-01\"
found 0 folders with 8 threads in 0.013281 seconds
found 8 files with 8 threads in 0.082554 seconds
finished sort, time taken 0.000702 seconds
DB_WAIT: _db_ready_proc waited 0.000352 seconds
IPC: execute query: infolder:"C:\Example\19-01"
found 0 folders with 8 threads in 0.007114 seconds
found 8 files with 8 threads in 0.060407 seconds
finished sort, time taken 0.001006 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: "C:\Example\19-02\"
found 0 folders with 8 threads in 0.014228 seconds
found 8 files with 8 threads in 0.090228 seconds
finished sort, time taken 0.000747 seconds
DB_WAIT: _db_ready_proc waited 0.000365 seconds
IPC: execute query: infolder:"C:\Example\19-02"
found 0 folders with 8 threads in 0.005844 seconds
found 8 files with 8 threads in 0.062189 seconds
finished sort, time taken 0.000751 seconds
DB_WAIT: _db_ready_proc waited 0.000430 seconds
IPC: execute query: "C:\Example\19-03\"
found 0 folders with 8 threads in 0.012186 seconds
found 23 files with 8 threads in 0.083839 seconds
finished sort, time taken 0.000776 seconds
DB_WAIT: _db_ready_proc waited 0.000498 seconds
IPC: execute query: infolder:"C:\Example\19-03"
found 0 folders with 8 threads in 0.005839 seconds
found 23 files with 8 threads in 0.067068 seconds
finished sort, time taken 0.000790 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: "C:\Example\19-04\"
found 0 folders with 8 threads in 0.011611 seconds
found 2 files with 8 threads in 0.087448 seconds
finished sort, time taken 0.000885 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: infolder:"C:\Example\19-04"
found 0 folders with 8 threads in 0.007601 seconds
found 2 files with 8 threads in 0.070954 seconds
finished sort, time taken 0.001016 seconds
DB_WAIT: _db_ready_proc waited 0.000477 seconds
IPC: execute query: "C:\Example\19-05\"
processed 2 usn records in 0.000262 seconds
DB_WAIT: db_query_create waited 0.001228 seconds
found 0 folders with 8 threads in 0.018286 seconds
found 23 files with 8 threads in 0.088978 seconds
finished sort, time taken 0.000816 seconds
DB_WAIT: _db_ready_proc waited 0.000371 seconds
IPC: execute query: infolder:"C:\Example\19-05"
found 0 folders with 8 threads in 0.006129 seconds
found 23 files with 8 threads in 0.061123 seconds
finished sort, time taken 0.001301 seconds
DB_WAIT: _db_ready_proc waited 0.000370 seconds
IPC: execute query: "C:\Example\19-06\"
found 0 folders with 8 threads in 0.013416 seconds
found 27 files with 8 threads in 0.085524 seconds
finished sort, time taken 0.001402 seconds
DB_WAIT: _db_ready_proc waited 0.000460 seconds
IPC: execute query: infolder:"C:\Example\19-06"
found 0 folders with 8 threads in 0.006448 seconds
found 27 files with 8 threads in 0.057430 seconds
finished sort, time taken 0.000838 seconds
DB_WAIT: _db_ready_proc waited 0.000538 seconds
IPC: execute query: "C:\Example\19-07\"
found 0 folders with 8 threads in 0.012322 seconds
found 37 files with 8 threads in 0.082326 seconds
finished sort, time taken 0.000850 seconds
DB_WAIT: _db_ready_proc waited 0.000356 seconds
IPC: execute query: infolder:"C:\Example\19-07"
found 0 folders with 8 threads in 0.006548 seconds
found 37 files with 8 threads in 0.065708 seconds
finished sort, time taken 0.000895 seconds
DB_WAIT: _db_ready_proc waited 0.000431 seconds
IPC: execute query: "C:\Example\19-08\"
found 0 folders with 8 threads in 0.012922 seconds
found 24 files with 8 threads in 0.087893 seconds
finished sort, time taken 0.000923 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: infolder:"C:\Example\19-08"
found 0 folders with 8 threads in 0.005911 seconds
found 24 files with 8 threads in 0.061156 seconds
finished sort, time taken 0.001108 seconds
DB_WAIT: _db_ready_proc waited 0.000369 seconds
IPC: execute query: "C:\Example\19-09\"
found 0 folders with 8 threads in 0.011748 seconds
found 36 files with 8 threads in 0.082242 seconds
finished sort, time taken 0.001054 seconds
DB_WAIT: _db_ready_proc waited 0.000495 seconds
IPC: execute query: infolder:"C:\Example\19-09"
found 0 folders with 8 threads in 0.006456 seconds
found 36 files with 8 threads in 0.065049 seconds
finished sort, time taken 0.001609 seconds
DB_WAIT: _db_ready_proc waited 0.001107 seconds
IPC: execute query: "C:\Example\19-10\"
found 0 folders with 8 threads in 0.013780 seconds
found 61 files with 8 threads in 0.078406 seconds
finished sort, time taken 0.000760 seconds
DB_WAIT: _db_ready_proc waited 0.000449 seconds
IPC: execute query: infolder:"C:\Example\19-10"
found 0 folders with 8 threads in 0.006014 seconds
found 61 files with 8 threads in 0.061813 seconds
finished sort, time taken 0.000725 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: "C:\Example\19-11\"
found 0 folders with 8 threads in 0.012572 seconds
found 45 files with 8 threads in 0.087431 seconds
finished sort, time taken 0.001038 seconds
DB_WAIT: _db_ready_proc waited 0.000479 seconds
IPC: execute query: infolder:"C:\Example\19-11"
found 0 folders with 8 threads in 0.006473 seconds
found 45 files with 8 threads in 0.057650 seconds
finished sort, time taken 0.000726 seconds
DB_WAIT: _db_ready_proc waited 0.000357 seconds
IPC: execute query: "C:\Example\19-12\"
found 0 folders with 8 threads in 0.011991 seconds
found 17 files with 8 threads in 0.089461 seconds
finished sort, time taken 0.000748 seconds
DB_WAIT: _db_ready_proc waited 0.000442 seconds
IPC: execute query: infolder:"C:\Example\19-12"
found 0 folders with 8 threads in 0.006544 seconds
found 17 files with 8 threads in 0.060700 seconds
finished sort, time taken 0.000876 seconds
DB_WAIT: _db_ready_proc waited 0.000367 seconds
IPC: execute query: "C:\Example\20-01\"
found 0 folders with 8 threads in 0.012178 seconds
found 18 files with 8 threads in 0.081874 seconds
finished sort, time taken 0.000744 seconds
DB_WAIT: _db_ready_proc waited 0.001303 seconds
IPC: execute query: infolder:"C:\Example\20-01"
found 0 folders with 8 threads in 0.006201 seconds
found 18 files with 8 threads in 0.056312 seconds
finished sort, time taken 0.000710 seconds
DB_WAIT: _db_ready_proc waited 0.000348 seconds
IPC: execute query: "C:\Example\20-02\"
found 0 folders with 8 threads in 0.014783 seconds
found 33 files with 8 threads in 0.083648 seconds
finished sort, time taken 0.000736 seconds
DB_WAIT: _db_ready_proc waited 0.000357 seconds
IPC: execute query: infolder:"C:\Example\20-02"
found 0 folders with 8 threads in 0.005969 seconds
found 33 files with 8 threads in 0.057600 seconds
finished sort, time taken 0.000745 seconds
DB_WAIT: _db_ready_proc waited 0.000360 seconds
IPC: execute query: "C:\Example\20-03\"
found 0 folders with 8 threads in 0.011665 seconds
found 16 files with 8 threads in 0.077243 seconds
finished sort, time taken 0.000724 seconds
DB_WAIT: _db_ready_proc waited 0.000345 seconds
IPC: execute query: infolder:"C:\Example\20-03"
found 0 folders with 8 threads in 0.005848 seconds
found 16 files with 8 threads in 0.056463 seconds
finished sort, time taken 0.000759 seconds
DB_WAIT: _db_ready_proc waited 0.000345 seconds
IPC: execute query: "C:\Example\20-04\"
found 0 folders with 8 threads in 0.013327 seconds
found 21 files with 8 threads in 0.078471 seconds
finished sort, time taken 0.000705 seconds
DB_WAIT: _db_ready_proc waited 0.000362 seconds
IPC: execute query: infolder:"C:\Example\20-04"
found 0 folders with 8 threads in 0.006080 seconds
found 21 files with 8 threads in 0.063805 seconds
finished sort, time taken 0.000716 seconds
DB_WAIT: _db_ready_proc waited 0.000362 seconds
IPC: execute query: "C:\Example\20-05\"
found 0 folders with 8 threads in 0.012504 seconds
found 16 files with 8 threads in 0.084922 seconds
finished sort, time taken 0.000960 seconds
DB_WAIT: _db_ready_proc waited 0.000356 seconds
IPC: execute query: infolder:"C:\Example\20-05"
found 0 folders with 8 threads in 0.006217 seconds
found 16 files with 8 threads in 0.059929 seconds
finished sort, time taken 0.000708 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: "C:\Example\20-06\"
found 0 folders with 8 threads in 0.012526 seconds
found 40 files with 8 threads in 0.082852 seconds
finished sort, time taken 0.000878 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: infolder:"C:\Example\20-06"
found 0 folders with 8 threads in 0.005633 seconds
found 40 files with 8 threads in 0.057928 seconds
finished sort, time taken 0.000742 seconds
DB_WAIT: _db_ready_proc waited 0.000365 seconds
IPC: execute query: "C:\Example\20-07\"
found 0 folders with 8 threads in 0.012580 seconds
found 30 files with 8 threads in 0.080092 seconds
finished sort, time taken 0.000729 seconds
DB_WAIT: _db_ready_proc waited 0.000375 seconds
IPC: execute query: infolder:"C:\Example\20-07"
found 0 folders with 8 threads in 0.006147 seconds
found 30 files with 8 threads in 0.060466 seconds
finished sort, time taken 0.000796 seconds
DB_WAIT: _db_ready_proc waited 0.000350 seconds
IPC: execute query: "C:\Example\20-08\"
found 0 folders with 8 threads in 0.014016 seconds
found 3 files with 8 threads in 0.082738 seconds
finished sort, time taken 0.000720 seconds
DB_WAIT: _db_ready_proc waited 0.000360 seconds
IPC: execute query: infolder:"C:\Example\20-08"
found 0 folders with 8 threads in 0.006160 seconds
found 3 files with 8 threads in 0.059308 seconds
finished sort, time taken 0.000701 seconds
DB_WAIT: _db_ready_proc waited 0.000367 seconds
IPC: execute query: "C:\Example\20-09\"
found 0 folders with 8 threads in 0.012449 seconds
found 47 files with 8 threads in 0.078811 seconds
finished sort, time taken 0.000716 seconds
DB_WAIT: _db_ready_proc waited 0.000379 seconds
IPC: execute query: infolder:"C:\Example\20-09"
found 0 folders with 8 threads in 0.006542 seconds
found 47 files with 8 threads in 0.056723 seconds
finished sort, time taken 0.000722 seconds
DB_WAIT: _db_ready_proc waited 0.000358 seconds
IPC: execute query: "C:\Example\20-10\"
found 0 folders with 8 threads in 0.012722 seconds
found 8 files with 8 threads in 0.076503 seconds
finished sort, time taken 0.000705 seconds
DB_WAIT: _db_ready_proc waited 0.000352 seconds
IPC: execute query: infolder:"C:\Example\20-10"
found 0 folders with 8 threads in 0.005733 seconds
found 8 files with 8 threads in 0.057196 seconds
finished sort, time taken 0.000802 seconds
DB_WAIT: _db_ready_proc waited 0.000351 seconds
IPC: execute query: "C:\Example\20-11\"
found 0 folders with 8 threads in 0.013229 seconds
found 49 files with 8 threads in 0.080489 seconds
finished sort, time taken 0.000962 seconds
DB_WAIT: _db_ready_proc waited 0.000384 seconds
IPC: execute query: infolder:"C:\Example\20-11"
found 0 folders with 8 threads in 0.005889 seconds
found 49 files with 8 threads in 0.058863 seconds
finished sort, time taken 0.000915 seconds
DB_WAIT: _db_ready_proc waited 0.000411 seconds
IPC: execute query: "C:\Example\20-12\"
found 0 folders with 8 threads in 0.011804 seconds
found 41 files with 8 threads in 0.077905 seconds
finished sort, time taken 0.000702 seconds
DB_WAIT: _db_ready_proc waited 0.000345 seconds
IPC: execute query: infolder:"C:\Example\20-12"
found 0 folders with 8 threads in 0.005605 seconds
found 41 files with 8 threads in 0.056695 seconds
finished sort, time taken 0.000734 seconds
DB_WAIT: _db_ready_proc waited 0.000378 seconds
IPC: execute query: "C:\Example\21-01\"
found 0 folders with 8 threads in 0.012453 seconds
found 38 files with 8 threads in 0.076806 seconds
finished sort, time taken 0.000722 seconds
DB_WAIT: _db_ready_proc waited 0.000354 seconds
IPC: execute query: infolder:"C:\Example\21-01"
found 0 folders with 8 threads in 0.006159 seconds
found 38 files with 8 threads in 0.055933 seconds
finished sort, time taken 0.000820 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: "C:\Example\21-02\"
found 0 folders with 8 threads in 0.011711 seconds
found 29 files with 8 threads in 0.076227 seconds
finished sort, time taken 0.001306 seconds
DB_WAIT: _db_ready_proc waited 0.000369 seconds
IPC: execute query: infolder:"C:\Example\21-02"
found 0 folders with 8 threads in 0.006099 seconds
found 29 files with 8 threads in 0.057092 seconds
finished sort, time taken 0.000729 seconds
DB_WAIT: _db_ready_proc waited 0.000366 seconds
IPC: execute query: "C:\Example\21-03\"
found 0 folders with 8 threads in 0.012729 seconds
found 47 files with 8 threads in 0.083601 seconds
finished sort, time taken 0.000722 seconds
DB_WAIT: _db_ready_proc waited 0.000358 seconds
IPC: execute query: infolder:"C:\Example\21-03"
found 0 folders with 8 threads in 0.006084 seconds
found 47 files with 8 threads in 0.057346 seconds
finished sort, time taken 0.000848 seconds
DB_WAIT: _db_ready_proc waited 0.000489 seconds
IPC: execute query: "C:\Example\21-04\"
found 0 folders with 8 threads in 0.011818 seconds
found 22 files with 8 threads in 0.077792 seconds
finished sort, time taken 0.000731 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: infolder:"C:\Example\21-04"
found 0 folders with 8 threads in 0.006371 seconds
found 22 files with 8 threads in 0.058825 seconds
finished sort, time taken 0.000708 seconds
DB_WAIT: _db_ready_proc waited 0.000347 seconds
IPC: execute query: "C:\Example\21-05\"
found 0 folders with 8 threads in 0.014131 seconds
found 24 files with 8 threads in 0.080650 seconds
finished sort, time taken 0.000725 seconds
DB_WAIT: _db_ready_proc waited 0.000354 seconds
IPC: execute query: infolder:"C:\Example\21-05"
found 0 folders with 8 threads in 0.005590 seconds
found 24 files with 8 threads in 0.059590 seconds
finished sort, time taken 0.001258 seconds
DB_WAIT: _db_ready_proc waited 0.000406 seconds
IPC: execute query: "C:\Example\21-06\"
found 0 folders with 8 threads in 0.011180 seconds
found 42 files with 8 threads in 0.082889 seconds
finished sort, time taken 0.000719 seconds
DB_WAIT: _db_ready_proc waited 0.000386 seconds
IPC: execute query: infolder:"C:\Example\21-06"
found 0 folders with 8 threads in 0.006347 seconds
found 42 files with 8 threads in 0.057200 seconds
finished sort, time taken 0.001053 seconds
DB_WAIT: _db_ready_proc waited 0.000365 seconds
IPC: execute query: "C:\Example\21-07\"
found 0 folders with 8 threads in 0.015070 seconds
found 42 files with 8 threads in 0.082303 seconds
finished sort, time taken 0.001169 seconds
DB_WAIT: _db_ready_proc waited 0.000807 seconds
IPC: execute query: infolder:"C:\Example\21-07"
found 0 folders with 8 threads in 0.006548 seconds
found 42 files with 8 threads in 0.061629 seconds
finished sort, time taken 0.000995 seconds
DB_WAIT: _db_ready_proc waited 0.000489 seconds
IPC: execute query: "C:\Example\21-08\"
found 0 folders with 8 threads in 0.013221 seconds
found 104 files with 8 threads in 0.088354 seconds
finished sort, time taken 0.000937 seconds
DB_WAIT: _db_ready_proc waited 0.000367 seconds
IPC: execute query: infolder:"C:\Example\21-08"
found 0 folders with 8 threads in 0.006088 seconds
found 104 files with 8 threads in 0.057716 seconds
finished sort, time taken 0.000701 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: "C:\Example\21-09\"
found 0 folders with 8 threads in 0.013087 seconds
found 54 files with 8 threads in 0.082508 seconds
finished sort, time taken 0.000726 seconds
DB_WAIT: _db_ready_proc waited 0.000376 seconds
IPC: execute query: infolder:"C:\Example\21-09"
found 0 folders with 8 threads in 0.005848 seconds
found 54 files with 8 threads in 0.059217 seconds
finished sort, time taken 0.001512 seconds
DB_WAIT: _db_ready_proc waited 0.000367 seconds
IPC: execute query: "C:\Example\21-10\"
found 0 folders with 8 threads in 0.012868 seconds
found 79 files with 8 threads in 0.081191 seconds
finished sort, time taken 0.000706 seconds
DB_WAIT: _db_ready_proc waited 0.000385 seconds
IPC: execute query: infolder:"C:\Example\21-10"
found 0 folders with 8 threads in 0.005626 seconds
found 79 files with 8 threads in 0.060723 seconds
finished sort, time taken 0.000882 seconds
DB_WAIT: _db_ready_proc waited 0.000442 seconds
IPC: execute query: "C:\Example\21-11\"
found 0 folders with 8 threads in 0.013470 seconds
found 61 files with 8 threads in 0.090512 seconds
finished sort, time taken 0.000703 seconds
DB_WAIT: _db_ready_proc waited 0.000377 seconds
IPC: execute query: infolder:"C:\Example\21-11"
found 0 folders with 8 threads in 0.006475 seconds
found 61 files with 8 threads in 0.063955 seconds
finished sort, time taken 0.000949 seconds
DB_WAIT: _db_ready_proc waited 0.000454 seconds
IPC: execute query: "C:\Example\21-12\"
found 0 folders with 8 threads in 0.013394 seconds
found 54 files with 8 threads in 0.091112 seconds
finished sort, time taken 0.001080 seconds
DB_WAIT: _db_ready_proc waited 0.000488 seconds
IPC: execute query: infolder:"C:\Example\21-12"
found 0 folders with 8 threads in 0.006894 seconds
found 54 files with 8 threads in 0.066331 seconds
finished sort, time taken 0.000732 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: "C:\Example\22-01\"
found 0 folders with 8 threads in 0.012170 seconds
found 71 files with 8 threads in 0.091099 seconds
finished sort, time taken 0.001016 seconds
DB_WAIT: _db_ready_proc waited 0.000429 seconds
IPC: execute query: infolder:"C:\Example\22-01"
found 0 folders with 8 threads in 0.008090 seconds
found 71 files with 8 threads in 0.070308 seconds
finished sort, time taken 0.001048 seconds
DB_WAIT: _db_ready_proc waited 0.000432 seconds
IPC: execute query: "C:\Example\22-02\"
found 0 folders with 8 threads in 0.014371 seconds
found 20 files with 8 threads in 0.102003 seconds
finished sort, time taken 0.000948 seconds
DB_WAIT: _db_ready_proc waited 0.000475 seconds
IPC: execute query: infolder:"C:\Example\22-02"
found 0 folders with 8 threads in 0.006143 seconds
found 20 files with 8 threads in 0.063408 seconds
finished sort, time taken 0.000852 seconds
DB_WAIT: _db_ready_proc waited 0.000420 seconds
IPC: execute query: "C:\Example\22-03\"
found 0 folders with 8 threads in 0.012326 seconds
found 114 files with 8 threads in 0.083640 seconds
finished sort, time taken 0.000934 seconds
DB_WAIT: _db_ready_proc waited 0.000550 seconds
IPC: execute query: infolder:"C:\Example\22-03"
found 0 folders with 8 threads in 0.005962 seconds
found 114 files with 8 threads in 0.062886 seconds
finished sort, time taken 0.000948 seconds
DB_WAIT: _db_ready_proc waited 0.000525 seconds
IPC: execute query: "C:\Example\22-04\"
found 0 folders with 8 threads in 0.012510 seconds
found 12 files with 8 threads in 0.084022 seconds
finished sort, time taken 0.000867 seconds
DB_WAIT: _db_ready_proc waited 0.000427 seconds
IPC: execute query: infolder:"C:\Example\22-04"
found 0 folders with 8 threads in 0.006365 seconds
found 12 files with 8 threads in 0.061127 seconds
finished sort, time taken 0.000721 seconds
DB_WAIT: _db_ready_proc waited 0.000425 seconds
IPC: execute query: "C:\Example\22-05\"
found 0 folders with 8 threads in 0.016025 seconds
found 37 files with 8 threads in 0.095364 seconds
finished sort, time taken 0.001095 seconds
DB_WAIT: _db_ready_proc waited 0.000469 seconds
IPC: execute query: infolder:"C:\Example\22-05"
found 0 folders with 8 threads in 0.006002 seconds
found 37 files with 8 threads in 0.062878 seconds
finished sort, time taken 0.000875 seconds
DB_WAIT: _db_ready_proc waited 0.000366 seconds
IPC: execute query: "C:\Example\22-06\"
found 0 folders with 8 threads in 0.013047 seconds
found 47 files with 8 threads in 0.087147 seconds
finished sort, time taken 0.000759 seconds
DB_WAIT: _db_ready_proc waited 0.000360 seconds
IPC: execute query: infolder:"C:\Example\22-06"
found 0 folders with 8 threads in 0.005752 seconds
found 47 files with 8 threads in 0.058418 seconds
finished sort, time taken 0.000871 seconds
DB_WAIT: _db_ready_proc waited 0.000999 seconds
IPC: execute query: "C:\Example\22-07\"
found 0 folders with 8 threads in 0.013841 seconds
found 156 files with 8 threads in 0.078479 seconds
finished sort, time taken 0.000815 seconds
DB_WAIT: _db_ready_proc waited 0.001299 seconds
IPC: execute query: infolder:"C:\Example\22-07"
found 0 folders with 8 threads in 0.006435 seconds
found 156 files with 8 threads in 0.062288 seconds
finished sort, time taken 0.000129 seconds
DB_WAIT: _db_ready_proc waited 0.000967 seconds
IPC: execute query: "C:\Example\22-08\"
found 0 folders with 8 threads in 0.014578 seconds
found 37 files with 8 threads in 0.094555 seconds
finished sort, time taken 0.000807 seconds
DB_WAIT: _db_ready_proc waited 0.000381 seconds
IPC: execute query: infolder:"C:\Example\22-08"
found 0 folders with 8 threads in 0.006663 seconds
found 37 files with 8 threads in 0.064283 seconds
finished sort, time taken 0.000968 seconds
DB_WAIT: _db_ready_proc waited 0.000467 seconds
IPC: execute query: "C:\Example\22-09\"
found 0 folders with 8 threads in 0.012313 seconds
found 17 files with 8 threads in 0.088782 seconds
finished sort, time taken 0.000762 seconds
DB_WAIT: _db_ready_proc waited 0.000366 seconds
IPC: execute query: infolder:"C:\Example\22-09"
found 0 folders with 8 threads in 0.006542 seconds
found 17 files with 8 threads in 0.063164 seconds
finished sort, time taken 0.000583 seconds
DB_WAIT: _db_ready_proc waited 0.000420 seconds
IPC: execute query: "C:\Example\22-10\"
processed 13 usn records in 0.000286 seconds
DB_WAIT: db_query_create waited 0.000559 seconds
found 0 folders with 8 threads in 0.014282 seconds
found 4 files with 8 threads in 0.084474 seconds
finished sort, time taken 0.000909 seconds
DB_WAIT: _db_ready_proc waited 0.000428 seconds
IPC: execute query: infolder:"C:\Example\22-10"
found 0 folders with 8 threads in 0.007763 seconds
found 4 files with 8 threads in 0.061211 seconds
finished sort, time taken 0.000807 seconds
DB_WAIT: _db_ready_proc waited 0.000504 seconds
IPC: execute query: "C:\Example\22-11\"
found 0 folders with 8 threads in 0.013376 seconds
found 9 files with 8 threads in 0.086157 seconds
finished sort, time taken 0.000773 seconds
DB_WAIT: _db_ready_proc waited 0.000376 seconds
IPC: execute query: infolder:"C:\Example\22-11"
found 0 folders with 8 threads in 0.006056 seconds
found 9 files with 8 threads in 0.065038 seconds
finished sort, time taken 0.001290 seconds
DB_WAIT: _db_ready_proc waited 0.000457 seconds
IPC: execute query: "C:\Example\22-12\"
found 0 folders with 8 threads in 0.012926 seconds
found 6 files with 8 threads in 0.079802 seconds
finished sort, time taken 0.001119 seconds
DB_WAIT: _db_ready_proc waited 0.000398 seconds
IPC: execute query: infolder:"C:\Example\22-12"
found 0 folders with 8 threads in 0.007121 seconds
found 6 files with 8 threads in 0.060154 seconds
finished sort, time taken 0.000748 seconds
DB_WAIT: _db_ready_proc waited 0.000351 seconds
IPC: execute query: "C:\Example\23-01\"
found 0 folders with 8 threads in 0.014719 seconds
found 4 files with 8 threads in 0.078479 seconds
finished sort, time taken 0.000714 seconds
DB_WAIT: _db_ready_proc waited 0.000350 seconds
IPC: execute query: infolder:"C:\Example\23-01"
found 0 folders with 8 threads in 0.006486 seconds
found 4 files with 8 threads in 0.057870 seconds
finished sort, time taken 0.001110 seconds
DB_WAIT: _db_ready_proc waited 0.000364 seconds
IPC: execute query: "C:\Example\23-03\"
found 0 folders with 8 threads in 0.014024 seconds
found 6 files with 8 threads in 0.087051 seconds
finished sort, time taken 0.000708 seconds
DB_WAIT: _db_ready_proc waited 0.000363 seconds
IPC: execute query: infolder:"C:\Example\23-03"
found 0 folders with 8 threads in 0.005863 seconds
found 6 files with 8 threads in 0.058386 seconds
finished sort, time taken 0.000704 seconds
DB_WAIT: _db_ready_proc waited 0.000381 seconds
IPC: execute query: "C:\Example\23-04\"
found 0 folders with 8 threads in 0.011531 seconds
found 23 files with 8 threads in 0.080317 seconds
finished sort, time taken 0.000704 seconds
DB_WAIT: _db_ready_proc waited 0.000408 seconds
IPC: execute query: infolder:"C:\Example\23-04"
found 0 folders with 8 threads in 0.006515 seconds
found 23 files with 8 threads in 0.060674 seconds
finished sort, time taken 0.000843 seconds
DB_WAIT: _db_ready_proc waited 0.000373 seconds
IPC: execute query: "C:\Example\23-05\"
found 0 folders with 8 threads in 0.012965 seconds
found 24 files with 8 threads in 0.081744 seconds
finished sort, time taken 0.001717 seconds
DB_WAIT: _db_ready_proc waited 0.000981 seconds
IPC: execute query: infolder:"C:\Example\23-05"
found 0 folders with 8 threads in 0.006747 seconds
found 24 files with 8 threads in 0.059458 seconds
finished sort, time taken 0.001666 seconds
DB_WAIT: _db_ready_proc waited 0.000614 seconds
Total size shouldn't be relevant. Number of files/folders in and below the folder is what matters.
What do you see if you look at the Windows directory, for example?
The Windows directory is the same as the directory in the video I posted. It's the same in any directory I've tried. If you look at the log, there's just a couple of files in these directories. The speed remains the same no matter what directory.
The log shows that each folder is queried, twice. For 66 folders, that's 132 queries compared to 1 query with Total Commander. With a large large database, it takes slightly longer to evaluate each of these queries. For it to be instant on my sytem given the size of the database, there can't be more than 6 queries at a time.
sorry, but i have the same issue (from many betas ago) - calculating sizes with EveryThing 1.5 turned on is very slow. ET search is instant, alpha=false, all my folders (with their size) are already indexed in my Everything database...
The time per query must be negligible, or it would be slow for everyone. The overhead will be somewhere else.
Try with Everything 1.4, maybe. It's the only version we can officially support at the moment, and the version we have tested with.
@Leo I'm not sure how you come to that conclusion. Did you look at the "Everything Debug Log" I posted? It contains the time that it took Everything to execute each of the IPC queries when entering a directory with Dopus. In my case, that's 11 seconds in total for a directory with 66 folders (the one from the video).
It's not slow for everyone because it depends on the size of the database (possibly hardware too). I have also tried it with the 1.4 version of Everything. When I only include a small drive with 200k files, I get instant folder sizes in Opus, when I add a large drive with 15 million files, it's slow. However, the main reason that it's slow is not because Everything can't handle so many files, it's because Opus asks Everything 132 questions instead of just one! I think that makes a lot of sense, especially as the log confirms the IPC query times. The time per query is negligible, but the time per 132 queries is not.
@fkast From your video it seems like Opus isn't using Everything to calculate the folder sizes, because when using Everything it will show the final size immediately without any changes. Try unchecking the first option "Calculate folder sizes automatically fo" and try again.
I installed Everything v1.4.1.1024 for testing, and it is indeed much faster than v1.5a for dozens of folders, but it is still relatively slow for hundreds of folders.
without changes
I initially thought that it wasn't using Everything because of how it looked in the video but when I set the options like you have, Dopus uses both methods to get the folder sizes. It seems like it calculates the folder size until/unless it got a response from Everything.
I hope this issue will be addressed in a future update, but in some cases, enabling both options helps with small folders as it doesn't have wait for Everything to respond, while Everything is still faster for large folders.
@Jon Did you consider adding an option for users who have indexed folder sizes to use the following search query to get all the folder sizes in the current folder in just one query? It would help speed things up a lot.
folder:parent:"C:\Example"
Everything is so fast at searching it can show the results as you type each letter. If there's a huge per-query overhead based on the index size, that should mean it would lag on your system when typing into Everything itself. (Assuming each keypress causes a new query.) Is that the case?
It seems unlikely to me, but I might be wrong.
Yes, the per-query overhead is significant when it is not just one query (and the index is very large). You didn't have a look at the log I posted?
Would you mind and check if the drivers installed on the disk are the following 3 and nothing more:
disk.sys, EhStorClass.sys, partmgr.sys
You can find that in Device Manager -> Disk Drives (select the one you're using for Everything) then Tab of Drivers and then Driver Details.
I used to have a software running called Comodo Firewall and Comodo Backup that installed some drivers for all my disks and that slowed everything (not the program) down.
I did look into it, the problem is at the moment Opus needs to be able to know separately the counts that are direct children of the folder and the total of all nested children, which the folder: query doesn't provide.
Thanks, I've checked and it only shows the 3 drivers you listed.
In Everything 1.5a, there are columns for this: "child-count" for direct children and "descendant-count" for all children. Maybe you could try this query to see if you get the necessary results:
folder:parent:"C:\Example\" addcol:child-count: addcol:descendant-count:
We can't use Everything 1.5 until it's out of alpha and has a published API.
As you know, 1.5a also works just fine with Dopus. Maybe it would be possible to add an advanced setting to enable this different type of query for users of that version. If the query works as expected (please try), it would solve the performance problem for everyone who has performance issues with a large index.
Edit: Well, I think it doesn't support access to any of the 1.5a columns via the SDK. It would still be useful to have instant folder sizes using a single folder:parent:"C:\Example\" query as long as there's no "count" columns enabled.
I guess I will have to find time to read this discussion. I never was able to get the size to work right in beta or in the current release. It is so slow and some times doesn't even sort correctly.
Edit: I don't know about you guys but my everything uses a gig of ram... I have so many files and drives on my network
