Quote:
Originally Posted by
hburnswell
The files will be used as a one time read of the txt files. There will not be ongoing reads/writes.
That is not the problem, though:
Quote:
Originally Posted by Corona688
It's a very bad idea to put 90,000 files in one directory. Creating or deleting files inside that folder will become very slow.
This could happen
during the move, because moving a file counts. Anything which alters the output of 'ls' is altering the directory entry, which is what slows down. Moving the first few thousand files will happen lickety-split, but it will quickly bog down. It could take hours or days to move them all. That's
why those files have been split into a tree of folders, to avoid this. All for an operation you say you're going to be doing what -- once? What will you do with them after -- leave them sitting forever, or delete them? Deleting that massive pile of files will take a similarly awful amount of time.
Strangely, "ongoing reads/writes" usually aren't a problem. Creating
one file isn't so bad... Opening
one file isn't so bad... Which is how people end up with folders full of 90,000 files -- something logging or recording for years and years without cease in the same place. Someday they need to delete them all, and find themselves in big trouble. We regularly get threads like this.
So, let me repeat my question:
Quote:
What is your actual goal here? I don't mean "moving the files". Why are you moving the files? If we can find a way to accomplish your ask without dumping 90,000 files in one directory you'll be much better off.
Please tell us why you think you need 90,000 files in one place. What could you do with them all in one place, that you can't do now?