06-18-2010
Yea see that works the problem is I have no way to limit what find picks for files. The directory has 100,000 files with names like.
1276675022.1276721280
So the whole problem is avoiding the arguement list too long problem. When executing copies and moves. Currently I just have to guess and do things like
mv 12766* and hope that it isn't too many files with that name, if it is then I just expand out 1 more digit and try to get as many as I can. Eventually I get them all.
There are no subdirectories or files of other types its all purely log files and how many is entirely dependant on the box and they only get this way in a failed state. So the directory always has 10's of thousands of log files that I have to move.
If i'm able to do a mv command and combine that with head -1000 then that is the only automated way I can avoid arguement list too long problems. Least the only way i've come up with.
My manual system works but its incredibly sucky and time consuming. I have to just keep scrolling through history and slightly altering numbers dozens upon dozens of times.
Its Freebsd with bash BTW.
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
how can I automatically check if important files exist in a directory and if not, automatically put the important files where they are needed
say, I want to put .bashrc and a dozen other important files like it into every user's directory, how can I do this??? how do I check every user's... (4 Replies)
Discussion started by: TRUEST
4 Replies
2. UNIX for Dummies Questions & Answers
I would like automate the process of copying some logs files from a server to my local hard drive at a set time each week/day.
I don't really know anything about creating and scheduling jobs. Is this something I could setup relatively easily?
I would like to automatically copy all the logs... (1 Reply)
Discussion started by: Sepia
1 Replies
3. UNIX for Advanced & Expert Users
I am userB and have a dir
/temp1
This dir is owned by me.
How do I recursively copy files from another users's dir userA?
I need to preserve the original user who created files, original group information, original create date, mod date etc.
I tried
cp -pr /home/userA/* .
... (2 Replies)
Discussion started by: Hangman2
2 Replies
4. Shell Programming and Scripting
I am new to shell scripting and need to write a program to copy files that are posted as links on a specific url. I want all the links copied with the same file name and the one posted on the webpage containing the url onto a specific directory. That is the first part. The second part of the script... (2 Replies)
Discussion started by: libertyforall
2 Replies
5. Shell Programming and Scripting
Hi All,
I am doing this for svn patch making. I got the list of files to make the patch. I have the list in a file with path of all the files.
To Do
From Directory : /myproject/MainDir
To Directory : /myproject/data
List of files need to copy is in the file: /myproject/filesList.txt
... (4 Replies)
Discussion started by: linuxadmin
4 Replies
6. Shell Programming and Scripting
I am in a situation where I have some hundreds of thousands of files in a directory (name of directory: big_directory). Now, working on this directory is extremely slow.
I now plan to do this:
Copy 1000 files in each of the directories by creating the directories automatically. All files have... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies
7. OS X (Apple)
I'm looking to find/create a script so that when a download is complete, I can run the script in order for it to automatically move a file such as...
'example.avi' into my videos folder
I'm a novice when it comes to scripting, any advice/help would be greatly appreciated!
Thanks
Andrew (10 Replies)
Discussion started by: abudis
10 Replies
8. Shell Programming and Scripting
Here is the script I want to run to deleted log files after a certain time:
touch /usr/WebSphere/AppServer/profiles/AppSrv01/apps/RSA/logs
find /usr/WebSphere/AppServer/profiles/AppSrv01/apps/RSA/logs -atime +120 - exec rm -rf {}\;
Exerytime I run it, it throws me the error:
find: paths must... (2 Replies)
Discussion started by: lennyz04
2 Replies
9. Shell Programming and Scripting
Hi,
I have a huge structure of directories and subdirectories contsining some data. The lowest folders contain a file "image.png" which need to be converted to "folder.jpg". But how can I do that for all these files automatically? That's what I alredy have
find /path -type f -name... (1 Reply)
Discussion started by: KarlKarpfen
1 Replies