batching files

Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers batching files
# 15  
Old 03-28-2002

Thanx UNIX Guru, u are just too good.

One more question ?

Does Cpio actually copies all the desired files to the new file.
How does it actually work.

I have gone thru the man pages , but wasn't of much help.

Thanx in advance
# 16  
Old 03-29-2002

When I used the cpio option , it actually didn't help me much.
I first cahnged to the directory which contains the new moved files
and then I used the command provided by you.

It gave me an Error Message:

/home/arbor>ls | cpio -oO /tmp/R00HAA.cpio
cpio: illegal option -- O
Usage: cpio -o[aAcBvxCh] [-e warn|force|ignore] <name-list >collection
cpio -i[BcdmPrtuvfsSbx6RU] [pattern ...] <collection
cpio -p[adlmruvxU] [-e warn|force|ignore] directory <name-list

Please let me know if I am going wrong somewhere.

# 17  
Old 03-29-2002
First of all, when it comes to learning commands, only use the man pages if you cant find the definition somewhere else in a unix book. I personally dont use man pages unless I have to. man pages certainly is not the easiest thing to understand. I never refer nobody to a man page unless I checked it out my self and found it to be very helpful. try spending time online looking for definitions if you cant get a hold of a book

anyway, about that cpio thing. did you type a small letter o and a big letter O or did you mistakenly type number 0???

these characters look quite similar so be careful.

get in the directory where your wanted files are in and try this command:

ls | cpio -o > (name of file you want to back it up in)

to extract the files, do: cpio -i (name of file you backed up your files in)

that should work, if it dont then use tar instead.

if my linux pc was connected to the internet, I'd be a lot helpful to you but I goto reboot to access my linux system.
# 18  
Old 03-31-2002
Thanx for all your help and suggestions.

I think I cannot have a better Guru than you.

Can you please suggest me the efficient way of doing my task.

Basically I have got all my Files in my directory, Right .
Then I want them to be in a particular file ( You suggested I use tar).

Now I want to ftp across to some other server , OK ?

And that server just has the utility of GZIP. so Looks to me like then this won't work.

Basically what I want is put all my files in a single file and then Gzip that file and send it across by ftp.

Can you suggest me how this task is possible ?????

Your help & suggestions will be highly appreciated.
# 19  
Old 03-31-2002
What operating system are you using?? I dont know much about other operating systems except for Linux and little knowledge of solaris

anyway, I would suggest you use the tar method I showed you earlier. When you have already backed up the wanted files to a file, then you simply do this:

type: gzip (the file containing the wanted files)
type: ls
look for the file name you just gzipped and it should have a .gz attached to it

through ftp, log onto the server and go to the specific directory or place you want to transfer the file onto.

type: put (name of the gzipped file that has .gz attached to it)

that should do it

and by the way, using tar will certainly work with gzip and also, I hope you know your way around the ftp system cause that sure would help you deliver the file safely to where you want it delivered. are you familiar with the ftp commands??? if not, when you type ftp at the command prompt, you get a prompt that looks like this ftp>

now, you can type help at the ftp prompt and that will help you with the commands you need to accomplish what you want

ftp> help
# 20  
Old 03-31-2002
Hi ,
Thanx alot.

Now One more question .

When I had tared the files , and later wanted to extract them it shows me the complete pathname , something like this

x /home/R00h_ph_files/PH_TEST/PH0030012301544700000AF-005, 13950 bytes, 28 tape blocks
x /home/R00h_ph_files/PH_TEST/PH0030012301544700000AF-006, 15023 bytes, 30 tape blocks
x /home/R00h_ph_files/PH_TEST/PH0030012301544700000AF-007, 13272 bytes, 26 tape blocks

Is it possible that it just shows the names of the file rather than the whole path.

I could see the same thing even when the files were archived.
Why does it show the complete path of the file from where it is archived.

# 21  
Old 03-31-2002
situations like this would require the use of awk. I really dont think you can cut off some of the path. i really am not sure about that.

can you access the files after you tared them??? if you can, then dont worry about the long file names. all you have to do to access the files is type whatever command you want to type and the name of the files. (that is if you are in the same directory the files are in)

anyway, if you want to just get rid of every other thing but the pathnames of your file. try this command

get in the directory you xtracted the file into and type this

after typing whatever command you used to extract the files, then pipe it with this: awk '{print $2}'


tar xvf sowhat.tar | awk '{print $2}'
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

2. Shell Programming and Scripting

Shell script for field wise record count for different Files .csv files

Hi, Very good wishes to all! Please help to provide the shell script for generating the record counts in filed wise from the .csv file My question: Source file: Field1 Field2 Field3 abc 12f sLm 1234 hjd 12d Hyd 34 Chn My target file should generate the .csv file with the... (14 Replies)
Discussion started by: Kirands
14 Replies

3. Shell Programming and Scripting

Append string to all the files inside a directory excluding subdirectories and .zip files

Hii, Could someone help me to append string to the starting of all the filenames inside a directory but it should exclude .zip files and subdirectories. Eg. file1: test1.log file2: test2.log file3 After running the script file1: string_test1.log file2: string_test2.log file3:... (4 Replies)
Discussion started by: Ravi Kishore
4 Replies

4. Shell Programming and Scripting

How to create zip/gz/tar files for if the files are older than particular days in UNIX or Linux?

I need a script file for backup (zip or tar or gz) of old log files in our unix server (causing the space problem). Could you please help me to create the zip or gz files for each log files in current directory and sub-directories also? I found one command which is to create gz file for the... (4 Replies)
Discussion started by: Mallikgm
4 Replies

5. Shell Programming and Scripting

newbie needs help batching awk, tabitha

Hi guys, I need a little help learning to batch an awk script. All the examples I found on line are too complicated for me. Here's the awk command that I want to run on lots of files. awk 'NR==FNR{a=$0;next$3 in a{print $0 a " " a}' inputfile_A_1.out inputfile_B_1.out > outputfile1.txt ... (11 Replies)
Discussion started by: atjurhs
11 Replies

6. Shell Programming and Scripting

need a shell script to extract the files from source file and check whether those files existonserve

Hi, I am new to shell scripting.Please help me on this.I am using solaris 10 OS and shell i am using is # echo $0 -sh My requirement is i have source file say makefile.I need to extract files with extensions (.c |.cxx |.h |.hxx |.sc) from the makefile.after doing so i need to check whether... (13 Replies)
Discussion started by: muraliinfy04
13 Replies

7. UNIX for Dummies Questions & Answers

write a program in c in unix that display the files(includ sub-direc and files within) in a sorted

the sorting is based on name of file, file size modification time stamps o f file it should dislay the output in the following format "." and ".." enteries should be ignored please give some idea how to do it (1 Reply)
Discussion started by: pappu kumar jha
1 Replies

8. Shell Programming and Scripting

How to retrieve all the linked script files/ctl files/sql files?

Hi I am going to migrate our datawarehouse system from HP Tru 64 Unix to the Red Hat Linux. Inside the box, it is running around 40 cron jobs; inside each cron job, it is calling other shell script files, and the shell script files may again call other shell script files or ctl files(for... (1 Reply)
Discussion started by: franksubramania
1 Replies

9. Shell Programming and Scripting

Grep causing long delay (batching) whilst piping

Hi all. I have a problem at work which I have managed to break down into a simple test scenario: I have written a monitoring script that outputs every second the status of various processes, but for now, lets just print the date while true do date sleep 1 done This... (9 Replies)
Discussion started by: spudtheimpaler
9 Replies

10. Shell Programming and Scripting

batching files together

I'm looking after part of an application which batches up files concatanates them together and then moves the concatanated files to another directory. The problem I have is that the box runs Windows 2003 and UNIX shell emulation is provided by MKS Toolkit, when 10,000 or more files arive in the... (1 Reply)
Discussion started by: pookie
1 Replies
Login or Register to Ask a Question