copying file information using awk & grep

10-09-2011

Registered User

111, 0

Join Date: Oct 2011

Last Activity: 7 October 2012, 2:47 PM EDT

Posts: 111

Thanks Given: 23

Thanked 0 Times in 0 Posts

copying file information using awk & grep

Hi,

TASK 1:
I have been using this code to print the information of files kept at "/castor/cern.ch/user/s/sudha/forPooja" in some text file name FILE.txt.

Code:

rfdir /castor/cern.ch/user/s/sudha/forPooja | grep data | awk '{print "rfio:///castor/cern.ch/user/s/sudha/forPooja/"$9}' > FILE.txt

Need to mention that "rfdir" is special command in my work. It works same as "ls".

Code, which I am working.
I have some script :

Code:

#!/bin/bash
SOURCEPATH=$1
TARGETPATH=$2
GREP=$3
echo "Copying \"$1 | grep $3\" to $2"
for FILE in `nsls $SOURCEPATH | grep $GREP`
do
        if [ -f $TARGETPATH/$FILE ]; then
                echo "Skipping $FILE."
        else
                echo "Copying $FILE ..."
                awk '{print "$2"$9}' > $2
#               rfcp $SOURCEPATH/$FILE $TARGETPATH
        fi
done

TASK 2 :
In addition, I have a script which does the rest of the part

Code:

#!/bin/bash

split -10 **.txt chunk
i=0
for file in chunk*
do
    ((i=i+1))
    new_file="datafilename"$i".list"

    #sed '/^$/d' $file > $new_file
    #or use the perl command
    perl -0pe 's/\n$//' $file >  $new_file

    #to remove the processed file
    rm -rf $file
    echo 'succesful'
done

Here in this code, I am using that FILE.txt .

It would be really useful if I have single script doing both.
Thanks in advance
pooja.

nrjrasaxena

View Public Profile for nrjrasaxena

Find all posts by nrjrasaxena

Shell Programming and Scripting