Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: copying file information using awk & grep
Top Forums Shell Programming and Scripting copying file information using awk & grep Post 302562950 by nrjrasaxena on Sunday 9th of October 2011 11:37:25 AM
Old 10-09-2011
Hi,

No, the code is not working
Code:
#!/bin/bash

SOURCEPATH=$1
TARGETPATH=$2
search=$3
for file in $SOURCEPATH/*${search}* 
do
        file_name=$(basename $file)
        test -f $TARGETPATH/$file && continue
        echo "rfio://$SOURCEPATH/$file_name" >> FILE.txt
        cp $SOURCEPATH/$file_name $TARGETPATH
done

Error mesage is following
Code:
[lxplus427] /afs/cern.ch/user/p/pooja/test > ./pooja.sh /castor/cern.ch/user/s/sudha/forPooja FILE.txt data
cp: cannot stat `/castor/cern.ch/user/s/sudha/forPooja/*data*': No such file or directory
[lxplus427] /afs/cern.ch/user/p/pooja/test >

Actually, the problem is with the source directory. It is special one and normal command does not work there. As i mentioned "rfdir == ls" similarly, "rfcp == cp"

I have some hint, find below the working code (1.sh) which copy the root files kept in the "/castor/cern.ch/user/s/sudha/forPooja" to some target folder.
Code:
#!/bin/bash
SOURCEPATH=$1
TARGETPATH=$2
GREP=$3

echo "Copying \"$1 | grep $3\" to $2"

for FILE in `nsls $SOURCEPATH | grep $GREP`
do
        if [ -f $TARGETPATH/$FILE ]; then
                echo "Skipping $FILE."
        else
                echo "Copying $FILE ..."
                rfcp $SOURCEPATH/$FILE $TARGETPATH
        fi
done

I execute it following way
[code]
$./1.sh /castor/cern.ch/user/s/sudha/forPooja/ data /afs/cern.ch/user/p/pooja/

Thanks
pooja..

---------- Post updated at 10:37 AM ---------- Previous update was at 03:54 AM ----------

Hi,
I have a request, could you please explain me the meaning of these command lines.
Code:
for file in $SOURCEPATH/*${search}* 
do
        file_name=$(basename $file)
        test -f $TARGETPATH/$file_name && continue
        echo "rfio://$TARGETPATH/$file_name" >> FILE.txt
        cp $SOURCEPATH/$file_name $TARGETPATH
done


I did not understand the usage of these 2 lines:
Code:
  file_name=$(basename $file)
        test -f $TARGETPATH/$file_name && continue

waiting..
pooja..
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Copying file names returned from a grep command into another directory

When I do the following : grep -l "string" *, I get a list of file names returned. Is there a way to copy the files returned from the list into another directory ?. Thanks. (4 Replies)
Discussion started by: Kartheg
4 Replies

2. Shell Programming and Scripting

grep & awk

Hi all, I'm figuring on how to grep only specific data I want below: Bin Total % ----- ------- ----- 1 15 42.9 Bin Total % ----- ------- ----- 2 15 ... (3 Replies)
Discussion started by: *Jess*
3 Replies

3. Shell Programming and Scripting

awk (gawk) grep & columns

Hi, I'm working with gawk (on DOS) today. A goal is: find a string for-instance '123', cut a line in two columns and write second one. The problem is: command line works OK, awk file doesn't. But I would like to work with file because there are many strings to find. input: line command: awk... (4 Replies)
Discussion started by: frajer
4 Replies

4. Shell Programming and Scripting

Copying Information from One File to Another File in Shell

Hello, I'm new to scripting and I need help moving text from one file to another file. Here are examples what the files look like. File 1: Ac-223 2.10m A 1 0 0 0 Fr-219 358 9.9000E-01 0 0.0 0 0.0 0 0.0... (1 Reply)
Discussion started by: tamachan414
1 Replies

5. Shell Programming and Scripting

Grep'ing information from a log file on SUN OS 5

Hi Guys, I'm trying to write an script that will be launched by a user. The script will look at a log file and check for alerts with the date (supplied by user) and a machine's hostname (also supplied by the user). I'm trying to get the output formatted just like the log file. The logfile looks... (5 Replies)
Discussion started by: illgetit
5 Replies

6. Shell Programming and Scripting

Copying the Header & footer Information to the Outfile.

Hi I am writing a perl script which checks for the specific column values from a file and writes to the OUT file. So the feed file has a header information and footer information. I header information isaround107 lines i.e. Starts with START-OF-FILE ....... so on .... ... (11 Replies)
Discussion started by: filter
11 Replies

7. UNIX for Dummies Questions & Answers

Grep? - using a file of terms to search another file when the information is on a different line

I have a flat file that looks like this, let's call it Chromosome_9.txt: FT /Gene_Name="Guanyl-Acetylase 9" FT /Gene_Number"36952" FT /Gene_Name="Endoplasmic Luciferase" FT /Gene_Number"36953" FT ... (4 Replies)
Discussion started by: Twinklefingers
4 Replies

8. Shell Programming and Scripting

Include information in certain columns using grep and awk

HI all, I have data in a file that looks like this: 1 HOW _ NNP NNP _ 3 nn _ _ 2 DRUGS _ NNP NNP _ 3 nn _ _ 3 ACT _ NNP NNP _ 0 null _ _ 4 : _ ... (3 Replies)
Discussion started by: owwow14
3 Replies

9. Shell Programming and Scripting

sed / awk / grep to extract information from log

Hi all, I have a query that runs that outputs data in the following format - 01/09/12 11:43:40,ADMIN,4,77,Application Group Load: Name(TESTED) LoadId(5137-1-0-1XX-15343-15343) File(/dir/dir/File.T03.CI2.RYR.2012009.11433350806.ARD) InputSize(5344) OutputSize(1359) Rows(2) Time(1.9960)... (8 Replies)
Discussion started by: jeffs42885
8 Replies

LEARN ABOUT CENTOS

sestatus.conf

sestatus.conf(5)					    sestatus configuration file 					  sestatus.conf(5)

NAME

       sestatus.conf - The sestatus(8) configuration file.

DESCRIPTION

       The sestatus.conf file is used by the sestatus(8) command with the -v option to determine what file and process security contexts should be
       displayed.

       The fully qualified path name of the configuration file is:
	      /etc/sestatus.conf

       The file consists of two optional sections as described in the FILE FORMAT section. Whether these exist or not, the following  will  always
       be displayed:
	      The current process context
	      The init process context
	      The controlling terminal file context

FILE FORMAT

       The format consists of two optional sections as follows:
	      [files]
	      file_name
	      [file_name]
	      ...

	      [process]
	      executable_file_name
	      [executable_file_name]
	      ...

       Where:
	      [files]
		     The start of the file list block.
	      file_name
		     One  or  more  fully qualified file names, each on a new line will that will have its context displayed. If the file does not
		     exist, then it is ignored. If the file is a symbolic link, then sestatus -v will also display the target file context.

	      [process]
		     The start of the process list block.
	      executable_file_name
		     One or more fully qualified executable file names that should it be an active process, have its context displayed. Each entry
		     is on a new line.

EXAMPLE

       # /etc/sestatus.conf
       [files]
       /etc/passwd
       /etc/shadow
       /bin/bash
       /bin/login
       /lib/libc.so.6
       /lib/ld-linux.so.2
       /lib/ld.so.1

       [process]
       /sbin/mingetty
       /sbin/agetty
       /usr/sbin/sshd

SEE ALSO

       selinux(8), sestatus(8)

Security Enhanced Linux 					    26-Nov-2011 						  sestatus.conf(5)
All times are GMT -4. The time now is 05:34 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy