Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: copying file information using awk & grep
Top Forums Shell Programming and Scripting copying file information using awk & grep Post 302562934 by nrjrasaxena on Sunday 9th of October 2011 04:01:27 AM
Old 10-09-2011
copying file information using awk & grep
Hi,

TASK 1:
I have been using this code to print the information of files kept at "/castor/cern.ch/user/s/sudha/forPooja" in some text file name FILE.txt.
Code:
rfdir /castor/cern.ch/user/s/sudha/forPooja | grep data | awk '{print "rfio:///castor/cern.ch/user/s/sudha/forPooja/"$9}' > FILE.txt

Need to mention that "rfdir" is special command in my work. It works same as "ls".

Code, which I am working.
I have some script :
Code:
#!/bin/bash
SOURCEPATH=$1
TARGETPATH=$2
GREP=$3
echo "Copying \"$1 | grep $3\" to $2"
for FILE in `nsls $SOURCEPATH | grep $GREP`
do
        if [ -f $TARGETPATH/$FILE ]; then
                echo "Skipping $FILE."
        else
                echo "Copying $FILE ..."
                awk '{print "$2"$9}' > $2
#               rfcp $SOURCEPATH/$FILE $TARGETPATH
        fi
done

TASK 2 :
In addition, I have a script which does the rest of the part
Code:
#!/bin/bash

split -10 **.txt chunk
i=0
for file in chunk*
do
    ((i=i+1))
    new_file="datafilename"$i".list"

    #sed '/^$/d' $file > $new_file
    #or use the perl command
    perl -0pe 's/\n$//' $file >  $new_file

    #to remove the processed file
    rm -rf $file
    echo 'succesful'
done

Here in this code, I am using that FILE.txt .

It would be really useful if I have single script doing both.
Thanks in advance
pooja.
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Copying file names returned from a grep command into another directory

When I do the following : grep -l "string" *, I get a list of file names returned. Is there a way to copy the files returned from the list into another directory ?. Thanks. (4 Replies)
Discussion started by: Kartheg
4 Replies

2. Shell Programming and Scripting

grep & awk

Hi all, I'm figuring on how to grep only specific data I want below: Bin Total % ----- ------- ----- 1 15 42.9 Bin Total % ----- ------- ----- 2 15 ... (3 Replies)
Discussion started by: *Jess*
3 Replies

3. Shell Programming and Scripting

awk (gawk) grep & columns

Hi, I'm working with gawk (on DOS) today. A goal is: find a string for-instance '123', cut a line in two columns and write second one. The problem is: command line works OK, awk file doesn't. But I would like to work with file because there are many strings to find. input: line command: awk... (4 Replies)
Discussion started by: frajer
4 Replies

4. Shell Programming and Scripting

Copying Information from One File to Another File in Shell

Hello, I'm new to scripting and I need help moving text from one file to another file. Here are examples what the files look like. File 1: Ac-223 2.10m A 1 0 0 0 Fr-219 358 9.9000E-01 0 0.0 0 0.0 0 0.0... (1 Reply)
Discussion started by: tamachan414
1 Replies

5. Shell Programming and Scripting

Grep'ing information from a log file on SUN OS 5

Hi Guys, I'm trying to write an script that will be launched by a user. The script will look at a log file and check for alerts with the date (supplied by user) and a machine's hostname (also supplied by the user). I'm trying to get the output formatted just like the log file. The logfile looks... (5 Replies)
Discussion started by: illgetit
5 Replies

6. Shell Programming and Scripting

Copying the Header & footer Information to the Outfile.

Hi I am writing a perl script which checks for the specific column values from a file and writes to the OUT file. So the feed file has a header information and footer information. I header information isaround107 lines i.e. Starts with START-OF-FILE ....... so on .... ... (11 Replies)
Discussion started by: filter
11 Replies

7. UNIX for Dummies Questions & Answers

Grep? - using a file of terms to search another file when the information is on a different line

I have a flat file that looks like this, let's call it Chromosome_9.txt: FT /Gene_Name="Guanyl-Acetylase 9" FT /Gene_Number"36952" FT /Gene_Name="Endoplasmic Luciferase" FT /Gene_Number"36953" FT ... (4 Replies)
Discussion started by: Twinklefingers
4 Replies

8. Shell Programming and Scripting

Include information in certain columns using grep and awk

HI all, I have data in a file that looks like this: 1 HOW _ NNP NNP _ 3 nn _ _ 2 DRUGS _ NNP NNP _ 3 nn _ _ 3 ACT _ NNP NNP _ 0 null _ _ 4 : _ ... (3 Replies)
Discussion started by: owwow14
3 Replies

9. Shell Programming and Scripting

sed / awk / grep to extract information from log

Hi all, I have a query that runs that outputs data in the following format - 01/09/12 11:43:40,ADMIN,4,77,Application Group Load: Name(TESTED) LoadId(5137-1-0-1XX-15343-15343) File(/dir/dir/File.T03.CI2.RYR.2012009.11433350806.ARD) InputSize(5344) OutputSize(1359) Rows(2) Time(1.9960)... (8 Replies)
Discussion started by: jeffs42885
8 Replies

LEARN ABOUT REDHAT

dircolors

DIRCOLORS(1)								FSF							      DIRCOLORS(1)

NAME

       dircolors - color setup for ls

SYNOPSIS

       dircolors [OPTION]... [FILE]

DESCRIPTION

       Output commands to set the LS_COLORS environment variable.

   Determine format of output:
       -b, --sh, --bourne-shell
	      output Bourne shell code to set LS_COLORS

       -c, --csh, --c-shell
	      output C shell code to set LS_COLORS

       -p, --print-database
	      output defaults

       --help display this help and exit

       --version
	      output version information and exit

       If  FILE  is specified, read it to determine which colors to use for which file types and extensions.  Otherwise, a precompiled database is
       used.  For details on the format of these files, run `dircolors --print-database'.

AUTHOR

       Written by H. Peter Anvin.

REPORTING BUGS

       Report bugs to <bug-coreutils@gnu.org>.

COPYRIGHT

       Copyright (C) 2002 Free Software Foundation, Inc.
       This is free software; see the source for copying conditions.  There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICU-
       LAR PURPOSE.

SEE ALSO

       The  full documentation for dircolors is maintained as a Texinfo manual.  If the info and dircolors programs are properly installed at your
       site, the command

	      info dircolors

       should give you access to the complete manual.

dircolors (coreutils) 4.5.3					   February 2003						      DIRCOLORS(1)
All times are GMT -4. The time now is 02:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy