Need Help with a Data Extract script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need Help with a Data Extract script
# 8  
Old 09-14-2011
Quote:
Originally Posted by kmr023
no luck, even i took off "-m 1".
In what way did it not work when you took off -m 1? Always be descriptive!

Did you try egrep like I suggested?

Have you tried my alternative code?
# 9  
Old 09-14-2011
hi,
i tried the code, it ended up finding the latest file for the last string "ST1604" of /var/tmp/usr1/pools, what about the other strings in the list /var/tmp/usr1/pools
# 10  
Old 09-14-2011
Sorry, I wasn't clear on that -- it only found the latest file with any of those strings in it.

How about this:

Code:
for FILE in /usr01/archive/PStat*.Z
do
        zcat "$FILE" > /tmp/$$

        N=0
        while read STR
        do
                grep -l "$STR" "/tmp/$$" > /dev/null &&
                        echo "$FILE" >> /tmp/${N}.$$

                N=`expr $N + 1`
        done < var/tmp/usr1/pools
done

N=0
while read STR
do
        printf "%s:\t" $STR

        xargs ls -t < /tmp/${N}.$$ | head -n 1
        rm -f /tmp/${N}.$$
        N=`expr $N + 1`
done < var/tmp/usr1/pools

rm -f /tmp/$$

This User Gave Thanks to Corona688 For This Post:
# 11  
Old 09-14-2011
Quote:
Originally Posted by kmr023
no luck, even i took off "-m 1".
i'am using solaris 8. so, any thing compatable help be greatly appreciated
Code:
/usr/xpg4/bin/grep ...

It still doesn't have the -m options but it has the -f and -F ones.

Andrew
# 12  
Old 09-14-2011
Quote:
Originally Posted by apmcd47
It still doesn't have the -m options but it has the -f and -F ones.
Even working properly, my original script doesn't do what he intended, meaning, the improvements possible with -f and -F aren't relevant anymore Smilie
# 13  
Old 09-15-2011
Thanks Very Much, it worked this time.

---------- Post updated 09-15-11 at 01:10 PM ---------- Previous update was 09-14-11 at 05:04 PM ----------

Hi Corona688,

when i tried the script with fresh set of strings in "var/tmp/usr1/pools", i'am getting the below error

grep: RE error 41: No remembered search string.


could you please advise as to why the script is not working for other strings?
# 14  
Old 09-15-2011
Without seeing the strings I'm only guessing, but the strings might contain + ? * . [ ] { } ( ) \ characters that grep would consider an expression, not literal characters. So you turn out to need -F after all (but not -f).

Code:
for FILE in /usr01/archive/PStat*.Z
do
        zcat "$FILE" > /tmp/$$

        N=0
        while read STR
        do
                /usr/xpg4/bin/grep -F -l "$STR" "/tmp/$$" > /dev/null &&
                        echo "$FILE" >> /tmp/${N}.$$

                N=`expr $N + 1`
        done < var/tmp/usr1/pools
done

N=0
while read STR
do
        printf "%s:\t" $STR

        xargs ls -t < /tmp/${N}.$$ | head -n 1
        rm -f /tmp/${N}.$$
        N=`expr $N + 1`
done < var/tmp/usr1/pools

rm -f /tmp/$$

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to extract data in a file

I have this 5GB file, and i want to extract from the file particulars pattern. this is my script: // count=`grep -wc "MSISDN" file_name` k=1 >OUTPUT >OUTPUT_Final while do cat file_name | awk -F":" -v var="$k" '$1=="MSISDN" {m++}m==var{print; exit}' >> OUTPUT cat file_name |awk -F":"... (33 Replies)
Discussion started by: gillesi
33 Replies

2. Shell Programming and Scripting

Shell script to extract data from csv file

Hi everyone, I have a csv file which has data with different heading and column names as below. Static Data Ingested ,,,,,,,,,,,,Known Explained Rejections Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies

3. Shell Programming and Scripting

help with data extract script

hi, i'am trying to write a script which takes a data element from one file and searches in a certain file path and after it finds it it redirects the file names to a new file...Now i have to pick the up the last modified file's Timestamp(MMDDYY) from the files collected for each data element. ... (2 Replies)
Discussion started by: kmr023
2 Replies

4. Shell Programming and Scripting

Script to extract certain data

Hi Not to good with data extraction . I have some output that looks like this 1301925447 1 2 2 mtlhqmst 16215531 0 0 *NULL* bpduplicate Initiating optimized duplication from @aaagc to @aaaeG 1301925484 1 2 4 snccprd6 16215531 0 0 hwd-rg-f04b bpdm begin copying backup id... (5 Replies)
Discussion started by: bombcan1
5 Replies

5. Shell Programming and Scripting

Script to extract data

Hi, Pleae find the attached files. I want to extract all the table names that has got * mark within its last column data. The doc file will give you a clear picture of what I am trying to do. Tables names in oval should be extracted in other file because it has got * mark in its last column data (5 Replies)
Discussion started by: db2cap
5 Replies

6. Shell Programming and Scripting

need a shell script to extract data from a log file.

If I have a log like : Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi I will need an output like this : Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies

7. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

8. Shell Programming and Scripting

Perl script for extract data from xml files

Hi All, Prepare a perl script for extracting data from xml file. The xml data look like as AC StartTime="1227858839" ID="88" ETime="1227858837" DSTFlag="false" Type="2" Duration="303" /> <AS StartTime="1227858849" SigPairs="119 40 98 15 100 32 128 18 131 23 70 39 123 20 120 27 100 17 136 12... (3 Replies)
Discussion started by: allways4u21
3 Replies

9. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies

10. Shell Programming and Scripting

How to extract data using UNIX shell script?

Hello All, I am starting with UNIX. Any help is highly appreciated. How to extract data using UNIX shell script? And how do you export data using UNIX shell scripts into Microsoft Excel format? Thank you. (3 Replies)
Discussion started by: desiondarun
3 Replies
Login or Register to Ask a Question