help with data extract script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting help with data extract script
# 1  
Old 09-13-2011
help with data extract script

hi,

i'am trying to write a script which takes a data element from one file and searches in a certain file path and after it finds it it redirects the file names to a new file...Now i have to pick the up the last modified file's Timestamp(MMDDYY) from the files collected for each data element.

how would i go by breaking the loop for each data element in the list to get the latest filename in the filepath in which that data element is present.

any suggestions,please...

regards,
kmr023
# 2  
Old 09-13-2011
Best if we can see samples

Please copy small sections of the file(s) to a message, and include desired output. Remember to wrap CodeTags around the data.

Often, requests are best understood with examples. Especially since this is a world-wide forum, and people have different ways to describe things.
# 3  
Old 09-13-2011
Quote:
Originally Posted by joeyg
Please copy small sections of the file(s) to a message, and include desired output. Remember to wrap CodeTags around the data.

Often, requests are best understood with examples. Especially since this is a world-wide forum, and people have different ways to describe things.
Code:
fl='/XXX/AAA/CCC/'
for i in `cat /var/tmp/g3ukem/pools`
do
for j in `ls -ltr ${fl}/*.Z | tr -s ' '| cut -d" " -f9 | cut -d\ / -f7`
do
count=`zcat $fl/$j | grep "$i" | wc -l` 
if [ $count -eq 1 ] ; then
echo ${j} | grep "PSta*" >> /var/tmp/g3ukem/fcount
fi

...from here when i see the /var/tmp/g3ukem/fcount i see the files for all the data elements in cat /var/tmp/g3ukem/pools, i need to split the loop for each data element so that i can get the latest file for each data element in /var/tmp/g3ukem/pools

Last edited by pludi; 09-13-2011 at 06:52 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to extract data in a file

I have this 5GB file, and i want to extract from the file particulars pattern. this is my script: // count=`grep -wc "MSISDN" file_name` k=1 >OUTPUT >OUTPUT_Final while do cat file_name | awk -F":" -v var="$k" '$1=="MSISDN" {m++}m==var{print; exit}' >> OUTPUT cat file_name |awk -F":"... (33 Replies)
Discussion started by: gillesi
33 Replies

2. Shell Programming and Scripting

Shell script to extract data from csv file

Hi everyone, I have a csv file which has data with different heading and column names as below. Static Data Ingested ,,,,,,,,,,,,Known Explained Rejections Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies

3. Shell Programming and Scripting

Need Help with a Data Extract script

hi, i'am trying to write a shell program which takes a data element from one file(var/tmp/usr1/pools)and search that data element in a zipped file in archive location/usr01/archive/PSta*.Z). cat var/tmp/usr1/pools FC5173 FI5178 BE5221 FE5229 ST1604 ls /usr01/archive/PSta*.Z... (14 Replies)
Discussion started by: kmr023
14 Replies

4. Shell Programming and Scripting

Script to extract certain data

Hi Not to good with data extraction . I have some output that looks like this 1301925447 1 2 2 mtlhqmst 16215531 0 0 *NULL* bpduplicate Initiating optimized duplication from @aaagc to @aaaeG 1301925484 1 2 4 snccprd6 16215531 0 0 hwd-rg-f04b bpdm begin copying backup id... (5 Replies)
Discussion started by: bombcan1
5 Replies

5. Shell Programming and Scripting

Script to extract data

Hi, Pleae find the attached files. I want to extract all the table names that has got * mark within its last column data. The doc file will give you a clear picture of what I am trying to do. Tables names in oval should be extracted in other file because it has got * mark in its last column data (5 Replies)
Discussion started by: db2cap
5 Replies

6. Shell Programming and Scripting

need a shell script to extract data from a log file.

If I have a log like : Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi I will need an output like this : Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies

7. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

8. Shell Programming and Scripting

Perl script for extract data from xml files

Hi All, Prepare a perl script for extracting data from xml file. The xml data look like as AC StartTime="1227858839" ID="88" ETime="1227858837" DSTFlag="false" Type="2" Duration="303" /> <AS StartTime="1227858849" SigPairs="119 40 98 15 100 32 128 18 131 23 70 39 123 20 120 27 100 17 136 12... (3 Replies)
Discussion started by: allways4u21
3 Replies

9. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies

10. Shell Programming and Scripting

How to extract data using UNIX shell script?

Hello All, I am starting with UNIX. Any help is highly appreciated. How to extract data using UNIX shell script? And how do you export data using UNIX shell scripts into Microsoft Excel format? Thank you. (3 Replies)
Discussion started by: desiondarun
3 Replies
Login or Register to Ask a Question