Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Script to extract certain data

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Script to extract certain data
# 1  
Old 04-05-2011
Script to extract certain data
Hi

Not to good with data extraction . I have some output that looks like this
Code:
1301925447 1 2 2 mtlhqmst 16215531 0 0 *NULL* bpduplicate Initiating optimized duplication from @aaagc to @aaaeG
1301925484 1 2 4 snccprd6 16215531 0 0 hwd-rg-f04b bpdm begin copying backup id hwd-rg-f04b_1301106309 (duplicate-optimized), copy 1, fragment 1
1301971247 1 2 4 snccprd6 16215531 0 0 hwd-rg-f04b bpdm successfully copied (duplicate-optimized) backup id hwd-rg-f04b_1301106309, copy 1, fragment 1, 25600000 Kbytes at 559.460 Kbytes/sec
1301971258 1 2 4 snccprd6 16215531 0 0 hwd-rg-f04b bpdm begin copying backup id hwd-rg-f04b_1301106309 (duplicate-optimized), copy 1, fragment 2

I would need to extract the highlighted data out and put it like this

Code:
Time             id                  client                backupid                       Status
1301925447     16215531
1301925484     16215531            hwd-rg-f04b            hwd-rg-f04b_1301106309            copy 1, fragment 1
1301971247     16215531            hwd-rg-f04b            hwd-rg-f04b_1301106309            copy 1, fragment 1, 25600000 Kbytes at 559.460 Kbytes/sec
1301971258     16215531            hwd-rg-f04b            hwd-rg-f04b_1301106309            [B]copy 1, fragment 2


Thanks

Moderator's Comments:
Mod Comment edit by bakunin: P-L-E-A-S-E have mercy! i actually deleted ~3/4 of your posts text just by removing to (absolutely unnecessary) formatting and replaced that by simple "CODE"-tags. Please use these instead of whatever you did to format your post - it is easier to do, better to read and it is a lot simpler than a dozen of FONT- and SIZE-tags in every line.

Look at it this way: the less time i spend to edit your posts the more time i have to actually answer them.

Thank you.
Last edited by bakunin; 04-05-2011 at 10:05 AM..
# 2  
Old 04-05-2011
Code:
 
awk -F"[ ,]" 'BEGIN { print "Time\t\tid\t\tclient\t\tbackupid\t\tStatus" }
$9 ~ "NULL" { a=$1;b=$6}
$9 !~ "NULL"  {a=$1;b=$6;c=$9; for(i=1;i<=NF;i++){ if($i=="id") { d=$(i+1); } if($i=="copy") {ind=i} } for(i=1;i<=ind-1;i++) { $i=""  }; e=$0}
{ print a"\t"b"\t"c"\t"d"\t"e}' input_file

You have to do the formatinng to get the output in the way you desire.
# 3  
Old 04-05-2011
Thanks for this bit of code it works. But if I would want to run it as a file (ie: with the | awk -f ) I would need to incorportate the field seperator (-F) into the Begin?
# 4  
Old 04-05-2011
Code:
 
awk -F"[ ,]" -f awk_script input_file

# 5  
Old 04-05-2011
Code:
perl -ne 'BEGIN { printf "%-15s\t%-10s\t%-15s\t%-20s\t%-80s\n",Time,client,backupid,Status}if(/^(.+?\s+)(.+?\s+){4}(.+?)\s+(.+?\s+){2}(.+?)\s+(.+backup id\s+(.+?)(,|\s+).+?(copy.*$)|.+$)/) {printf "%-15s\t%-10s\t",$1,$3;($a=$5)=~s/\*NULL\*//;printf "%-15s\t%-20s\t%-80s\n",$a,$7,$9;}' inputfile

# 6  
Old 04-05-2011
Thank-you everyone for taking the time to help me..They both work great
Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to extract data in a file

I have this 5GB file, and i want to extract from the file particulars pattern. this is my script: // count=`grep -wc "MSISDN" file_name` k=1 >OUTPUT >OUTPUT_Final while do cat file_name | awk -F":" -v var="$k" '$1=="MSISDN" {m++}m==var{print; exit}' >> OUTPUT cat file_name |awk -F":"... (33 Replies)
Discussion started by: gillesi
33 Replies

2. Shell Programming and Scripting

Shell script to extract data from csv file

Hi everyone, I have a csv file which has data with different heading and column names as below. Static Data Ingested ,,,,,,,,,,,,Known Explained Rejections Column_1,column_2,Column_3,Column_4,,Column_6,Column_7,,% Column_8,,Column_9 ,Column_10 ,... (14 Replies)
Discussion started by: Vivekit82
14 Replies

3. Shell Programming and Scripting

Need Help with a Data Extract script

hi, i'am trying to write a shell program which takes a data element from one file(var/tmp/usr1/pools)and search that data element in a zipped file in archive location/usr01/archive/PSta*.Z). cat var/tmp/usr1/pools FC5173 FI5178 BE5221 FE5229 ST1604 ls /usr01/archive/PSta*.Z... (14 Replies)
Discussion started by: kmr023
14 Replies

4. Shell Programming and Scripting

help with data extract script

hi, i'am trying to write a script which takes a data element from one file and searches in a certain file path and after it finds it it redirects the file names to a new file...Now i have to pick the up the last modified file's Timestamp(MMDDYY) from the files collected for each data element. ... (2 Replies)
Discussion started by: kmr023
2 Replies

5. Shell Programming and Scripting

Script to extract data

Hi, Pleae find the attached files. I want to extract all the table names that has got * mark within its last column data. The doc file will give you a clear picture of what I am trying to do. Tables names in oval should be extracted in other file because it has got * mark in its last column data (5 Replies)
Discussion started by: db2cap
5 Replies

6. Shell Programming and Scripting

need a shell script to extract data from a log file.

If I have a log like : Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi I will need an output like this : Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies

7. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

8. Shell Programming and Scripting

Perl script for extract data from xml files

Hi All, Prepare a perl script for extracting data from xml file. The xml data look like as AC StartTime="1227858839" ID="88" ETime="1227858837" DSTFlag="false" Type="2" Duration="303" /> <AS StartTime="1227858849" SigPairs="119 40 98 15 100 32 128 18 131 23 70 39 123 20 120 27 100 17 136 12... (3 Replies)
Discussion started by: allways4u21
3 Replies

9. Shell Programming and Scripting

extract data from xml- shell script using awk

Hi, This is the xml file that i have. - <front-servlet platform="WAS4.0" request-retriever="SiteMinder-aware" configuration-rescan-interval="60000"> <concurrency-throttle maximum-concurrency="50" redirect-page="/jsp/defaulterror.jsp" /> - <loggers> <instrumentation... (5 Replies)
Discussion started by: nishana
5 Replies

10. Shell Programming and Scripting

How to extract data using UNIX shell script?

Hello All, I am starting with UNIX. Any help is highly appreciated. How to extract data using UNIX shell script? And how do you export data using UNIX shell scripts into Microsoft Excel format? Thank you. (3 Replies)
Discussion started by: desiondarun
3 Replies
Login or Register to Ask a Question