Extract column data


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Extract column data
# 1  
Old 07-22-2013
Extract column data

I have a file which extracts data from an HTML file
For Eg HTML file contains:


Code:
New York;ABC;145;Yes;YES;No
New York;BCD;113;Yes;YES;No
New York;NAS;63;Yes;YES;No
------------------------
London-48;CBT;16;Yes;YES;No
London-48;CME;17;Yes;YES;No
London-48;EUR;52;Yes;YES;No
London-48;EUR;188;Yes;YES;No
London-48;USx;66;Yes;YES;No
London-48;AMS;172<BR>178;Yes<BR>Yes;YES<BR>YES;no<BR>no
London-48;LIFE;172<BR>174<BR>178;Yes<BR>Yes<BR>Yes;YES<BR>YES<BR>YES;no<BR>no<BR>no
London-48;EUEd;175;Yes;YES;no
London-48;FOXN;177;Yes;YES;no
London-48;BIRD;177;Yes;YES;no
London-48;MOND;177;Yes;YES;no
London-48;EUI;174;Yes;YES;no
London-48;XEC;15;Yes;No;No
London-48;BRUS;95;Yes;No;No
London-48;NYMC;15;Yes;No;No
-----------------------------
London-47;WBOx;28;Yes;YES;No
London-47;BCD;20;Yes;No;No
London-47;MCe;89;Yes;YES;No
London-47;DUBL;87;Yes;YES;No
London-47;CIHX;34;Yes;YES;No
London-47;Ctaf;203;Yes;No;No
London-47;LUXA;95;Yes;YES;No
London-47;LUXB;95;Yes;YES;No
London-47;LUXP;95;Yes;YES;No
London-47;NEBX;95;Yes;YES;No
London-47;NXEL;95;Yes;YES;No
London-47;misc;95;Yes;YES;No
London-47;BXNJ;95;Yes;YES;No
London-47;LANT;95;Yes;YES;No
London-47;LANB;95;Yes;YES;No
London-47;MASD;95;Yes;YES;No
London-47;BRUS;95;Yes;YES;No
London-47;LISB;95;Yes;YES;No
London-47;LIST;95;Yes;YES;No
London-47;PARF;95;Yes;YES;No
London-47;JSEB;31;Yes;YES;No
London-47;LoND;33;Yes;YES;No

As a TXT file, it gets:

It is in the format of

Code:
Server;Country;Num;Data1;Data2;Data3

If there are multiple Num column, then it is in the format


Code:
Server;Country;<BR>Num1</BR><BR>Num2</BR>;Data1ofNum1<BR>Data1ofNum2;Data2ofNum1<BR>Data2ofNum2;Data3ofNum1<BR>Data3ofNum2

Now I need to write a uniq script where the user needs to find a server which has routing and Data2 lets say:

FOR EG of entered data: BRUS Data2

I want to see if data 2 + BRUS is available on a server, it should return London-47, London-48

but the problem is that the txt file grabs data per column and not by row.

If this question is not so clear please inform me.
# 2  
Old 07-22-2013
What does "data2" mean here? What relationship does it have with the content in the HTML file?
# 3  
Old 07-22-2013
The following will perform the columnar checks you require:
Code:
perl -ne '@rec=split/;/,$_;print if (($rec[1] eq "BRUS") && ($rec[4] =~m/Yes/))'


Last edited by Skrynesaver; 07-22-2013 at 10:43 AM..
# 4  
Old 07-22-2013
Again, your specification is inconsistent. Your desired output (NOT code tagged!) contains London-47, London-48 ALTHOUGH Data2 in London48 is NO in your sample input file! And, lower case and upper case seem to be mingled deliberately. And, you don't specify what to do with multiple Num entries...
Anyhow, try
Code:
awk -F";" '$2~COUNTRY && toupper($(DATA+3))~"YES" {print $1}' COUNTRY="BRUS" DATA="2" file
London-47

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Get extract and replace column with link in a column where it exists

hi i have sample data a,b,c,d,e,g h http://mysite.xyx z,b,d,f,e,s t http://123124# a,b,c,i,m,nothing d,i,j,e,w,nothing output expected is a,b,c,d,e,http://mysite.xyx z,b,d,f,e,http://123124# a,b,c,i,m,nothing d,i,j,e,w,nothing i can get only links using grep -o 'http.*' i... (8 Replies)
Discussion started by: zozoo
8 Replies

2. Shell Programming and Scripting

Change data in one column with data from another file's column

Hello, I have this file outputData: # cat /tmp/outputData __Capacity^6^NBSC01_Licences^L3_functionality_for_ESB_switch __Capacity^2100^NBSC01_Licences^Gb_over_IP __Capacity^1837^NBSC01_Licences^EDGE_BSS_Fnc __Capacity^1816^NBSC01_Licences^GPRS_CS3_and_CS4... (1 Reply)
Discussion started by: nypreH
1 Replies

3. Shell Programming and Scripting

Compare 2 files and match column data and align data from 3 column

Hello experts, Please help me in achieving this in an easier way possible. I have 2 csv files with following data: File1 08/23/2012 12:35:47,JOB_5330 08/23/2012 12:35:47,JOB_5330 08/23/2012 12:36:09,JOB_5340 08/23/2012 12:36:14,JOB_5340 08/23/2012 12:36:22,JOB_5350 08/23/2012... (5 Replies)
Discussion started by: asnandhakumar
5 Replies

4. Shell Programming and Scripting

Need to extract data from Column having variable length column

Hi , I need to extract data from below mentioned data, having no delimiter and havin no fixed column length. For example: Member nbr Ref no date 10000 1000 10202012 200000 2000 11202012 Output: to update DB with memeber nbr on basis of ref no. ... (6 Replies)
Discussion started by: ns64110
6 Replies

5. Shell Programming and Scripting

for each different entry in column 1 extract maximum values from column 2 in unix/awk

Hello, I have 2 columns (1st column has multiple entries but the corresponding values in the column 2 may be the same or different.) however I want to extract unique values for each entry in column 1 by assigning the max value from column 2 SDF4 -0.211654 SDF4 0.978068 ... (1 Reply)
Discussion started by: Diya123
1 Replies

6. UNIX for Dummies Questions & Answers

Extract alphahumeric data from a column

Hi Unix Gurus, I am newbie to UNIX. I have a file test.txt with the follwing data aa90558 bb72962 cc08342 xy112233 yz25341 aa372099 cc34590231 bb880011 testfil Whatisit00 1234556 testfile2test I want to output only the items with two alpha followed by 5 numeric (ex aa90558 or... (2 Replies)
Discussion started by: SalM
2 Replies

7. Shell Programming and Scripting

Extract specific data content from a long list of data

My input: Data name: ABC001 Data length: 1000 Detail info Data Direction Start_time End_time Length 1 forward 10 100 90 1 forward 15 200 185 2 reverse 50 500 450 Data name: XFG110 Data length: 100 Detail info Data Direction Start_time End_time Length 1 forward 50 100 50 ... (11 Replies)
Discussion started by: patrick87
11 Replies

8. Shell Programming and Scripting

Extract data based on match against one column data from a long list data

My input file: data_5 Ali 422 2.00E-45 102/253 140/253 24 data_3 Abu 202 60.00E-45 12/23 140/23 28 data_1 Ahmad 256 7.00E-45 120/235 140/235 22 data_4 Aman 365 8.00E-45 15/65 140/65 20 data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies

9. Shell Programming and Scripting

how to extract a data from a column?

Hi All, Consider the below column, say this is the 4th column in a file PROV_STATS:::919900546978::Nokia 6600 PROV_STATS:::919900546978::Nokia 6600 PROV_STATS:::919900546978::Nokia 6600 I wanted to extract only 919900546978 from the 4 th cloumn using unix scripting? Kindly help (8 Replies)
Discussion started by: Balaji Sukumara
8 Replies

10. UNIX for Dummies Questions & Answers

Extract column data from File

I have a file containing the lines similar to the following entries: File1.txt: ..... -rw-r--r-- 1 root staff 4110 Aug 7 17:02 XXX_OrderNum1_date1_time1.txt -rw-r--r-- 1 root staff 4110 Aug 7 17:02 XXX_OrderNum2_date2_time1.txt -rw-r--r-- 1 root staff ... (3 Replies)
Discussion started by: sudheshnaiyer
3 Replies
Login or Register to Ask a Question