Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

sed and maybe AWK

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting sed and maybe AWK
# 8  
Old 10-16-2010
I'm confused by your last sample which has semicolons instead of colons as field separator. Anyway, that one might do it:
Code:
sed 's/\([;,]\)[ 0-9]*\1/\1/'

# 9  
Old 10-16-2010
So at the beginning of your post the field separator was "," now in your SAN DIEGO sample line, the field spearator is now ";" ... what's going on ?

Could you please provide a representative input file containing all the case of line formating possible you want to filter and give us what output file sample you expect, then maybe people will be able to help
# 10  
Old 10-16-2010
Hi
Yes the problem of this file, is this.. All the field do not have the same patern.
It's complicated.
Look this other exemple:

HTML Code:
AMSTERDAM;NORTH-HOLLAND PUBLISHING COMPANY;1980;52 VANDERBILT AVENUE, NEW YORK, N.Y. 10017
The only item i have to remove here is the date...

so the result should be:

HTML Code:
AMSTERDAM;NORTH-HOLLAND PUBLISHING COMPANY;;52 VANDERBILT AVENUE, NEW YORK, N.Y. 10017
There are other exemple with the date rounded with ,

like this:
HTML Code:
PARIS : OECD, 1989
or
HTML Code:
MADRID : JUNTA DE ENERGIA NUCLEAR, 1965
Thanks
# 11  
Old 10-16-2010
Quote:
Originally Posted by ldiaz2106
Yes the problem of this file, is this.. All the field do not have the same patern.
It's complicated.
And you think that wasn't worth mentioning in the first place ??
Quote:
Look this other exemple:
Code:
AMSTERDAM;NORTH-HOLLAND PUBLISHING COMPANY;1980;52 VANDERBILT AVENUE, NEW YORK, N.Y. 10017

The only item i have to remove here is the date...so the result should be:
Code:
AMSTERDAM;NORTH-HOLLAND PUBLISHING COMPANY;;52 VANDERBILT AVENUE, NEW YORK, N.Y. 10017

Did you try my last suggestion ? It works with that one.
Quote:
There are other exemple with the date rounded with ,
like this:
Code:
PARIS : OECD, 1989

or
Code:
MADRID : JUNTA DE ENERGIA NUCLEAR, 1965

Thanks
I don't see any date rounded with colons here, only prefixed. Do you mean the date field can also be the last one ?
# 12  
Old 10-16-2010
Hi
the last suggestion works fine but if I have this string:

HTML Code:
SAN DIEGO :ACADEMIC PRESS, INC.;1989;UNIVERSITY CAFILORNIA
it don't works.
because the output of the suggestion is this:

HTML Code:
SAN DIEGO :ACADEMIC PRESS, INC.,
So all the text after the date is dropped too.

I check the whole file and there are 3 case:

1 (this case is ok with your seggestion
HTML Code:
AMSTERDAM :NORTH-HOLLAND,1989
Needed result:
AMSTERDAM :NORTH-HOLLAND,
2 This case do not works because PUBLISHING COMPANY is dropped too
HTML Code:
AMSTERDAM :NORTH-HOLLAND,1989,PUBLISHING COMPANY
Needed result:(if 2 , appear here it's not a problem)
AMSTERDAM :NORTH-HOLLAND,,PUBLISHING COMPANY
3 Same problem
HTML Code:
AMSTERDAM :NORTH-HOLLAND;1989;PUBLISHING COMPANY
Needed result:(if 2 ; appear here it's not a problem)
 AMSTERDAM :NORTH-HOLLAND;;PUBLISHING COMPANY
Thanks in advance
# 13  
Old 10-16-2010
Code:
sed 's/[;,][ ]\?[0-9]\{4\}//'

Last edited by Aia; 10-16-2010 at 06:00 PM..
# 14  
Old 10-16-2010
Hi

many of the records have been formatted fine, but not this one:

Code:
GAINESVILLE;INTERFERENCE CONTROL TECHNOLOGIES;1982;ROUTE 625, GAINESVILLE, VA 22065

The result expected is this:
Code:
GAINESVILLE;INTERFERENCE CONTROL TECHNOLOGIES;;ROUTE 625, GAINESVILLE, VA 22065

THanks
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

2. Shell Programming and Scripting

Is this possible using SED and AWK?

Dear Geeks, I want to manipulate a file with certain modifications for that using sed or AWK how to do this process for one file i have this type of data. Input File: "Restricted and Reserved names .ANISH",3798,"TEST.CO",1201208,6/16/10 0:00,6/16/13 0:00,,,"CO","2nd"^M "Restricted and... (4 Replies)
Discussion started by: anishkumarv
4 Replies

3. UNIX for Dummies Questions & Answers

sed/awk or help please

I have a file that contain the data below: B1 1 2 3 B2 20 30 40 B3 7 8 B4 100 B5 21 22 23How can I retrieve the data for B1 into a seperate file. (8 Replies)
Discussion started by: bobo
8 Replies

4. Shell Programming and Scripting

Need help using awk or sed.

Hi All, Is there a way of comparing two columns in the same file and deleting the row if the values of the columns match. I have the sample data file as below. M024900|175309.00|968.00|17 M025001|19861.79|97.90|148 M025002|431.70|159.00|3 M025003|912.30|159.90|6 ... (6 Replies)
Discussion started by: nua7
6 Replies

5. Shell Programming and Scripting

Using sed or awk?

What if I wanted to add a word such as IT after the first character and if theres 3 characters, after the 2nd character? output would be: G, it H G, H it P G, H, P it L I'm thinking that AWK would be the easiest way to do this... Currently looking it up. Right now I'm using awk but I... (13 Replies)
Discussion started by: puttster
13 Replies

6. UNIX for Dummies Questions & Answers

sed or awk?

I've got an inventory database with eight columns with things like product name, manufacturer, UPC code, etc. on each line. Our PO (purchase order) number is in the first column. I can grep the date and get the full line of data but I would like to strip out everything but the PO number in the... (5 Replies)
Discussion started by: NetJones
5 Replies

7. UNIX for Advanced & Expert Users

Awk or Sed help

Hi, I have a data file with 5 columns - like this: "20080401 09:43:08.770798 +0100s","TEST 1","R 1","A TEST","Nov 27 2007","1" "20080401 09:43:08.770798 +0100s","THIS IS A TEST","R 2","B TEST","Nov 30 2007","10" "20080401 09:43:08.770798 +0100s","ANOTHER TEST","R 3","B TEST","Nov 05... (7 Replies)
Discussion started by: MrG-San
7 Replies

8. UNIX for Advanced & Expert Users

sed in awk ? or nested awk ?

Hey all, Can I put sed command inside the awk action ?? If not then can i do grep in the awk action ?? For ex: awk '$1=="174" { ppid=($2) ; sed -n '/$ppid/p' tempfind.txt ; }' tempfind.txt Assume: 174 is string. Assume: tempfind.txt is used for awk and sed both. tempfind.txt... (11 Replies)
Discussion started by: varungupta
11 Replies

9. Shell Programming and Scripting

sed,awk

Hi, I know sed is stream text editor and not a bit more than that. Can anyone explain its usage and advantages? How is awk different from sed? I donno i am a bit confused about it. But i have coded in awk and shell. Thanks, Nisha :confused: (7 Replies)
Discussion started by: Nisha
7 Replies

10. Shell Programming and Scripting

awk / sed

I have many messages such as the test message below: 00:00000:00021:2002/05/13 13:57:00.51 ERROR:- Test error, my test error!!! I am writing a script in which I need to get everything from the word "ERROR:-" onwards. I normally use awk for these things, but I am not an expert at it so i am... (6 Replies)
Discussion started by: baileyr1
6 Replies
Login or Register to Ask a Question