Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Remove SPACES between PIPE delimited file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove SPACES between PIPE delimited file
# 1  
Old 03-13-2010
Remove SPACES between PIPE delimited file
This is my input file with extra information in the HEADER and leading & trailing SPACES between PIPE delimiter.
02/04/2010 Dynamic List Display 1
--------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------
| FIST_NAME|LAST_NAME|ADDRESS |
--------------------------------------------------------------------------------------
| Rajesh |Verma |10/27/2004|
| James |David Jr |10/08/2009|
--------------------------------------------------------------------------------------

How to make output file like this, please help with UNIX script

FIST_NAME|LAST_NAME|ADDRESS|
Rajesh|Verma|164 N Tutor Ln, Chicago-IL|
James|David Jr|529 Carlton Arms Dr, Chicago-IL|

Thanks
srimitta
# 2  
Old 03-13-2010
it's funny

02/04/2010 Dynamic List Display 1
--------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------
| FIST_NAME|LAST_NAME|ADDRESS |
--------------------------------------------------------------------------------------
| Rajesh |Verma |10/27/2004|
| James |David Jr |10/08/2009|
--------------------------------------------------------------------------------------

How to make output file like this, please help with UNIX script

FIST_NAME|LAST_NAME|ADDRESS|
Rajesh|Verma|164 N Tutor Ln, Chicago-IL|
James|David Jr|529 Carlton Arms Dr, Chicago-IL|

What's from the address???
Last edited by john1212; 03-13-2010 at 05:13 PM..
# 3  
Old 03-13-2010
Code:
awk -F\| '{for(i=1;i<=NF;i++) gsub("^[ \t]*|[ \t]*$","",$i)}1' OFS=\| FILE

Last edited by EAGL€; 03-13-2010 at 06:57 PM.. Reason: changed delimeter from "#" to "|"
# 4  
Old 03-13-2010
Hi, srimitta:

Code:
$ cat data
02/04/2010 Dynamic List Display 1
--------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------
| FIST_NAME|LAST_NAME|ADDRESS |
--------------------------------------------------------------------------------------
| Rajesh |Verma |10/27/2004|
| James |David Jr |10/08/2009|
--------------------------------------------------------------------------------------

$ sed -n '/^| */{s///;s/ *| */|/g;p;}' data
FIST_NAME|LAST_NAME|ADDRESS|
Rajesh|Verma|10/27/2004|
James|David Jr|10/08/2009|

Regards,
Alister
# 5  
Old 03-13-2010
john1212, Address was copy / paste mistake.


Thanks Alister worked like charm.
Quote:
sed -n '/^| */{s///;s/ *| */|/g;p;}' data

Regards
srimitta
# 6  
Old 03-14-2010
Using Perl:

Code:
$ 
$ cat f0
02/04/2010 Dynamic List Display 1
--------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------
| FIST_NAME|LAST_NAME|ADDRESS |
--------------------------------------------------------------------------------------
| Rajesh |Verma |10/27/2004|
| James |David Jr |10/08/2009|
--------------------------------------------------------------------------------------
$ 
$ perl -lne 's/\s*\|\s*/\|/g && print' f0
|FIST_NAME|LAST_NAME|ADDRESS|
|Rajesh|Verma|10/27/2004|
|James|David Jr|10/08/2009|
$ 
$

tyler_durden
# 7  
Old 03-14-2010
Quote:
Originally Posted by EAGL€
Code:
awk -F\| '{for(i=1;i<=NF;i++) gsub("^[ \t]*|[ \t]*$","",$i)}1' OFS=\| FILE


Another straight awk solution.

Code:
awk -F"|" '/^\|/ { OFS="\|"; gsub(/ /,"",$0); print $2,$3,$4,$5; }' file

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to remove new line characters from data rows in a Pipe delimited file?

I have a file as below Emp1|FirstName|MiddleName|LastName|Address|Pincode|PhoneNumber 1234|FirstName1|MiddleName2|LastName3| Add1 || ADD2|123|000000000 2345|FirstName2|MiddleName3|LastName4| Add1 || ADD2| 234|000000000 OUTPUT : ... (1 Reply)
Discussion started by: styris
1 Replies

2. UNIX for Dummies Questions & Answers

Need to convert a pipe delimited text file to tab delimited

Hi, I have a rquirement in unix as below . I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column. ex: Input Text file: 1|A|apple 2|B|bottle excel file to be generated as output as... (9 Replies)
Discussion started by: raja kakitapall
9 Replies

3. Shell Programming and Scripting

To remove duplicates from pipe delimited file

Hi some one please help me to remove duplicates from a pipe delimited file based on first two columns. 123|asdf|sfsd|qwrer 431|yui|qwer|opws 123|asdf|pol|njio Here My first record and last record are duplicates.As per my requirement I want all the latest records into one file. I want the... (12 Replies)
Discussion started by: ginrkf
12 Replies

4. Shell Programming and Scripting

How to ignore Pipe in Pipe delimited file?

Hi guys, I need to know how i can ignore Pipe '|' if Pipe is coming as a column in Pipe delimited file for eg: file 1: xx|yy|"xyz|zzz"|zzz|12... using below awk command awk 'BEGIN {FS=OFS="|" } print $3 i would get xyz But i want as : xyz|zzz to consider as whole column... (13 Replies)
Discussion started by: rohit_shinez
13 Replies

5. Shell Programming and Scripting

Remove few columns from pipe delimited file

I have file as below column1|column2|column3|column4|column5| fill1|fill2|fill3|fill4|fill5| abc1|abc2|abc3|abc4|abc5| . . . . i need to remove column2,3, from that file column1|column4|column5| fill1|fill4|fill5| abc1|abc4|abc5| . . . (3 Replies)
Discussion started by: greenworld123
3 Replies

6. Shell Programming and Scripting

Help with converting Pipe delimited file to Tab Delimited

I have a file which was pipe delimited, I need to make it tab delimited. I tried with sed but no use cat file | sed 's/|//t/g' The above command substituted "/t" not tab in the place of pipe. Sample file: abc|123|2012-01-30|2012-04-28|xyz have to convert to: abc 123... (6 Replies)
Discussion started by: karumudi7
6 Replies

7. UNIX for Advanced & Expert Users

Check Whether File is Pipe Delimited

Can anybody help me how to check whether a file is Pipe delimited or not? (1 Reply)
Discussion started by: Allwin333
1 Replies

8. Shell Programming and Scripting

How to convert a space delimited file into a pipe delimited file using shellscript?

Hi All, I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted... AA ATIU2345098809 009697 005374 BB ATIU2345097809 005445 006518 CC ATIU9685098809 003215 003571 DD... (7 Replies)
Discussion started by: nithins007
7 Replies

9. UNIX for Dummies Questions & Answers

Delete last value from pipe delimited file

I have a large(ish) pipe delimited file. The last line of the file contains a total row count and a checksum: END|1537451|1328569446 After making other adjustments to the file, I need to strip out the checksum and apply a new value - I have a script to generate the checksum and 'cat' it... (3 Replies)
Discussion started by: relentl3ss
3 Replies

10. Shell Programming and Scripting

convert a pipe delimited file to a':" delimited file

i have a file whose data is like this:: osr_pe_assign|-120|wg000d@att.com|4| osr_evt|-21|wg000d@att.com|4| pe_avail|-21|wg000d@att.com|4| osr_svt|-11|wg000d@att.com|4| pe_mop|-13|wg000d@att.com|4| instar_ready|-35|wg000d@att.com|4| nsdnet_ready|-90|wg000d@att.com|4|... (6 Replies)
Discussion started by: priyanka3006
6 Replies
Login or Register to Ask a Question