Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Remove '| ' from file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove '| ' from file
# 1  
Old 02-07-2010
Remove '| ' from file
Hi,

I am using paste command to concat different fields from different files to create a new file. The new file is creating fine and is creating as a pipe delimited. The issue I am getting into is the new file have spaces after the '|' sign which it should not be there as I am creating a pipe delimited file. Please advise.

Code:
 
paste temp_field1.dat temp_field2_d.dat temp_field3_b.dat temp_field4_b.dat temp_field5_b.dat temp_field6_10.dat> newfile.dat
 
Result from data...
 
3|    JJJJ|    123 MAIN AVE|      ||       ATLANTA|GA|30317||0


Please advise.

Thanks....
# 2  
Old 02-07-2010
Code:
tr "|" " "  < input.txt

# 3  
Old 02-07-2010
I need the "|" in the file but take out the spaces after the "|".

Code:
Input File : 

3|    JJJJ|    123 MAIN AVE|      ||       ATLANTA|GA|30317||0

So the output should look as follow :


Output File After the code : 

3|JJJJ|123 MAIN AVE|||ATLANTA|GA|30317||0


I am basically trying to create a pipe delimited file with various fields being concatenated. Please advise. Thanks...
# 4  
Old 02-07-2010
Try...
Code:
sed 's/\| */\|/g' infile

# 5  
Old 02-07-2010
maybe sed, with the -r option to get rid of all spaces that are double or more..

Code:
sed -r 's/  +//g'

Code:
# echo '3|    JJJJ|    123 MAIN AVE|      ||       ATLANTA|GA|30317||0' | sed -r 's/  +//g'
3|JJJJ|123 MAIN AVE|||ATLANTA|GA|30317||0
#

malcomex999's sed line didn't work for me, I added the -r option to it and got the exact same results as mine.
Last edited by fubaya; 02-07-2010 at 02:43 AM..
# 6  
Old 02-07-2010
I hope this will work for you:

Code:
nawk '{for(i=1;i<=NF;i++) {gsub("^[ \t]*","",$i)}}1' FILE

# 7  
Old 02-07-2010
Thanks...Eagle solution work for me but it still had 1 space after the '|'. Still I can live with it but would be nice to also take one spae after |.

Thanks...
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Remove lines from File.A based on criteria in File.B

Hello, I have two files of the following form. I would like to remove from File.A where the first three colum matches values in File.B to give the output in File.C File.A 121 54321 PQR CAT 122 765431 ABC DOG 124 98765 ZXY TIGER 125 86432 GEF LION File.B 122 765431 ABC 125 86432 GEF... (4 Replies)
Discussion started by: Gussifinknottle
4 Replies

2. Shell Programming and Scripting

awk remove/grab lines from file with pattern from other file

Sorry for the weird title but i have the following problem. We have several files which have between 10000 and about 500000 lines in them. From these files we want to remove lines which contain a pattern which is located in another file (around 20000 lines, all EAN codes). We also want to get... (28 Replies)
Discussion started by: SDohmen
28 Replies

3. Shell Programming and Scripting

ksh Loop through file one, remove lines from file two

Good Afternoon, I start with a file named biglist.txt. I have another file smallerlist. txt I want to remove the lines from smallerlist.txt from biglist.txt and leave those lines that do not reside in smallerlist.txt. Thanks !! (2 Replies)
Discussion started by: popeye
2 Replies

4. Shell Programming and Scripting

Remove comments from file with specific file name extensions

Hello Unix board community, I have to program a shell script, but I am a complete noob so I hope I get some help here. The assignment is as follows: The program removes all comments regardless of formatting or language from files with specific file name extensions (php, css, js, ...).... (3 Replies)
Discussion started by: TheZeusMan
3 Replies

5. Shell Programming and Scripting

Remove bad records from file and move them into a file then send those via email

Hi my requirement is that i want pull the bad records from input file and move those records in to a seperate file. that file has to be sent via email.. any suggentions please (1 Reply)
Discussion started by: sxk4999
1 Replies

6. Shell Programming and Scripting

How to remove blank lines in a file and save the file with same name?

I have a text file which has blank lines. I want them to be removed before upload it to DB using SQL *Loader. Below is the command line, i use to remove blank lines. sed '/^ *$/d' /loc/test.txt If i use the below command to replace the file after removing the blank lines, it replace the... (6 Replies)
Discussion started by: vel4ever
6 Replies

7. Shell Programming and Scripting

Remove duplicate lines from first file comparing second file

Hi, I have two files with below data:: file1:- 123|aaa|ppp 445|fff|yyy 999|ttt|jjj 555|hhh|hhh file2:- 445|fff|yyy 555|hhh|hhh The records present in file1, not present in file 2 should be writtent to the out put file. output:- 123|aaa|ppp 999|ttt|jjj Is there any one line... (3 Replies)
Discussion started by: gani_85
3 Replies

8. Shell Programming and Scripting

need to remove 1st line of a file and save the file with same old name

Hi friends, I have a doubt, I am not sure whether it is possible ah nu. I am having a file(sample.txt) which contain 5 lines. I want to remove 1st line in the file and save the file with same old name (sample.txt). For removing 1st line i am using sed 1d filename But dono how to... (3 Replies)
Discussion started by: natraj005
3 Replies

9. UNIX for Dummies Questions & Answers

how to copy a file without remove the contents of the target file?

Hello every body, Kindly support me to "copy a file without remove the contents of the target file" Thanks in advance. :) Ahmed Amer Cairo,Egypt (2 Replies)
Discussion started by: ahmedamer12
2 Replies

10. Shell Programming and Scripting

Batch file to remove double quotes from a file

Hi I have to create a windows batch file which will read an input file and remove "double quotes" from each line of the file. For eg.If input file name is abcd.csv and contents is : "asasd,123123,213213,asd" "esfrf,dsfsdf,234324,sdfsdf" Then the batch file should remove "" from the... (11 Replies)
Discussion started by: akashtcs
11 Replies
Login or Register to Ask a Question