Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Replace help

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Replace help
# 1  
Old 10-07-2013
Replace help
Hi experts,

I have a csv file where the delimiter is comma and the text between apostrophe.

Like this:

Code:
"aaa","bbb","ccc","ddd","eee","fff","ggg"


But now i have a lot of enter(end of line) in text like this:
Code:
"aaa","bbb","ccc","ddd","eee","
""
""
fff","ggg"

How can i remove that enters and make my line like the firs example?

Thank You for Your help!
# 2  
Old 10-07-2013
try

Code:
$ cat file
"aaa","bbb","ccc","ddd","eee","
""
""
fff","ggg"

if you have to remove empty line use this

Code:
$ awk '!/^""$/'  file

resulting
Code:
"aaa","bbb","ccc","ddd","eee","
fff","ggg"

if you need everything in one line use below one
Code:
$ awk '!/^""$/{printf $0}END{printf RS}'  file

resulting
Code:
"aaa","bbb","ccc","ddd","eee","fff","ggg"

# 3  
Old 10-07-2013
Code:
paste -s filename | sed 's/""//g;s/"\s\+/"/g'

# 4  
Old 10-07-2013
thanks its work by 1 line file.

Can you help what can i do, if i have a file with 1 million lines which include 15 bad characters(apostrophe and enter).
# 5  
Old 10-07-2013
Hi snayper,

Could you please provide part of input file ?

Thanks
Pravin
# 6  
Old 10-07-2013
sure:

Code:
"2721348","2013-10-06","2013-10-06 15:54:37","Tree","1","0","1","1","paper","sumer","","ppd","no","no","anonymous","195","oo","Seria SP, kete","000000000126 ","Red 4","","","","","","","","","2013-10-06 15:57:59","107","","","","7763","EgĂĄg","sĂĄg","a","27"," ep,  ,  Ajt","73","Eger","yes","a","27","let,  Emelet,  Ajt","76","Eger","Ipol","ca","27","let,  Emelet,  Aj","","","","","","","","","","Sen","rea","Sea","Pcs","","1731","","mar","rtya","5755","","460","","","knes","","","0382323422919","ignhu","
""
""
""
","","0","","","","micro","","","","","","","","","","","","",""
"3621123","2013-10-06","2013-10-06 07:07:23","Szabina","1","0","1","0","zala","coer","ice","paid","no","no","anonymous","","oo","CsaIM","noim","Red 24","","","","","","","","","2013-10-06 07:07:56","107","","","","3529","Miskolc","yi Istv","ua","29","let","32","lc","Ac","ua","2","","32","Mc","Ac","ua","2"," let,  let,  ","","","","","","","","","","Cs","Sina","","kol","","116","","myar","","599452PA","","388304RL","","","","","","3254608134","srohu","","","0","","","","mini","","","","","","","","","","","","",""

that is two row which include one of bad.
# 7  
Old 10-07-2013
Code:
awk '!/^""$/ {
if ( $0 ~ /^"[^,].+/) { printf NR==1?$0:"\n"$0} else { printf $0}
} END { printf  "\n"} ' filename
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

awk script to extract a column, replace one of the header and replace year(from ddmmyy to yyyy)

I have a csv which has lot of columns . I was looking for an awk script which would extract a column twice. for the first occurance the header and data needs to be intact but for the second occurance i want to replace the header name since it a duplicate and extract year value which is in ddmmyy... (10 Replies)
Discussion started by: Kunalcurious
10 Replies

2. UNIX for Dummies Questions & Answers

How can I replace the lines that start with a star and replace it with numbers start from 1?

I need to replace the (*) in the fist of a list with numbers using sed for example > this file contain a list * linux * computers * labs * questions to >>>> this file contain a list 1. linux 2. computers 3. labs 4. questions (7 Replies)
Discussion started by: aalbazie
7 Replies

3. Shell Programming and Scripting

Replace dashes positions 351-357 & 024-043 with 0 & replace " " if exis with 04 at position 381-382

I need to replace dashes (i.e. -) if present from positions 351-357 with zero (i.e. 0), I also need to replace dash (i.e “-“) if present between position 024-043 with zero (i.e. 0) & I replace " " (i.e. 2 space characters) if present at position 381-382 with "04". Total length of record is 413.... (11 Replies)
Discussion started by: lancesunny
11 Replies

4. Shell Programming and Scripting

How to replace

Here is my file content age=12 age=34 age=54 age=23 Hello world. This is the age result I am getting. To day date is 23-02-2010. From the above content I have to replace all the values after 'age=*' to age=24. How to do it. (1 Reply)
Discussion started by: brahma
1 Replies

5. Shell Programming and Scripting

awk - replace number of string length from search and replace for a serialized array

Hello, I really would appreciate some help with a bash script for some string manipulation on an SQL dump: I'd like to be able to rename "sites/WHATEVER/files" to "sites/SOMETHINGELSE/files" within the sql dump. This is quite easy with sed: sed -e... (1 Reply)
Discussion started by: otrotipo
1 Replies

6. Shell Programming and Scripting

Replace Help

Hi, djfksdjk)))) kmmm jfdfjk)))) I want to replace the first ')' after kmmm with #. The output would be djfksdjk)))) exists jfdfjk#))) Can anyone help on this? (3 Replies)
Discussion started by: javeed7
3 Replies

7. Shell Programming and Scripting

replace

hi i have input file in this format E102|0|1-23-1994|0|12-5-1994|E003|A|10450|charan,devupalli|5000 how to convert this into outfile E102,0,1-23-1994,0,12-5-1994,E003,A,10450,charan,devupalli,5000 i wann the output in excel sheet.........that is why i am converting into csv.. but i have... (6 Replies)
Discussion started by: charandevu
6 Replies

8. Shell Programming and Scripting

replace last / by |

Hi: I want to write a Kshell script which will replace last / by |. eg: /home/apps/test/document should be replaced as /home/apps/test|document. The length of the string is not constant. Thanks, Ash (6 Replies)
Discussion started by: naikaa
6 Replies

9. Shell Programming and Scripting

How to replace into Vi

Ravi . Pawan 19.23 sanjeeva . I want to replace '.' into 'NULL' not the dot between 19.23 .. only single dots to NULL how to do replacement after opening file in Vi (5 Replies)
Discussion started by: ravi.sadani19
5 Replies

10. UNIX for Dummies Questions & Answers

How to replace ??

Hi all, I have a file with the following data. E01011U, ,E11, , , ,0 E03012U, ,E14, , , ,0 E02013U, ,E25, , , ,0 I want to change it to ('E01-01-1-U','E11' ); ('E03-01-2-U','E14' ); ('E02-01-3-U','E25' ); Please let me know about it .Thanks in advance. (10 Replies)
Discussion started by: preethgideon
10 Replies
Login or Register to Ask a Question