Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Remove newline character conditionally

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Remove newline character conditionally
# 1  
Old 04-06-2009
Data Remove newline character conditionally
Hi All,

I have 5000 records like this
Code:
Request_id|Type|Status|Priority|Ticket Submitted Date and Time|Actual Resolved Date and Time|Current Ticket Owner Group|Case final Ticket Owner Group|Customer Severity|Reported Symptom/Request|Component|Hot Topic|Reason for Missed SLA|Current Ticket Owner|Case Owner SSO|End User|Case Contact SSO|City|Work Address Postal Code|Created By|Case Originator SSO|Resolved Via|L1_Resolvable|Case Owner Login Name|Country|Detailed Description
1816808|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:12:57||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Allard, J Marc M (206025364) |206025364|Washington|20016-2795|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name: NUWBURNP5YB02XD
IP Address: 3.50.161.116

I want the above records to be like this
Code:
Request_id|Type|Status|Priority|Ticket Submitted Date and Time|Actual Resolved Date and Time|Current Ticket Owner Group|Case final Ticket Owner Group|Customer Severity|Reported Symptom/Request|Component|Hot Topic|Reason for Missed SLA|Current Ticket Owner|Case Owner SSO|End User|Case Contact SSO|City|Work Address Postal Code|Created By|Case Originator SSO|Resolved Via|L1_Resolvable|Case Owner Login Name|Country|Detailed Description
1816808|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:12:57||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Allard, J Marc M (206025364) |206025364|Washington|20016-2795|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from ttp://quarantine.nbcuni.ge.com/howtofix.asp .Computer name: NUWBURNP5YB02XD IP Address: 3.50.161.116

MEANS THE SCRIPT SHOULD REMOVE ALL THE NEWLINE CHARACTERS FROM THE LAST FIELD BUT NOT
FROM THE END OF THAT LINE AND ANY NUMBER OF \N ARE COMING IN THE LAST FIELD
I NEED TO REMOVE ALL BUT NOT WHICH APPERS AT THE END OF THAT LINE
i tried a lot with sed ,tr pearl, google,previous posts in this forum but no use
one solution that i found
Code:
perl -e 'while (<>) { if (! /\|$/ ) { chomp; } print ;}'

not working
Last edited by radoulov; 04-06-2009 at 10:57 AM.. Reason: added code tags
# 2  
Old 04-06-2009
Could you post a bigger sample?
# 3  
Old 04-06-2009
sample data
Request_id|Type|Status|Priority|Ticket Submitted Date and Time|Actual Resolved Date and Time|Current Ticket Owner Group|Case final Ticket Owner Group|Customer Severity|Reported Symptom/Request|Component|Hot Topic|Reason for Missed SLA|Current Ticket Owner|Case Owner SSO|End User|Case Contact SSO|City|Work Address Postal Code|Created By|Case Originator SSO|Resolved Via|L1_Resolvable|Case Owner Login Name|Country|Detailed Description
1816805|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 00:55:19||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Sanvido, Colleen (501471620) |501471620|NW|20016|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name:NUWBURNPGSW02XD IP Address: 3.50.15.208
1816807|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:07:53||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Mohan, Sabina||NW|20016|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name: NUWBURNPHPWOXD
IP Address: 3.50.15.209
1816808|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:12:57||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Allard, J Marc M (206025364) |206025364|Washington|20016-2795|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name: NUWBURNP5YB02XD
IP Address: 3.50.161.116
1816809|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:16:48||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Edwards, Bruce D (206032135) |206032135|Washington|20016-2795|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name: NUWBURNPFXB02XD
IP address: 3.50.161.117
1816810|Request|Solving/Restoring|Request - Not Applicable|2009-04-05 01:20:50||GES-TR-CS-TVS EUS-WRC/WashingtonDC||Standard|Vulnerable|NAC|||||Brunson, Von P (206012626) |206012626|Washington|20016-2795|Mudiraj, Shravan|501448066|N| |Mudiraj, Shravan|US|Nac Enforcement of r11 will be turned on this coming Monday April 6th. Any computers without r11 installed and have Nac installed will be kicked off the network until remediated and the r11 agents are installed properly. Attached is the list of machines that need the CA R11 agent installed/Reinstalled. Analysts can install it from http://quarantine.nbcuni.ge.com/howtofix.asp .
Computer name: NUWBURNP1YB02XD
IP Address: 3.50.161.118
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Remove newline character from column spread over multiple lines in a file

Hi, I came across one issue recently where output from one of the columns of the table from where i am creating input file has newline characters hence, record in the file is spread over multiple lines. Fields in the file are separated by pipe (|) delimiter. As header will never have newline... (4 Replies)
Discussion started by: Prathmesh
4 Replies

2. Shell Programming and Scripting

How to remove newline character if it is the only character in the entire file.?

I have a file which comes every day and the file data look's as below. Vi abc.txt a|b|c|d\n a|g|h|j\n Some times we receive the file with only a new line character in the file like vi abc.txt \n (8 Replies)
Discussion started by: rak Kundra
8 Replies

3. Shell Programming and Scripting

Conditionally add character at end of line

Hi, I would like have a shell script to check every line in a file to see if it ends with ";". If this is NOT the last character ";" should be added. MyFile.csv : web9331801;01/01/2014 23:39:35;;"93962";353150256; web9331802;01/01/2014 23:44:29;;"479288";353153538; web9331803;01/01/2014... (14 Replies)
Discussion started by: vg77
14 Replies

4. Shell Programming and Scripting

Remove last newline character..

Hi all.. I have a text file which looks like below: abcd efgh ijkl (blank space) I need to remove only the last (blank space) from the file. When I try wc -l the file name,the number of lines coming is 3 only, however blank space is there in the file. I have tried options like... (14 Replies)
Discussion started by: Sathya83aa
14 Replies

5. Shell Programming and Scripting

Remove newline character between two delimiters

hi i am having delimited .dat file having content like below. test.dat(5 line of records) ====== PT2~Stag~Pt2 Stag Test. Updated~PT2 S T~Area~~UNCEF R20~~2012-05-24 ~2014-05-24~~ PT2~Stag y~Pt2 Stag Test. Updated~PT2 S T~Area~METR~~~2012-05-24~2014-05-24~~test PT2~Pt2 Stag Test~~PT2 S... (4 Replies)
Discussion started by: sushine11
4 Replies

6. Shell Programming and Scripting

Remove newline character or join the broken record

Hi, I have a very huge file, around 1GB of data. I want to remove the newline characters in the file but not preceded by the original end delimiter {} sample data will look like this 1234567 abcd{} 1234sssss as67 abcd{} 12dsad3dad 4sdad567 abcdsadd{} this should look like this... (6 Replies)
Discussion started by: ratheeshjulk
6 Replies

7. Shell Programming and Scripting

Remove \n <newline> character inside the records.

Hi, In my file, I have '\n' characters inside a single record. Because of this, a single records appears in many lines and looks like multiple records. In the below file. File 1 ==== 1,nmae,lctn,da\n t 2,ghjik,o\n ut,de\n fk Expected output after the \n removed File 2 =====... (5 Replies)
Discussion started by: machomaddy
5 Replies

8. Shell Programming and Scripting

any savant ? using AWK/SED to remove newline character between two strings : conditional removal

I'd like to remove (do a pattern or precise replacement - this I can handle in SED using Regex ) ---AFTER THE 1ST Occurrence ( i.e. on the 2nd occurrence - from the 2nd to fourth occurance ) of a specific string : type 1 -- After the 1st occurrence of 1 string1 till the 1st occurrence of... (4 Replies)
Discussion started by: sieger007
4 Replies

9. Shell Programming and Scripting

To remove the newline character while appending into a file

Hi All, We append the output of a file's size in a file. But a newline character is appended after the variable. Pls help how to clear this. filesize=`ls -l test.txt | awk `{print $5}'` echo File size of test.txt is $filesize bytes >> logfile.txt The output we got is, File size of... (4 Replies)
Discussion started by: amio
4 Replies

10. Shell Programming and Scripting

How to remove a newline character at the end of filename

Hi All, I have named a file with current date,time and year as follows: month=`date | awk '{print $2}'` date=`date | awk '{print $3}'` year=`date | awk '{print $6}'` time=`date +%Hh_%Mm_%Ss'` filename="test_"$month"_"$date"_"$year"_"$time".txt" > $filename The file is created with a... (2 Replies)
Discussion started by: amio
2 Replies
Login or Register to Ask a Question