Help with bash shell script


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with bash shell script
# 1  
Old 11-05-2011
Help with bash shell script

Hi,

I have a file in which records contains non ascii characters. The records are comma delimited and quoted.

The non ascii characters are found in a particular column.

Example records

"YY","AK000021","Ã","IO","PP"
"Y1","AK000022","Ã","PO","PP"
"Y2","AK000022","Ã","PO","PP"

I need to replace these special characters with null

After replacing it should look like this

"YY","AK000021","","IO","PP"
"Y1","AK000022","","PO","PP"
"Y2","AK000022","","PO","PP"


Please help me to write unix command to replace as above.

Thanks
Aks
# 2  
Old 11-05-2011
Do you mean "replace it with null" as in replace it with ASCII null, or "replace it with null" as in delete it?

Either's possible with tr.

Code:
# Delete
tr -d '[\177-\377]' < input > output

Code:
# Replace with ascii null
tr -s '[\177-\377]' '\000' < input > output

This User Gave Thanks to Corona688 For This Post:
# 3  
Old 11-06-2011
Thanks!! it is removing non ascii characters but, it it is removing pound(£) character which is there in other filed of the file. I want to retain pound character,

aim is to remove remove non ascii character only to that filed. Or in other way if highlighted filed has character other than P or Q then it should replace with empty value.

e.g
Sample File
------------
"Y3","I got £ 20","P","IO","PP"
"Y5","I got £ 20","Q","IO","PP"
"YY","I got £ 20","<88>","IO","PP"
"Y1","AK000022","ã","PO","PP"
"Y2","AK000022","¿","PO","PP"

Expected file
------------
"Y3","I got £ 20","P","IO","PP"
"Y5","I got £ 20","Q","IO","PP"
"YY","I got £ 20","","IO","PP"
"Y1","AK000022","","PO","PP"
"Y2","AK000022","","PO","PP"

Thanks
Aks

Last edited by akshu.agni; 11-06-2011 at 01:16 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

In Bash shell - the ps -ef shows only the /bin/bash but the script name is not displayed

In Bash shell - the ps -ef shows only the /bin/bash but the script name is not displayed ? Is there any way to get the script names for the process command ? --- Post updated at 08:39 AM --- in KSH (Korn Shell), my command output shows the script names but when run in the Bash Shell... (3 Replies)
Discussion started by: i4ismail
3 Replies

2. Shell Programming and Scripting

Different behavior between bash shell and bash script for cmd

So I'm trying to pass certain json elements as env vars and use them later on in a script. Sample json: JSON='{ "Element1": "file-123456", "Element2": "Name, of, company written in, a very weird way", "Element3": "path/to/some/file.txt", }' (part of the) script: for s... (5 Replies)
Discussion started by: da1
5 Replies

3. Shell Programming and Scripting

Help with Bash shell script

Hi All, I have a script which as below #!/bin/bash for i in `cat servers` do ssh uname@$i "df -t xfs --total | grep total"; done > out.txtOutput as below -------------- total 140583991104 118622795524 21961195580 85% - total 140583991104 112888595524 27695395580 ... (4 Replies)
Discussion started by: npk
4 Replies

4. Shell Programming and Scripting

Need help with bash shell script

I need to create digit day script that takes a single numeric argument and then it should print out the day of the week using the number modulo 7 formula e.g: 0 - Sunday 6- Saturday 131 - Friday I am fairly new to unix so I don't know how to use the number modulo 7 formula. Does the script need... (3 Replies)
Discussion started by: lukefrost96
3 Replies

5. Shell Programming and Scripting

Bash shell script to check if script itself is running

hi guys we've had nagios spewing false alarm (for the umpteenth time) and finally the customer had enough so they're starting to question nagios. we had the check interval increased from 5 minutes to 2 minutes, but that's just temporary solution. I'm thinking of implementing a script on the... (8 Replies)
Discussion started by: hedkandi
8 Replies

6. Shell Programming and Scripting

Bash Shell Script

HELP!My program ends after entering one choice---need help making it take multiple inputs,instead of terminating after displaying just one #!/bin/bash# Crude address databaseclear # Clear the screen.echo " Contact List"echo " ------- ----"echo "Choose one of the following... (6 Replies)
Discussion started by: help123
6 Replies

7. Shell Programming and Scripting

Bash shell script- help

I need to invoke a program on remote server using ssh in a shell script. In addition i would like to capture date/time and if there is any errors , then script should write to log file. can someone please help me out? (1 Reply)
Discussion started by: sam101
1 Replies

8. Shell Programming and Scripting

Bash Shell script--need help

Hi all, i am beginner to unix and trying out a shell script which does the following. i have to calculate a persons salary. his salary is read from the keyboard. he has two types of deductions. 40% as dearness allowance and 20% as house rent. i have to print the gross salary. here is the code... (5 Replies)
Discussion started by: Irishboy24
5 Replies

9. UNIX for Dummies Questions & Answers

Bash shell script

Hi Guys, I am trying to alter a script for my company. I need the start of it to go something like this. User is asked to input 8 numbers 8 numbers are written to a txt file ***** ***** ***** txt file is read ***** ***** The text file gets read in between other files represented by... (2 Replies)
Discussion started by: outthere_3
2 Replies

10. UNIX for Dummies Questions & Answers

need help with bash shell script

Hi guys! I have just started with shell programming!! I am having pronblem with variable subsitutuion. when i do egrep "*" marks this will give me the pattern match. but how can i catch the output of that result in a variable. if i say result = egrep "*" marks it gives me syntax... (2 Replies)
Discussion started by: vmtailor
2 Replies
Login or Register to Ask a Question