Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Escaping non-readable characters using grep, sed or awk
Top Forums UNIX for Dummies Questions & Answers Escaping non-readable characters using grep, sed or awk Post 302399846 by seanwpaul on Monday 1st of March 2010 06:22:56 PM
Old 03-01-2010
Thanks for the replies. Coworker put me on the right path.

Instead of trying to skip over the bad data, just transform it to something usable.
Code:
grep.exe -F "20100207" crashers.hst | tr -dc "[:graph:][:space:]" | awk "{OFS=\",\"};{print $1,$2,$8,$14,$15"}"

this output allows me to get everything instead of having to skip out some of the lines of data, ultimately speeding up the whole process, since I don't have to filter out the errors anymore using multiple grep statements.

Code:
20100207,03:52:40,192.168.40.200,A,(7)A"E+5(3)217(3)123(2)11(3)dis(2)ds(4)test(3)com(0)
20100207,03:52:40,192.168.40.200,A,(7)A"E+5(3)217(3)123(2)11(2)ds(4)test(3)com(0)
20100207,03:52:40,192.168.40.115,PTR,(3)200(2)40(3)138(3)160(7)in-addr(4)test(0)
20100207,03:52:40,192.168.40.200,A,(7)A"E+5(3)217(3)123(2)11(4)test(3)com(0)

Now, if only it would solve my space issues from having the data uncompressed... heh.

Again, thanks.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

escaping special characters in file name...

dear, I would like to rename files in a dir to another format, so I write a bash shell script to handle it. But my problem now is how to handle files having special characters like spaces, (, ): "a b c (d).doc" It seems that I need to escape those characters before applying the "mv" command.... (1 Reply)
Discussion started by: lau0001
1 Replies

2. Shell Programming and Scripting

Delete not readable characters

Hi All, I wanted to delete all the unwanted characters in the string. ie, to delete all the characters which are not alpha numeric values. var1="a./bc" var2='abc/\."123' like to get the output as print var1 abc print var2 abc123 Could you guys help me out pls. Your help is... (3 Replies)
Discussion started by: ajilesh
3 Replies

3. Shell Programming and Scripting

Escaping Special Characters-Help

Hi All, I am having a trouble in passing special characters to a script. As I am new to bash script I dont know how to go and solve this. mypwd=(a+sdfg!h# if i pass $mypwd to a bash script, it is not accepting "(,!,+ etc". It would be a great help if some one can help to escape these... (3 Replies)
Discussion started by: Tuxidow
3 Replies

4. Shell Programming and Scripting

Escaping Special characters

I want to append the following line to /var/spool/cron/root: */7 * * * * /root/'Linux CPU (EDF).sh' > /dev/null 2>&1 How to accomplish this using echo? ---------- Post updated at 04:09 PM ---------- Previous update was at 04:07 PM ---------- "Linux CPU (EDF)" is actually stored in a... (11 Replies)
Discussion started by: proactiveaditya
11 Replies

5. Shell Programming and Scripting

grep or sed. How to remove certain characters

Here is my problem. I have a list of phone numbers that I want to use only the last 4 digits as PINs for something I am working on. I have all the numbers in a file but now I want to be removed all items EXCEPT the last 4 digits. I have seen sed commands and some grep commands but I am... (10 Replies)
Discussion started by: Sucio
10 Replies

6. Shell Programming and Scripting

Help with escaping xml characters in a file

Hi, I have a file xy.csv with the following data separated by pipe (|): BC-NACO|12>ISA43<TEST| A & A INC|FAMOUS'S AL| i need to escape the xml characters as below BC-NACO|12&gt;ISA43&lt;TEST| A &amp; A INC|FAMOUS&apos;S AL| Please advise (5 Replies)
Discussion started by: prasannarajesh
5 Replies

7. Shell Programming and Scripting

SED equivalent for grep -w -f with pattern having special characters

I'm looking for SED equivalent for grep -w -f. All I want is to search a list of patterns from a file. Also If the pattern doesn't match I do not want "null returned", rather I would prefer some text as place holder say "BLANK LINE" as I intend to process the output file based on line number. ... (1 Reply)
Discussion started by: novice_man
1 Replies

8. Shell Programming and Scripting

Escaping special characters

I'm attempting a little hack to get grep to highlight (change foreground color to red) a found string. Assuming a target file "test" consisting of the word "albert": My executable "algrep" consists of this: grep $1 $2 | sed "s/$1/\\\033 And when run: algrep al test Produces this:... (2 Replies)
Discussion started by: tiggyboo
2 Replies

9. Shell Programming and Scripting

sed replacing specific characters and control characters by escaping

sed -e "s// /g" old.txt > new.txt While I do know some control characters need to be escaped, can normal characters also be escaped and still work the same way? Basically I do not know all control characters that have a special meaning, for example, ?, ., % have a meaning and have to be escaped... (11 Replies)
Discussion started by: ijustneeda
11 Replies

10. Shell Programming and Scripting

sed or awk grep, that will only get the line with more characters.

Is there a command for sed and awk that will only sort the line with more characters? #cat file 123 12345 12 asdgjljhhho bac ss Output: asdgjljhhho #cat file2 11.2 12345.00 21.222 12345678.10 (2 Replies)
Discussion started by: invinzin21
2 Replies

LEARN ABOUT DEBIAN

arpsend

arpsend(8)							    Containers								arpsend(8)

NAME

       arpsend - send ARP requests

SYNOPSIS

       arpsend -D -e target_ip [ -e target_ip ...]  [-c count] [-w timeout] interface

       arpsend -U -i source_ip [-c count] [-w timeout] interface

DESCRIPTION

       Utility arpsend sends ARP packets on device interface to detect or update neighbours' ARP caches with a given IP.

COMMANDS

       Run utility with one of the following commands:

       -D     Send broadcast ARP request to detect neighbours with target_ip. You have to specify target_ip (-e option).

       -U     Send broadcast ARP request to update neighbours' ARP caches with source_ip. You have to specify source_ip (-i option).

OPTIONS

       -c count
	      Number of packets to send. Default is infinity.

       -w interval
	      Interval between packets, in seconds. Default is 1 second.

       -i source_ip_address
	      Set source IP address field in ARP packet.

       -e target_ip_address
	      Set  target  IP  address	field in ARP packet. Note that you can specify -e option multiple times to detect many IP addresses in one
	      utility call.

EXIT STATUS

       arpsend returns 0 upon successful execution. If something goes wrong, it returns an appropriate error code.

       1    EXC_USAGE
	      Usage error

       2    EXC_SYSTEM
	      System error

       3    EXC_RECV
	      ARP reply was received

EXAMPLES

       To send request on interface eth0 to detect any neighbour computers with IP 192.168.10.200:

	  arpsend -D -e 192.168.10.200 eth0

       To send request on interface eth0 to update neighbours' ARP caches with IP 192.168.10.200:

	  arpsend -U -i 192.168.10.200 eth0

NOTES

       Interface you use have to be arpable and not be loopback (i.e.  /sbin/ip link show interface should show neither NOARP nor  LOOPBACK  flags
       in interface parameters).

SEE ALSO

       vzctl(8).

LICENSE

       Copyright (C) 2000-2011, Parallels, Inc. Licensed under GNU GPL.

OpenVZ								    28 Jun 2011 							arpsend(8)
All times are GMT -4. The time now is 09:53 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy