05-27-2010
awk print $1 escape all special characters
I'm using awk '{print $1}' and it works most of the time to print the contents of a mysql query loop, but occationally I get a field with some special character in it, is there a way to tell awk to ignore all special characters between my FS? I have >186K records, so building a list of ALL special characters might be tough, though I've only noticed ' and ) so far. the FS is a , .
Last edited by unclecameron; 05-27-2010 at 09:39 PM..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I would like to display the following message from my shell (Korn) script
Copy "old_file.txt" to "new_file.txt"
My code looks as follows
print "Copy "old_file.txt" to "new_file.txt""
However, when I execute the script, I get the following output
Copy old_file.txt to... (6 Replies)
Discussion started by: rogers42
6 Replies
2. Shell Programming and Scripting
I have a file that is a log file for web traffic. I would like to convert the timestamp in it to unix time or epoch time.
I am using the date command in conjunction with awk to try to do this. Just
myfile:
28/Aug/1995:00:00:38 1 /pub/atomicbk/catalog/home.gif 813
28/Aug/1995:00:00:38 1... (3 Replies)
Discussion started by: jontjioe
3 Replies
3. Shell Programming and Scripting
Hi, I wish to replace a new line with br (html) but it doesn't seem to work
message=$(echo ${FORM_message} | tr '\r' '<br \/>' )
what it gives me seems to be ... b...?
I am also having problem escaping hash sign in cut command:
list=$(echo "$line" | cut -d'\#;\#' -f1) ;
my intention is... (2 Replies)
Discussion started by: ted_chou12
2 Replies
4. Shell Programming and Scripting
i need to replace the any special characters with escape characters like below.
test!=123-> test\!\=123
!@#$%^&*()-= to be replaced by
\!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
Discussion started by: laknar
8 Replies
5. Shell Programming and Scripting
Hello Everyone,
I need to read an encrypted password from the user and update that value in an xml file. I am trying to use "sed" for searching the appropriate tag and replacing this new value that get from the user. Since the encrypted password can contain special characters(like /,\,&,etc),... (4 Replies)
Discussion started by: majose
4 Replies
6. Shell Programming and Scripting
I am having issues escaping special characters in my AWK script as follows:
for id in `cat file`
do
grep $id in file2 | awk '\
BEGIN {var=""} \
{ if ( /stringwith+'|'+'50'chars/ ) {
echo "do this"
} else if ( /anotherString/ ) {
echo "do that"
} else {
... (4 Replies)
Discussion started by: purebc
4 Replies
7. Shell Programming and Scripting
Need help in escaping special characters in sed command.
Here is the the string which i am trying to find a replace with
From :- REQUEST_TYPE=PIXEL&MSG_ID={//MESSAGE_ID}
To :- REQUEST_TYPE=PIXEL&MSG_ID= X_EDELIVERY_MESSAGE_ID & BATCH_ID= X_EDELIVERY_BATCH_ID
Here is the sed command i am... (2 Replies)
Discussion started by: aakishore
2 Replies
8. Shell Programming and Scripting
Hi,
I have written a unix expect utility "ssh-login.exp" which connects (ssh) to remote host and execute some shell script. I am calling this "ssh-login.exp" utility from another shell script.
"ssh-login.exp" takes username, password, host and shell script path to execute on remote host. All... (1 Reply)
Discussion started by: Mahesh Desai
1 Replies
9. Shell Programming and Scripting
This is a bit off the wall, but I often need to run scripts where there are argument values that contain special characters.
For example,
$ ./process.exe -t M -N -o temp.mol.s -i ../molfiles/N,N\',N\'\'-trimethylbis\(hexamethylene\)triamine.mol && sfile_space_to_tab.sh temp.mol.s temp.s
It... (1 Reply)
Discussion started by: LMHmedchem
1 Replies
10. Shell Programming and Scripting
I have an application which I am integrating with that accepts the password via a CLI. I am running in to issues with passwords that contain special characters. I tried to escape them all, but I ran in to an issue where I cannot escape the characters
'
]
My attempt is as follows:
$... (2 Replies)
Discussion started by: AMG1978
2 Replies
LEARN ABOUT ULTRIX
makedbm
makedbm(8yp) makedbm(8yp)
Name
makedbm - make a yellow pages dbm file
Syntax
makedbm [ -i yp_input_file ] [ -o yp_output_name ] [ -d yp_domain_name ] [ -m yp_master_name ] infile outfile
makedbm [ -u dbmfilename ]
Description
The command takes the file specified by the argument infile and converts it to a pair of files in format, namely and Each line of the input
file is converted to a single record. All characters up to the first tab or space form the key, and the rest of the line is defined as the
key's associated data. If a line ends with a backslash (), the data for that record is continued onto the next line. It is left for the
clients of the yellow pages to interpret the number sign (#); does not treat it as a comment character. The infile parameter can be a
hyphen (-), in which case reads the standard input.
The command is meant to be used in generating files for the yellow pages service. The command generates a special entry with the key
yp_last_modified, which is the date of infile.
Options
-i Create a special entry with the key yp_input_file.
-o Create a special entry with the key yp_output_name.
-d Create a special entry with the key yp_domain_name.
-m Create a special entry with the key yp_master_name. If no master host name is specified, yp_master_name will be set to the local
host name.
-u Undo a file. That is, print out a file one entry per line, with a single space separating keys from values.
Examples
The following example shows how a combination of commands can be used to make the yellow pages files and from the file. The percent sign
(%) signifies the system prompt.
% awk 'BEGIN { FS = ":"; OFS = ""; }
{ print $1, $0 }' /etc/passwd > ptmp
% makedbm ptmp passwd.byname
% rm ptmp
The command creates the file ptmp which is in a form usable by The command uses the ptmp file to create the yellow pages dbm files and The
command removes the ptmp file.
See Also
yppasswd(1yp), dbm(3x), ypmake(8yp)
makedbm(8yp)