05-27-2010
awk print $1 escape all special characters
I'm using awk '{print $1}' and it works most of the time to print the contents of a mysql query loop, but occationally I get a field with some special character in it, is there a way to tell awk to ignore all special characters between my FS? I have >186K records, so building a list of ALL special characters might be tough, though I've only noticed ' and ) so far. the FS is a , .
Last edited by unclecameron; 05-27-2010 at 09:39 PM..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I would like to display the following message from my shell (Korn) script
Copy "old_file.txt" to "new_file.txt"
My code looks as follows
print "Copy "old_file.txt" to "new_file.txt""
However, when I execute the script, I get the following output
Copy old_file.txt to... (6 Replies)
Discussion started by: rogers42
6 Replies
2. Shell Programming and Scripting
I have a file that is a log file for web traffic. I would like to convert the timestamp in it to unix time or epoch time.
I am using the date command in conjunction with awk to try to do this. Just
myfile:
28/Aug/1995:00:00:38 1 /pub/atomicbk/catalog/home.gif 813
28/Aug/1995:00:00:38 1... (3 Replies)
Discussion started by: jontjioe
3 Replies
3. Shell Programming and Scripting
Hi, I wish to replace a new line with br (html) but it doesn't seem to work
message=$(echo ${FORM_message} | tr '\r' '<br \/>' )
what it gives me seems to be ... b...?
I am also having problem escaping hash sign in cut command:
list=$(echo "$line" | cut -d'\#;\#' -f1) ;
my intention is... (2 Replies)
Discussion started by: ted_chou12
2 Replies
4. Shell Programming and Scripting
i need to replace the any special characters with escape characters like below.
test!=123-> test\!\=123
!@#$%^&*()-= to be replaced by
\!\@\#\$\%\^\&\*\(\)\-\= (8 Replies)
Discussion started by: laknar
8 Replies
5. Shell Programming and Scripting
Hello Everyone,
I need to read an encrypted password from the user and update that value in an xml file. I am trying to use "sed" for searching the appropriate tag and replacing this new value that get from the user. Since the encrypted password can contain special characters(like /,\,&,etc),... (4 Replies)
Discussion started by: majose
4 Replies
6. Shell Programming and Scripting
I am having issues escaping special characters in my AWK script as follows:
for id in `cat file`
do
grep $id in file2 | awk '\
BEGIN {var=""} \
{ if ( /stringwith+'|'+'50'chars/ ) {
echo "do this"
} else if ( /anotherString/ ) {
echo "do that"
} else {
... (4 Replies)
Discussion started by: purebc
4 Replies
7. Shell Programming and Scripting
Need help in escaping special characters in sed command.
Here is the the string which i am trying to find a replace with
From :- REQUEST_TYPE=PIXEL&MSG_ID={//MESSAGE_ID}
To :- REQUEST_TYPE=PIXEL&MSG_ID= X_EDELIVERY_MESSAGE_ID & BATCH_ID= X_EDELIVERY_BATCH_ID
Here is the sed command i am... (2 Replies)
Discussion started by: aakishore
2 Replies
8. Shell Programming and Scripting
Hi,
I have written a unix expect utility "ssh-login.exp" which connects (ssh) to remote host and execute some shell script. I am calling this "ssh-login.exp" utility from another shell script.
"ssh-login.exp" takes username, password, host and shell script path to execute on remote host. All... (1 Reply)
Discussion started by: Mahesh Desai
1 Replies
9. Shell Programming and Scripting
This is a bit off the wall, but I often need to run scripts where there are argument values that contain special characters.
For example,
$ ./process.exe -t M -N -o temp.mol.s -i ../molfiles/N,N\',N\'\'-trimethylbis\(hexamethylene\)triamine.mol && sfile_space_to_tab.sh temp.mol.s temp.s
It... (1 Reply)
Discussion started by: LMHmedchem
1 Replies
10. Shell Programming and Scripting
I have an application which I am integrating with that accepts the password via a CLI. I am running in to issues with passwords that contain special characters. I tried to escape them all, but I ran in to an issue where I cannot escape the characters
'
]
My attempt is as follows:
$... (2 Replies)
Discussion started by: AMG1978
2 Replies
makedbm(1M) makedbm(1M)
NAME
makedbm - make a Network Information System database
SYNOPSIS
nis_input_file] nis_output_name] nis_domain_name] nis_master_name] infile outfile
database_name
Remarks
The Network Information Service (NIS) was formerly known as Yellow Pages (yp). Although the name has changed, the functionality of the
service remains the same.
DESCRIPTION
generates databases (maps) for the Network Information System (NIS) from infile. A database created by consists of two files: and A data-
base contains records called dbm records composed of key-value pairs.
Each line of infile is converted to a single dbm record; all characters up to the first tab or space form the key, and the remainder of the
line is the value. If a value read from infile ends with the value for that record is continued onto the next line. The NIS clients must
interpret the character (which means that does not treat the as if it precedes a comment). If infile is a hyphen reads standard input.
always generates a special dbm record with the key whose value is the time of last modification of infile (or the current time, if infile
is This value is also known as the order number of a map, and prints it for a specified NIS map (see yppoll(1M)).
Another special dbm record created by has the key Its value is usually the host name retrieved by however, the option can be used to spec-
ify a different value (see gethostname(2)).
If the option is used, another special dbm record with the key is created. When this key exists in the NIS host.by* maps or ipnodes.by*
maps and the NIS host name resolution fails, the process will query the Internet domain name server, to provide the host name resolution.
Before using the option, it is recommended that the name services switch, be set to allow NIS host name resolution first. (Note that,
since the process only checks hosts.by* and ipnodes.by* for the existence of the key, using the option on any other NIS map will have no
effect. Also, the option should be used on both the *.byname and *.byaddr maps, not one exclusively.)
If the option is used, another special dbm record created is the key. If this key exists in an NIS map, will only allow privileged pro-
cesses (applications that can create reserved ports) to access the data within the map.
Options
recognizes the following options and command-line arguments.
Create a special dbm record with the key
This key, which is in the hosts.byname, hosts.byaddr, ipnodes.byname, and ipnodes.byaddr maps, allows the process to query the
Internet domain name server (see named(1M)).
Convert the keys of the given map to lowercase.
This command option allows host name matches to work independent of character-case distinctions.
Accept connections from secure NIS networks only.
Create a special dbm record with the key
and the value If the option is used, another special dbm record created is the key. If this key exists in an NIS map, will only
allow privileged processes to access the data within the map (that is, applications that can create reserved ports).
Create a special dbm record with the key
and the value nis_output_name.
Create a special dbm record with the key
and the value nis_domain_name.
Replace the value of the special dbm record whose key is
with nis_master_name.
Undo the
database_name (that is, write the contents of database_name to the standard output) one dbm record per line. A single space sepa-
rates each key from its value.
EXAMPLES
Shell scripts can be written to convert ASCII files such as to the key-value form used by For example,
#!/usr/bin/sh
/usr/bin/awk 'BEGIN { FS = ":" } { print $1, $0 }'
/etc/netgroup |
makedbm - netgroup
converts the file to a form that is read by to make the NIS map The keys in the database are names, and the values are the remainders of
the lines in the file.
AUTHOR
was developed by Sun Microsystems, Inc.
SEE ALSO
domainname(1), named(1M), ypinit(1M), ypmake(1M), yppoll(1M), gethostname(2), netgroup(4), ypfiles(4).
makedbm(1M)