Sponsored Content
Top Forums Shell Programming and Scripting Substituting Characters using SED Post 302305677 by Franklin52 on Thursday 9th of April 2009 01:26:26 PM
Old 04-09-2009
Quote:
Originally Posted by altamaha
My example was not clear enough. I have 12000 rows in my user accounts, and I wish to replace any capitals in the 3rd field of any row with lowercase.

The 3rd field of the output file will be used as a join field with a second file.

Agan, I thank you for you help.

JB
This is the output I get, am I missing something?

Code:
$ cat file
HHC 1 BDE:Lastname, Firstname MI:FIRSTNAME.MI.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:FIRSTNAME.MI.Lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:FIRSTNAME.MI.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:FIRSTNAME.MI.Lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:FIRSTNAME.MI.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:FIRSTNAME.MI.Lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:FIRSTNAME.MI.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:FIRSTNAME.MI.Lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:FIRSTNAME.MI.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:FIRSTNAME.MI.Lastname@mil:SGT
$
$ awk -F: '{$3=tolower($3)}1' OFS=":" file
HHC 1 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 1 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
HHC 2 BDE:Lastname, Firstname MI:firstname.mi.lastname@mil:SGT
$

Regards
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Substituting with value of variable in Sed

Hi, I have a program in which i have to substitute a TAG in a file with the value of a variable. Code Snippet: ---------------- myvar=1234 sed 's/_TAG_/$myvar/' infile outfile When I run this command, the _TAG_ in the "infile" is substituted with "$myvar" but NOT the value "1234"... (1 Reply)
Discussion started by: jyotipg
1 Replies

2. Shell Programming and Scripting

SED to extract characters

Hi, Please let me know how do we write a piece of code to extract characters from a line using SED. (2 Replies)
Discussion started by: Shilpi
2 Replies

3. Shell Programming and Scripting

SED to extract characters

Hi, Please let me know how do we write a piece of code to extract characters from a line using SED. (1 Reply)
Discussion started by: Shilpi
1 Replies

4. Shell Programming and Scripting

issue with substituting using sed

have a fileA containing about 260 lines wherein i have to match 2 lines fileA blah blah OF 90 DAYS DOCS PERIOD 12/06/0" Pairs_Id 52006 Amount1 -300000.0 Amount2 15091500.10 Codifiers_Id 0 OriginalId 0 EOT --blah blah blah TBL Tradt_IN CardRate 0.0 hashAmount -15091500.0... (2 Replies)
Discussion started by: sunnyboy
2 Replies

5. Shell Programming and Scripting

Substituting a shell variable in sed

Hi guys, I'm trying to figure out how to use a shell variable inside my sed command. I just want to remove a certain part of a path. I've tried three different combinations and none of them work. Here are the three combinations: echo $file | sed 's/'$test'//' echo $file | sed "s/$test//"... (7 Replies)
Discussion started by: chu816
7 Replies

6. Shell Programming and Scripting

Remove the Characters '[' and ']' with Sed

Hi, I am new to Sed and would like to know if it is possible to remove the characters . I have a couple of files with a keyword and would like to remove the substring. I am Using sed s/// but Its not working Thanks for your Support Andrew Borg (2 Replies)
Discussion started by: andrewborg
2 Replies

7. Shell Programming and Scripting

sed replacing specific characters and control characters by escaping

sed -e "s// /g" old.txt > new.txt While I do know some control characters need to be escaped, can normal characters also be escaped and still work the same way? Basically I do not know all control characters that have a special meaning, for example, ?, ., % have a meaning and have to be escaped... (11 Replies)
Discussion started by: ijustneeda
11 Replies

8. Shell Programming and Scripting

Trouble with sed and substituting a string with special characters in variable

Hey guys, I know that title is a mouthful - I'll try to better explain my struggles a little better... What I'm trying to do is: 1. Query a db and output to a file, a list of column data. 2. Then, for each line in this file, repeat these values but wrap them with: ITEM{ ... (3 Replies)
Discussion started by: ampsys
3 Replies

9. Shell Programming and Scripting

getting error while substituting variable using sed..

I am using script for substitute one variable with another variable like below... below code works fine... sed 's/'$sub_fun'/'$To_sub'/g' But when i run the same code from the script getting below errors.. sed: -e expression #1, char 7: unterminated `s' command please help....... (2 Replies)
Discussion started by: pamu
2 Replies

10. Shell Programming and Scripting

Outputting characters after a given string and reporting the characters in the row below --sed

I have this fastq file: @M04961:22:000000000-B5VGJ:1:1101:9280:7106 1:N:0:86 GGGGGGGGGGGGCATGAAAACATACAAACCGTCTTTCCAGAAATTGTTCCAAGTATCGGCAACAGCTTTATCAATACCATGAAAAATATCAACCACACCA +test-1 GGGGGGGGGGGGGGGGGCCGGGGGFF,EDFFGEDFG,@DGGCGGEGGG7DCGGGF68CGFFFGGGG@CGDGFFDFEFEFF:30CGAFFDFEFF8CAF;;8... (10 Replies)
Discussion started by: Xterra
10 Replies
addresses(5)                                                    File Formats Manual                                                   addresses(5)

NAME
addresses - formats for Internet mail addresses INTRODUCTION
A mail address is a string of characters containing @. Every mail address has a local part and a domain part. The domain part is everything after the final @. The local part is everything before. For example, the mail addresses God@heaven.af.mil @heaven.af.mil @at@@heaven.af.mil all have domain part heaven.af.mil. The local parts are God, empty, and @at@. Some domains have owners. It is up to the owner of heaven.af.mil to say how mail messages will be delivered to addresses with domain part heaven.af.mil. The domain part of an address is interpreted without regard to case, so God@heaven.af.mil God@HEAVEN.AF.MIL God@Heaven.AF.Mil all refer to the same domain. There is one exceptional address that does not contain an @: namely, the empty string. The empty string cannot be used as a recipient address. It can be used as a sender address so that the real sender doesn't receive bounces. QMAIL EXTENSIONS
The qmail system allows several further types of addresses in mail envelopes. First, an envelope recipient address without an @ is interpreted as being at envnoathost. For example, if envnoathost is heaven.af.mil, the address God will be rewritten as God@heaven.af.mil. Second, the address #@[] is used as an envelope sender address for double bounces. Third, envelope sender addresses of the form pre@host-@[] are used to support variable envelope return paths (VERPs). qmail-send will re- write pre@host-@[] as prerecip=domain@host for deliveries to recip@domain. Bounces directly from qmail-send will come back to pre@host. CHOOSING MAIL ADDRESSES
Here are some suggestions on choosing mail addresses for the Internet. Do not use non-ASCII characters. Under RFC 822 and RFC 821, these characters cannot be used in mail headers or in SMTP commands. In prac- tice, they are regularly corrupted. Do not use ASCII control characters. NUL is regularly corrupted. CR and LF cannot be used in some combinations and are corrupted in all. None of these characters are usable on business cards. Avoid spaces and the characters "<>()[],;: These all require quoting in mail headers and in SMTP. Many existing mail programs do not handle quoting properly. Do not use @ in a local part. @ requires quoting in mail headers and in SMTP. Many programs incorrectly look for the first @, rather than the last @, to find the domain part of an address. In a local part, do not use two consecutive dots, a dot at the beginning, or a dot at the end. Any of these would require quoting in mail headers. Do not use an empty local part; it cannot appear in SMTP commands. Avoid local parts longer than 64 characters. Be wary of uppercase letters in local parts. Some mail programs (and users!) will incorrectly convert God@heaven.af.mil to god@heaven.af.mil. Be wary of the following characters: $&!#~`'^*|{} Some users will not know how to feed these characters safely to their mail programs. In domain names, stick to letters, digits, dash, and dot. One popular DNS resolver has, under the banner of security, recently begun destroying domain names that contain certain other characters, including underscore. Exception: A dotted-decimal IP address in brackets, such as [127.0.0.1], identifies a domain owned by whoever owns the host at that IP address, and can be used safely. In a domain name, do not use two consecutive dots, a dot at the beginning, or a dot at the end. This means that, when a domain name is broken down into components separated by dots, there are no empty components. Always use at least one dot in a domain name. If you own the mil domain, don't bother using the address root@mil; most users will be unable to send messages to that address. Same for the root domain. Avoid domain names longer than 64 characters. ENCODED ADDRESSES IN SMTP COMMANDS
RFC 821 defines an encoding of mail addresses in SMTP. For example, the addresses God@heaven.af.mil a"quote@heaven.af.mil The Almighty.One@heaven.af.mil could be encoded in RCPT commands as RCPT TO:<God@heaven.af.mil> RCPT TO:<a"quote@heaven.af.mil> RCPT TO:<The Almighty.One@heaven.af.mil> There are several restrictions in RFC 821 on the mail addresses that can be used over SMTP. Non-ASCII characters are prohibited. The local part must not be empty. The domain part must be a sequence of elements separated by dots, where each element is either a component, a sequence of digits preceded by #, or a dotted-decimal IP address surrounded by brackets. The only allowable characters in components are letters, digits, and dashes. Every component must (believe it or not) have at least three characters; the first character must be a let- ter; the last character must not be a hyphen. ENCODED ADDRESSES IN MAIL HEADERS
RFC 822 defines an encoding of mail addresses in certain header fields in a mail message. For example, the addresses God@heaven.af.mil a"quote@heaven.af.mil The Almighty.One@heaven.af.mil could be encoded in a To field as To: God@heaven.af.mil, <@brl.mil:"a"quote"@heaven.af.mil>, "The Almighty".One@heaven.af.mil or perhaps To: < "God"@heaven .af.mil>, "a"quote" (Who?) @ heaven . af. mil , God<"The Almighty.One"@heaven.af.mil> There are several restrictions on the mail addresses that can be used in these header fields. Non-ASCII characters are prohibited. The domain part must be a sequence of elements separated by dots, where each element either (1) begins with [ and ends with ] or (2) is a nonempty string of printable ASCII characters not including any of ".<>()[],;: and not including space. SEE ALSO
envelopes(5), qmail-header(5), qmail-inject(8), qmail-remote(8), qmail-smtpd(8) addresses(5)
All times are GMT -4. The time now is 01:44 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy