Sponsored Content
Full Discussion: Problem with AWK and OFS
Top Forums UNIX for Dummies Questions & Answers Problem with AWK and OFS Post 302566594 by alister on Thursday 20th of October 2011 04:17:43 PM
Old 10-20-2011
Regarding the original code and why it failed, my guess is that your problem results from a misunderstanding of how RS is interpreted by your AWK.

POSIX states that only the first character of RS is used as the record separator. If RS consists of more than one character, the behavior is undefined.

Many AWK implementations (notably, the ones most likely to be found on a linux system, including gawk, mawk, and busybox's awk) treat a multicharacter RS as a regular expression.

So, one of two things is likely happening. Either your AWK is treating RS as the single character ^, in which case it's not splitting on the character sequence you intend. Or, your AWK is treating it as a regular expression, in which case it is also not splitting on the character sequence you intend.

If it's treating RS as a regular expression, what does ^^ mean? I'm not certain how AWK implementations which support regular expressions in RS handle anchors (^ and $), since in that context a newline isn't exactly meaningful (it is, afterall, what one is attempting to define when setting RS).

... after a few minutes spent dusting off and booting a 6 yr old version of debian with mawk ...

mawk supports multicharacter, regular expression RS values, and, as expected, RS='^^' does not split records on ^^. However, RS='\^\^' did the trick.

Regards,
Alister
This User Gave Thanks to alister For This Post:
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

OFS in awk

Hi, I have these out put field seperator changed to "|" in my awk command, but it didn't give me the result. Can someone help me find out why? ======================================= /bin/awk 'BEGIN { OFS="|" } { print $0 }' list.tmp.$$ > listtmp.$$ =======================================... (1 Reply)
Discussion started by: whatsfordinner
1 Replies

2. Shell Programming and Scripting

OFS in awk.

OFS is inbuild command in awk. I have a file file.txt abc : def : ghi jkl : mno: pqr stu : vwx :yzz code i used: awk -F ":" 'BEGIN {OFS="|"} {print $1,$2}' file.txt output: abc def jkl mno stu vwx but as i have used OFS="|" and i am expecting output as: abc | def jkl... (4 Replies)
Discussion started by: salil2012
4 Replies

3. Shell Programming and Scripting

AWK - OFS

Hi All, I have a comma seperated delimited file with 10 columns. I need to convert it into TAB seperated delimited file. awk -F"," '{print $1"\t"$2"\t"$3"\t"$4"\t"$5"\t"$6"\t"$7"\t"$8"\t"$9"\t"$10}' a.txt >> b.txt how to use OFS to get the same output. I have tried by googling, but it... (5 Replies)
Discussion started by: Amit.Sagpariya
5 Replies

4. Shell Programming and Scripting

Parsing XML in awk : OFS does not work as expected

Hi, I am trying to parse regular XML file where I have to reduce number of decimal points in some xml elements. I am using following AWK command to achive that : #!/bin/ksh EDITCMD='BEGIN { FS = ""; OFS=FS } { if ( $3 ~ "*\\.*" && length(substr($3,1+index($3,"."))) == 15 ) {... (4 Replies)
Discussion started by: martin.franek
4 Replies

5. Shell Programming and Scripting

Awk OFS issues

Hi Im trying to tidy up the output of a who command when it writes to a log, everything I've tried doesnt seem to work though, any help would be massively appreciated. Im using the awk command to set the OFS as tab. #!/bin/bash who >> /export/home/tjmoore/logusers awk -F 'BEGIN... (3 Replies)
Discussion started by: 02JayJay02
3 Replies

6. Shell Programming and Scripting

Awk OFS issues

Hi, Could anyone tell me what Im doing wrong here any help will be much appreciated #!/bin/bash ls -ltr /export/home/tjmoore > /export/home/tjmoore/log100 awk -F " " /export/home/tjmoore/log100 'BEGIN {OFS="\t";} {print $1,$2,$3,$4,$5, $6,$7,$8,$9;}' > /export/home/tjmoore/log1001 I... (9 Replies)
Discussion started by: 02JayJay02
9 Replies

7. UNIX for Dummies Questions & Answers

OFS in awk

Hello, I have an issue with adding commas as delimiters in this scenario: cat xtr3.rpl|head -5|awk 'BEGIN {OFS=","} {print $1,$2,$3,$4}' Produces this output: 00530083,0000000471,000000000000.00,000000000000.00 00530085,0000000471,000000000000.00,000000000000.00... (10 Replies)
Discussion started by: MIA651
10 Replies

8. Shell Programming and Scripting

OFS print awk

file: sasa|asasa|asasa|asas erer|Erer|rere|ererer Output needed : sasa:asasa:asasa:asas erer:Erer:rere:ererer Im getting output, when i use the $1,$2. awk -F'|' 'BEGIN{OFS=":";} {print $1,$2; }' file Output : sasa:asasa erer:Erer But when i need the whole column, i... (5 Replies)
Discussion started by: Ramesh M
5 Replies

9. Shell Programming and Scripting

OFS does not apply to few records in awk

Hi , I am having a problem with my awk oneliner , which for some reason leaves the first two records Input File $ cat file1 A1:B1:C1:NoLimit M1:M2:M3:Limit A2:B2:C2,C3,C4,C5 A3:B3:C3,C4,C5,C6,C7Desired output A1,B1,C1,NoLimit M1,M2,M3,Limit A2,B2,C2 ,,,C3 ,,,C4 ,,,C5 A3,B3,C3... (5 Replies)
Discussion started by: chidori
5 Replies

10. Shell Programming and Scripting

awk - OFS printing duplicate. Why?

Why the following code printing duplicate records? bash-4.1$ cat rm1 c1 c2 c3 l1 2 3 4 l2 2 3 2 bash-4.1$ awk '{print $0} OFS = "\n"' rm1 c1 c2 c3 c1 c2 c3 l1 2 3 4 l1 2 3... (4 Replies)
Discussion started by: quincyjones
4 Replies
regexp(3erl)						     Erlang Module Definition						      regexp(3erl)

NAME
regexp - Regular Expression Functions for Strings DESCRIPTION
Note: This module has been obsoleted by the re module and will be removed in a future release. This module contains functions for regular expression matching and substitution. EXPORTS
match(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match,Start,Length} | nomatch | {error,errordesc()} Start = Length = integer() Finds the first, longest match of the regular expression RegExp in String . This function searches for the longest possible match and returns the first one found if there are several expressions of the same length. It returns as follows: {match,Start,Length} : if the match succeeded. Start is the starting position of the match, and Length is the length of the matching string. nomatch : if there were no matching characters. {error,Error} : if there was an error in RegExp . first_match(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match,Start,Length} | nomatch | {error,errordesc()} Start = Length = integer() Finds the first match of the regular expression RegExp in String . This call is usually faster than match and it is also a useful way to ascertain that a match exists. It returns as follows: {match,Start,Length} : if the match succeeded. Start is the starting position of the match and Length is the length of the matching string. nomatch : if there were no matching characters. {error,Error} : if there was an error in RegExp . matches(String, RegExp) -> MatchRes Types String = RegExp = string() MatchRes = {match, Matches} | {error, errordesc()} Matches = list() Finds all non-overlapping matches of the expression RegExp in String . It returns as follows: {match, Matches} : if the regular expression was correct. The list will be empty if there was no match. Each element in the list looks like {Start, Length} , where Start is the starting position of the match, and Length is the length of the matching string. {error,Error} : if there was an error in RegExp . sub(String, RegExp, New) -> SubRes Types String = RegExp = New = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() Substitutes the first occurrence of a substring matching RegExp in String with the string New . A & in the string New is replaced by the matched substring of String . & puts a literal & into the replacement string. It returns as follows: {ok,NewString,RepCount} : if RegExp is correct. RepCount is the number of replacements which have been made (this will be either 0 or 1). {error, Error} : if there is an error in RegExp . gsub(String, RegExp, New) -> SubRes Types String = RegExp = New = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() The same as sub , except that all non-overlapping occurrences of a substring matching RegExp in String are replaced by the string New . It returns: {ok,NewString,RepCount} : if RegExp is correct. RepCount is the number of replacements which have been made. {error, Error} : if there is an error in RegExp . split(String, RegExp) -> SplitRes Types String = RegExp = string() SubRes = {ok,FieldList} | {error,errordesc()} Fieldlist = [string()] String is split into fields (sub-strings) by the regular expression RegExp . If the separator expression is " " (a single space), then the fields are separated by blanks and/or tabs and leading and trailing blanks and tabs are discarded. For all other values of the separator, leading and trailing blanks and tabs are not discarded. It returns: {ok, FieldList} : to indicate that the string has been split up into the fields of FieldList . {error, Error} : if there is an error in RegExp . sh_to_awk(ShRegExp) -> AwkRegExp Types ShRegExp AwkRegExp = string() SubRes = {ok,NewString,RepCount} | {error,errordesc()} RepCount = integer() Converts the sh type regular expression ShRegExp into a full AWK regular expression. Returns the converted regular expression string. sh expressions are used in the shell for matching file names and have the following special characters: * : matches any string including the null string. ? : matches any single character. [...] : matches any of the enclosed characters. Character ranges are specified by a pair of characters separated by a - . If the first character after [ is a ! , then any character not enclosed is matched. It may sometimes be more practical to use sh type expansions as they are simpler and easier to use, even though they are not as pow- erful. parse(RegExp) -> ParseRes Types RegExp = string() ParseRes = {ok,RE} | {error,errordesc()} Parses the regular expression RegExp and builds the internal representation used in the other regular expression functions. Such representations can be used in all of the other functions instead of a regular expression string. This is more efficient when the same regular expression is used in many strings. It returns: {ok, RE} if RegExp is correct and RE is the internal representation. : {error, Error} if there is an error in RegExpString . : format_error(ErrorDescriptor) -> Chars Types ErrorDescriptor = errordesc() Chars = [char() | Chars] Returns a string which describes the error ErrorDescriptor returned when there is an error in a regular expression. REGULAR EXPRESSIONS
The regular expressions allowed here is a subset of the set found in egrep and in the AWK programming language, as defined in the book, The AWK Programming Language, by A. V. Aho, B. W. Kernighan, P. J. Weinberger . They are composed of the following characters: c : matches the non-metacharacter c . c : matches the escape sequence or literal character c . . : matches any character. ^ : matches the beginning of a string. $ : matches the end of a string. [abc...] : character class, which matches any of the characters abc... Character ranges are specified by a pair of characters separated by a - . [^abc...] : negated character class, which matches any character except abc... . r1 | r2 : alternation. It matches either r1 or r2 . r1r2 : concatenation. It matches r1 and then r2 . r+ : matches one or more r s. r* : matches zero or more r s. r? : matches zero or one r s. (r) : grouping. It matches r . The escape sequences allowed are the same as for Erlang strings:  : backspace f : form feed : newline (line feed) : carriage return : tab e : escape v : vertical tab s : space d : delete ddd : the octal value ddd xhh : The hexadecimal value hh . x{h...} : The hexadecimal value h... . c : any other character literally, for example \ for backslash, " for ") To make these functions easier to use, in combination with the function io:get_line which terminates the input line with a new line, the $ characters also matches a string ending with "... " . The following examples define Erlang data types: Atoms [a-z][0-9a-zA-Z_]* Variables [A-Z_][0-9a-zA-Z_]* Floats (+|-)?[0-9]+.[0-9]+((E|e)(+|-)?[0-9]+)? Regular expressions are written as Erlang strings when used with the functions in this module. This means that any or " characters in a regular expression string must be written with as they are also escape characters for the string. For example, the regular expression string for Erlang floats is: "(\+|-)?[0-9]+\.[0-9]+((E|e)(\+|-)?[0-9]+)?" . It is not really necessary to have the escape sequences as part of the regular expression syntax as they can always be generated directly in the string. They are included for completeness and can they can also be useful when generating regular expressions, or when they are entered other than with Erlang strings. Ericsson AB stdlib 1.17.3 regexp(3erl)
All times are GMT -4. The time now is 08:23 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy