awk multiple lines


Login or Register for Dates, Times and to Reply

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users awk multiple lines
# 1  
awk multiple lines

When your data is consistent it is easy to use awk with multiple lines like this. Can we please make this portable so I can use this in both RHEL and AIX?

Code:
awk '{RS="/directory1" } $7 ~ /drwxr-xr-x/ {print $1 " "  $7}' file

What do I do when the data is not consistent? When your data is not consistent like this it does not work.
Code:
server1 | CHANGED | rc=0 >>
drwxr-xr-x. 8 root root 77 Apr 18  2018 /directory1
server2 | CHANGED | rc=0 >>
drwxr-xr-x. 7 root root 120 Feb 14  2019 /directory2
server3| FAILED | rc=2 >>
ls: /director3: No such file or directorynon-zero return code
server5 | FAILED | rc=2 >>
ls: cannot access /sirectory3: No such file or directorynon-zero return code

There is another problem I have. Sometimes the data has more than two lines.
Code:
server4| UNREACHABLE! => {
    "changed": false,
    "msg": "Data could not be sent to remote host \"server4\". Make sure this host can be reached over ssh: ",
    "unreachable": true
}


Last edited by cokedude; 12-05-2019 at 09:28 PM..
# 2  
You are using /directory1 as a record separator. That means awk just reads the text including \n characters which display. And not ignoring them using the default EOL operation - chop off the newline.

Try using gsub on each record to remove the newline character from $0, replace that with a space.

Whenever you mess with either pagination or carriage control you can get "unexpected results" in standard tools.
# 3  
I don't think you can have a swiss army knife solution to a wild card problem. Please decently describe the data conents / structure in all cases, for every case, in detail. Are above the only three cases, or are there more? Is that pipe symbol enclosed in spaces or not always? Could it be used as a field separator? WIll the more-than-four-line data always be using braces to enclose the last field? One level of braces only?

You seem to want to print sth. like
Code:
server1 drwxr-xr-x
server2 drwxr-xr-x

in the "good cases". What should be the output in the "FAILED" cases? What in the multiline case?


You could use sth. like this to get the full records to operate upon:

Code:
awk -F\| '
function RDREST()       {getline X; $0 = $0 " | " X
                        }
/{$/    {while (! /}/) RDREST()
        }
NF < 4  {RDREST()
        }
1
' file
server1 | CHANGED | rc=0 >> | drwxr-xr-x. 8 root root 77 Apr 18  2018 /directory1
server2 | CHANGED | rc=0 >> | drwxr-xr-x. 7 root root 120 Feb 14  2019 /directory2
server3 | FAILED | rc=2 >> | ls: /director3: No such file or directorynon-zero return code
server5 | FAILED | rc=2 >> | ls: cannot access /sirectory3: No such file or directorynon-zero return code
server4 | UNREACHABLE! => { |     "changed": false, |     "msg": "Data could not be sent to remote host \"server4\". Make sure this host can be reached over ssh: ", |     "unreachable": true | }


Last edited by RudiC; 12-06-2019 at 09:38 AM..
This User Gave Thanks to RudiC For This Post:
Login or Register for Dates, Times and to Reply

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #462
Difficulty: Medium
NTPv4 introduced a 256-bit date format: 128 bits for the second and 128 bits for the fractional-second.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging multiple lines to columns with awk, while inserting commas for missing lines

Hello all, I have a large csv file where there are four types of rows I need to merge into one row per person, where there is a column for each possible code / type of row, even if that code/row isn't there for that person. In the csv, a person may be listed from one to four times... (9 Replies)
Discussion started by: RalphNY
9 Replies

2. Shell Programming and Scripting

awk to filter multiple lines

Hi. I need to filter lines based upon matches in multiple tab-separated columns. For all matching occurrences in column 1, check the corresponding column 4. IF all column 4 entries are identical, discard all lines. If even one entry in column 4 is different, then keep all lines. How can I... (5 Replies)
Discussion started by: owwow14
5 Replies

3. Shell Programming and Scripting

Awk match multiple columns in multiple lines in single file

Hi, Input 7488 7389 chr1.fa chr1.fa 3546 9887 chr5.fa chr9.fa 7387 7898 chrX.fa chr3.fa 7488 7389 chr21.fa chr3.fa 7488 7389 chr1.fa chr1.fa 3546 9887 chr9.fa chr5.fa 7898 7387 chrX.fa chr3.fa Desired Output 7488 7389 chr1.fa chr1.fa 2 3546 9887 chr5.fa chr9.fa 2... (2 Replies)
Discussion started by: jacobs.smith
2 Replies

4. Shell Programming and Scripting

awk if conditional, multiple lines

Hi experts, I have a file with hundreds of lines that looks something like this: Cake 1 3 4 2 3 1 3 Onion 3 2 4 1 3 4 2 Apple 2 3 4 4 1 2 1 Orange 4 3 4 1 2 4 1 Cake 3 1 4 2 4 2 1 Onion 2 4 2 1 4 2 1 Apple 4 3 3 3 3 2 1 Orange 2 1 2 2 2 4 1 Cake 4 3 4 3 1 3 3 ... I'm trying to... (2 Replies)
Discussion started by: david_seeds
2 Replies

5. Shell Programming and Scripting

inserting multiple lines with awk

awk '/<login-module code="com.nlayers.seneca.security.LdapLogin" flag="sufficient">/{p++} /<login-module code="com.nlayers.seneca.security.LdapLogin" flag="sufficient">/ && p==1 {$0="Mulitple lines here\n"$0}1' login-config.xml In the above awk code inside shell script, i am having problems when... (1 Reply)
Discussion started by: sunrexstar
1 Replies

6. Shell Programming and Scripting

displaying multiple lines using AWk

say I'm doing awk 'NR==534' Is there a way to display 534 535 536 537? without appending to a variable? per line? maybe an easier way with a different command? My first impression was NR==534-537 but that would be too easy :P (2 Replies)
Discussion started by: puttster
2 Replies

7. Shell Programming and Scripting

AWK record in multiple lines

Hi everyboby this is my problem I Have this input 1111;222 222 2;333 3333;4444 111; 22222;33 33; 444 and I need this output 1111;2222222;3333333;4444 (15 Replies)
Discussion started by: agritur
15 Replies

8. Shell Programming and Scripting

Awk to Break lines to multiple lines.

Input File: nawk -F "|" '{ for(i=1;i<=NF;i++) { if (i == 2) {gsub(",","#",$i);z=split($i,a,"")} else if (i == 3) {gsub(",","#",$i);z=split($i,b,"")} } if(z > 0) for(i=1;i<=z;i++) print $1,a,"Test"; if(w > 0) for(j=1;j<=w;j++) ... (1 Reply)
Discussion started by: pinnacle
1 Replies

9. UNIX for Dummies Questions & Answers

print multiple lines with awk

Hi everyone! I'm not new to Unix, but I've never used awk before. I tried to look up this information on several sites and forums, I also looked in the documentation but I haven't found a solution yet. I would like to print the previous 3 lines before and the following 4 lines after the... (6 Replies)
Discussion started by: djcsabus
6 Replies

10. Shell Programming and Scripting

Awk Join multiple lines

Hi, I have data with broken lines: Sample data: "12"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|"2453748"|"08:10:50" "16"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|" 2453748"|"08:15:50" "16"|"25"|"a"|"b"|" c"|"d"|"e"|"f"|"2453748"|"08:19:50" "16"|"25"|"a"|"b"|"c"|"d"|"e"|"f"|"2453748"|"08:19:50" In the... (5 Replies)
Discussion started by: hitmansilentass
5 Replies