Answer to your questions:
Tell us what operating system you're using? AiX

Tell us what shell you're using? bash shell


The format of text files is based on generated sas programs that produce sas log files. The sas programmers sometimes add the following parameters to their code Memsize, and a directory path /sas/sasfoundation. A programmer doesn't always add Memsize or a directory path /sas/sasfoundation in his code.

Therefore the output in his log file will not have Memsize or a directory path
/sas/sasfoundation.

In all the log files, there is an assignment variable named Real Time with a numeric value. Real Time value is normally low. The value range between 0.0 - 0.9. Real Time value is high if the value is 1.0


I have several problems with the program: I hope you can help me.

1) the If else statement is throwing an error message. syntax error can't

Code:

    read
    {if ($1)|| ($2>1.0) || ($ 3) && ( $0)) printf $1 "\t" $2 "\t"" $3"\t" $0"\t";   
    elseif($2 < 1.0  else print ''}'
    ' *.log > progflag.csv.txt

What the below syntax is saying :


For example in filew.log if the following items don't exist: Memsize, SASFoundation and also if Real Time row value is less than 1.0 then no data is outputted to progflag.cvs.txt

The below show sample of the exact output I'm trying to produce from the sample input files to progflag.cvs.txt. filew.log.txt data isn't in the progflag.cvs.txt because it doesn't have the following criteria Memsize, SASFoundation and Real Time value greater than 1.0 :

Code:

Memsize        Second        SASEXE                  filename.txt
    200                            SASFoundation           file1x.log.txt
    100                            SASFoundation           file2x.log.txt
    400           5.1                                            filez.log.txt

2) I am not getting any data in progflag.cvs.txt even though Memsize, and SASFoundation are in some of the log files that the program reads in


3) I am not receiving the progflag.cvs attachment via email

4) I added *.log | awk because I want the program to read in log files with the .log extension only. There are other files in the directory that have different extensions.

Code:

'*.log | awk -F '[=:;.]' '
  function pr() {if(NR>1) printf "%s\t%s\t%s\t%s\n", K[1],K[2],K[3],K[0]

I am getting the following error

Code:

*.log |awk -F [=:: not found.
   .] not found. syntax error at line 3: '(' not expected

what The program is doing is the followings:

searches for 3 selected items in each log files:

Code:

#!/bin/bash
cd /tmp/logs

'*.log | awk -F '[=:;.]' '
  function pr() {if(NR>1) printf "%s\t%s\t%s\t%s\n", K[1],K[2],K[3],K[0]}
  BEGIN {
      printf "MEMSIZE\tSECOND\tSASEXE\tFilename\n"
      for(i=split("memsize ,Real Time ,SASFoundation",A,",");i;i--) L[A[i]]=i
  }
  FNR==1 {
      pr()
       K[0]=FILENAME
      K[1]=K[2]=K[3]=x
  }
  $1 in L {v=$2;gsub("^[/ ]*","",v);gsub(/ *$/,"",v);K[L[$1]]=v}
  END{pr(
{if ($1) || ($2>1.0 ) || ( $ 3 ) &&  ($0)) printf $1 "\t" $2 "\t" $3"\t" $0"\t; elseif($2 < 1.0 else print ''}'
' *.log > progflag.csv

[ -s progflag.csv ] && mailx -s "subject text -a "Programs flagged" receiver@domain.com < progflag.csv

Moderator's Comments:

I have made a best effort attempt to correctly format your post. But, I am not able to understand a lot of what you are saying. I repeat: Use CODE tags to display sample intput. Use CODE tags to display sample output. Use CODE tags to display code. Do NOT use CODE tags to display questions, answers, or explanatory text. Use QUOTE tags to display text that is copied from another post or an external source. Do not use QUOTE tags to display explanatory text.