Shell Programming and Scripting

Having read and appreciating the comments, and being as overwhelmed as the others by the data files, and having removed the <CR> line terminators from the DOS/windows files, I'd like to propose for discussion (hoping to have guessed the requirements correctly)

Code:

awk     'FNR==NR        {T[$1]=$2; next}
         FNR==1         {$0=toupper($0) 
                         for (n=1; n<=100; n++) if ($n in T) C[$n]=n
                         getline
                         next   
                        }
                        {for (n in T) if (C[n]) print FNR, n, T[n], $4, $(C[n])
                        }
        ' OFS="," /tmp/paramaters.txt /tmp/CNAI_DUMP_RAW1.txt

This is working on a subset of the data; applying it to the entire data set as well as redirecting it to the desired output file is left to the reader.

Gautam Banerjee,

Some of the space separated key/value pairs of parameters.txt are malformed:

Code:

NCCPERM As Per BSIC PLAN
CS 1 for non MBC
CHAP 6 for MBC
CHAP 11 for BCCH on OL

Also, providing five lines of 4068 columns each is not a good example of an input datafile. Can you provide the columns that are pertinent to the problem at hand?

As Don Cragen as requested, please give better description of what you are trying to accomplish, including output? This should include something like:

For example, on line 4 of the input sample data, the value of the 5 column ("a.dent") is used as the lookup key in the parameters table. The returned value ("towel") is used as column 4 of the output file.

The result should look something like:

Code:

$1 $2 $4 lookup($5)

Also for discussion, here's how CNAI_DUMP_RAW1.txt appears when loaded into Gnumeric. Each line extends to column EZL. I don't suppose it matters how many columns that is?

Hi experts,

I have pasted a small sample of two inputs and one output desired.

Any suggestions on how to get the desired output using awk, sed or a shell script file?


Please suggest some code to achieve the desired output.csv

Code:

Parameter   Ideal Value     Cell Name       Actual Value
---------   -----------     ---------       ------------
accmin      Ranges          RBR201A         100
cchpwr      33              RBR201A         33
cchpwr      30              RBR201A         33
att         yes             RBR201A         yes
...
...
maxret      2               RBR201A         1

@ Gautam Banerjee
Is this sample output close to the output you are looking for?

Gautam Banarjee,

Can you check the parameters.txt file that your provided? There are differences between your OnGoto's postings. For example, the parameter accmin has a value of '100' as shown by your posting, while the file has 'RANGES', as shown by OnGoto.

Please also remember that standard CSV does not provide a method to highlight values or cells.

- DL

Please help us help you.

I applaud your efforts to show us reasonable sized sample inputs and corresonding output. But, PLEASE, don't show us pictures of data. (Especially with some data truncated due to field widths in the pictures of tables you show us.) Give us text (in CODE tags) that we can copy and paste into files we can use as test data to try to test code we might write to solve your problem!

I see that the name of one of your input files has changed from paramaters.txt to parameters.txt (and that is good), but why does parameters.txt show four data rows while your expected output has six data columns? Why is the 3rd column in your output (with heading limit1) present when limit1 does not appear in parameters.txt?

You don't show what field separators are to be used in your output. Although most .csv files use comma as the separator, that isn't always the case.

And, flat text .csv files don't contain red coloring. Explain how (or if) this distinctive output is supposed to actually appear in output.csv.

And, please be sure that the sample data you provide is representative of problems your script will have to handle. For example, your original data files contained things like:

Code:

NCCPERM As Per BSIC PLAN
CHAP 6 for MBC
CHAP 11 for BCCH on OL

which I assume in your latest example should now be:

Code:

nccperm As Per BSIC PLAN
chap 6 for MBC
chap 11 for BCCH on OL

but your latest sample doesn't show us anything like these cases.

Please explain what the output should look like for a column with the header nccperm? Should it be nccperm(As) or nccperm(As Per BSIC PLAN) or nccperm(as) or nccperm(as per basic plan) or something else?

Which input line is supposed to be used for chap? Or are there supposed to be two copies of that input column in the output.csv file with different values in parentheses on the header line?