Problems with awk (fatal error) and paste (two variables into one column-by-column) Post: 302922580

Sponsored Content

Top Forums Shell Programming and Scripting Problems with awk (fatal error) and paste (two variables into one column-by-column) Post 302922580 by vgbraymond on Monday 27th of October 2014 02:37:15 AM

10-27-2014

Registered User

Quote:

Originally Posted by neutronscott

You need to quote every variable expansion. Likely your $BaseForAveraging ends up with whitespace in it and awk sees that as the program to execute and the next parameter (your actual awk code) as a file to open to reading.

There are a lot of bad practices going on here. Please give us sample input and sample output and you can likely do this a lot cleaner with just 1 invocation of awk.

Hi Neutronscott,
Thanks for your reply.

I have a data file, in which there are 48 repetitions of the following block of data.
In each block, there are 2 parts: "Direct signal" and "Cross-talk" (I have bolded them).
I then extract two sets of information (I underlined them) under only the "Direct signal" section.
1. Number of signal records
2. Data (1st column: time // 2nd column: data value)

Data consists of two columns. I divide each value in the second column by the number of signal records.
Therefore, for each block, I will get 2 columns of data. It is known that the 1st column (time) of each block is the same.
The last step is to add the 2nd columns of every three consecutive blocks up, and tabulate the result. I will get 48/3 = 16 "added" columns. I will finally insert a first column back.
This is what I am trying to implement.

By quoting the variables, do I have to replace every $var with "$var"?

Input:

Code:

% Created 16/09/14 At 16.04.46 < none > SIGNAL   "Direct signal, group   1     "

  Group 1 consists of:
     Wire 1 with label W at (x,y)=(0,0) and at 1600 V
 Number of signal records:  1000
 Units used: time in second, current in Ampere.
 .STIMULUS signal PWL
 + TIME_SCALE_FACTOR =  0.100E-11
 + VALUE_SCALE_FACTOR =  0.100E-11
 + (  0.00000000E+00   0.00000000E+00
 +     0.30000002E-09   0.00000000E+00
### 996 more rows of data here
 +     0.29940000E-06   0.00000000E+00
 +     0.29970002E-06   0.00000000E+00 )
% Created 16/09/14 At 16.04.46 < none > SIGNAL   "Cross-talk, group   1        "

  Group 1 consists of:
     Wire 1 with label W at (x,y)=(0,0) and at 1600 V
 Number of signal records:  1000
 Units used: time in second, current in Ampere.
 .STIMULUS signal PWL
 + TIME_SCALE_FACTOR =  0.100E-11
 + VALUE_SCALE_FACTOR =  0.100E-11
 + (  0.00000000E+00   0.00000000E+00
 +     0.30000002E-09   0.00000000E+00
### 996 more rows of data here
 +     0.29940000E-06   0.00000000E+00
 +     0.29970002E-06   0.00000000E+00 )

Output:

Code:

0.00000000E+00   0.00000000000E+00 ###14 more columns here  0.00000000000E+00 
0.30000002E+00   0.00000000001E+00 ###14 more columns here  0.00000000001E+00 
### 996 more rows of data here
0.29940000E+00   0.00000000005E+00 ###14 more columns here  0.00000000005E+00 
0.29970002E+00   0.00000000002E+00 ###14 more columns here  0.00000000002E+00

vgbraymond

View Public Profile for vgbraymond

Find all posts by vgbraymond

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

paste each 10 lines of single column to several column

Hi, I need to paste each 10 lines of single column to several columns. Please, can anyone tell me how to write in awk? Input File: 22 34 36 12 17 19 15 11 89 99 56 38 29

2. Shell Programming and Scripting

for each different entry in column 1 extract maximum values from column 2 in unix/awk

Hello, I have 2 columns (1st column has multiple entries but the corresponding values in the column 2 may be the same or different.) however I want to extract unique values for each entry in column 1 by assigning the max value from column 2 SDF4 -0.211654 SDF4 0.978068 ...

3. Shell Programming and Scripting

AWK script to create max value of 3rd column, grouping by first column

Hi, I need an awk script (or whatever shell-construct) that would take data like below and get the max value of 3 column, when grouping by the 1st column. clientname,day-of-month,max-users ----------------------------------- client1,20120610,5 client2,20120610,2 client3,20120610,7...

4. Shell Programming and Scripting

awk or sed: change the color of a column w/o screwing up column spacing

Hey folks. I wrote a little awk script that summarizes /proc/net/dev info and then pipes it to the nix column command to set up column spacing appropriately. Here's some example output: Iface RxMBytes RxPackets RxErrs RxDrop TxMBytes TxPackets TxErrs TxDrop bond0 9 83830...

5. Shell Programming and Scripting

awk Print New Column For Every Two Lines and Match On Multiple Column Values to print another column

Hi, My input files is like this axis1 0 1 10 axis2 0 1 5 axis1 1 2 -4 axis2 2 3 -3 axis1 3 4 5 axis2 3 4 -1 axis1 4 5 -6 axis2 4 5 1 Now, these are my following tasks 1. Print a first column for every two rows that has the same value followed by a string. 2. Match on the...

6. UNIX for Dummies Questions & Answers

Paste column from one file as column of

Any shortcuts for doing this? I need to cut the column 4 values from File1 and paste them as column4 values of File2, but only for the (first) same number of lines as File1 . All rows in File1 are contained in File2 in the exact same order, so the cut paste should work. File1 (with header and 3...

7. Shell Programming and Scripting

awk to Sum columns when other column has duplicates and append one column value to another with Care

Hi Experts, Please bear with me, i need help I am learning AWk and stuck up in one issue. First point : I want to sum up column value for column 7, 9, 11,13 and column15 if rows in column 5 are duplicates.No action to be taken for rows where value in column 5 is unique. Second point : For...

8. Shell Programming and Scripting

awk script to append suffix to column when column has duplicated values

Please help me to get required output for both scenario 1 and scenario 2 and need separate code for both scenario 1 and scenario 2 Scenario 1 i need to do below changes only when column1 is CR and column3 has duplicates rows/values. This inputfile can contain 100 of this duplicated rows of...

9. Shell Programming and Scripting

Need awk or Shell script to compare Column-1 of two different CSV files and print if column-1 matche

Example: I have files in below format file 1: zxc,133,joe@example.com cst,222,xyz@example1.com File 2 Contains: hxd hcd jws zxc cst File 1 has 50000 lines and file 2 has around 30000 lines : Expected Output has to be : hxd hcd jws

10. UNIX for Beginners Questions & Answers

How to copy a column of multiple files and paste into new excel file (next to column)?

I have data of an excel files as given below, file1 org1_1 1 1 2.5 100 org1_2 1 2 5.5 98 org1_3 1 3 7.2 88 file2 org2_1 1 1 2.5 100 org2_2 1 2 5.5 56 org2_3 1 3 7.2 70 I have multiple excel files as above shown. I have to copy column 1, column 4 and paste into a new excel file as...

LEARN ABOUT REDHAT

column

COLUMN(1)						    BSD General Commands Manual 						 COLUMN(1)

NAME

     column -- columnate lists

SYNOPSIS

     column [-tx] [-c columns] [-s sep] [file ...]

DESCRIPTION

     The column utility formats its input into multiple columns.  Rows are filled before columns.  Input is taken from file operands, or, by
     default, from the standard input.	Empty lines are ignored.

     The options are as follows:

     -c      Output is formatted for a display columns wide.

     -s      Specify a set of characters to be used to delimit columns for the -t option.

     -t      Determine the number of columns the input contains and create a table.  Columns are delimited with whitespace, by default, or with
	     the characters supplied using the -s option.  Useful for pretty-printing displays.

     -x      Fill columns before filling rows.

     Column exits 0 on success, >0 if an error occurred.

ENVIRONMENT

     COLUMNS  The environment variable COLUMNS is used to determine the size of the screen if no other information is available.

EXAMPLES

	   (printf "PERM LINKS OWNER GROUP SIZE MONTH DAY HH:MM/YEAR NAME
" 
	   ; ls -l | sed 1d) | column -t

SEE ALSO

     colrm(1), ls(1), paste(1), sort(1)

HISTORY

     The column command appeared in 4.3BSD-Reno.

BSD
								   June 6, 1993 							       BSD