formatting columns


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting formatting columns
# 1  
Old 03-29-2012
formatting columns

Hi

I have a file that is several gigs in size and basically I want to change the format of it. Obviously I cannot go through it manually.

The file looks like this:

Code:
897	2
901	2
905	2
909	2
913	2
917	2
921	2
925	2
929	2
933	2
937	2
941	2
945	2
949	0
953	0
957	0
961	0
965	0
969	0
973	1
977	1
981	1
985	1
989	1
993	1
997	1
1001	1
1005	1
1009	1

I want the output so that it will look like this:

Code:
897  945  2
949  969  0
973  1009  1

basically compressing the file into something more simple. The initial file is tab separated and it would be great to have the output the same way.

Thanks

Kyle
# 2  
Old 03-29-2012
This should do it based on your sample:

Code:
awk  '
    s"" != $2 {                  # s"" handles the case where $2 is 0 on the first record
            if( NR > 1 )
                printf( "%s\t%s\t%s\n", f, l, s );
            f = $1;
            s = $2;
            next;
    }

    { l = $1; }
    END { printf( "%s\t%s\t%s\n", f, $1, s ); }
' input-file >output-file

This User Gave Thanks to agama For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Bash formatting data into columns

Hi guys, I'm trying to create a table of aggregated data using just bash commands. My data is in three columns, for example: 2014-01-01 testA 64 2014-01-01 testB 27 2014-02-01 testA 31 2014-02-02 testB 29 2014-02-02 testC 12 And the result I am looking for is: ... (4 Replies)
Discussion started by: mccmjc
4 Replies

2. Shell Programming and Scripting

Compare 2 csv files by columns, then extract certain columns of matcing rows

Hi all, I'm pretty much a newbie to UNIX. I would appreciate any help with UNIX coding on comparing two large csv files (greater than 10 GB in size), and output a file with matching columns. I want to compare file1 and file2 by 'id' and 'chain' columns, then extract exact matching rows'... (5 Replies)
Discussion started by: bkane3
5 Replies

3. Shell Programming and Scripting

Perl syntax for formatting columns and text

Dear all, Pzl let me know what is the syntax for converting the columns format to text as i have lots of values for but when i put these values in xls sheet the values are automatically converted to and one more question i have is how to call values from shell script into perl script eg. ... (3 Replies)
Discussion started by: sagar_1986
3 Replies

4. Shell Programming and Scripting

Formatting columns in file

I have a script that creates a file with three column output. The columns look like this: Policy Name Name Volume VLS-EDWARDS-ARCHIVED_FILE-WINDOWS 10 12 XLZ-BASE-CYGWIN-ARCHIVED-FILE-LINUX 2 21 ZLX-GOLD-FILES-JAPANFILERS1-LINUX 20 27 ZLX-GOLD-FILES-JAPANFILERS2-LINUX13 29... (4 Replies)
Discussion started by: newbie2010
4 Replies

5. Shell Programming and Scripting

Combine columns from many files but keep them aligned in columns-shorter left column issue

Hello everyone, I searched the forum looking for answers to this but I could not pinpoint exactly what I need as I keep having trouble. I have many files each having two columns and hundreds of rows. first column is a string (can have many words) and the second column is a number.The files are... (5 Replies)
Discussion started by: isildur1234
5 Replies

6. Shell Programming and Scripting

Single command for add 2 columns and remove 2 columns in unix/performance tuning

Hi all, I have created a script which adding two columns and removing two columns for all files. Filename: Cust_information_1200_201010.txt Source Data: "1","Cust information","123","106001","street","1-203 high street" "1","Cust information","124","105001","street","1-203 high street" ... (0 Replies)
Discussion started by: onesuri
0 Replies

7. Shell Programming and Scripting

Formatting output in columns

I have a file which contains data in below format: nbkv28s MgmtReporting -> TradingDesk 1 nbkv28s RMBS -> Credits 178 nbkv28s RMBS -> PassThrough 96 nbkv28s RMBS -> Prepayment 111 nbkv28s RMBS -> RMBSHome 370 nbkv28s RMBS -> TradingStrategy 98 nbkvnze RMBS -> RMBSHome 85 nbkvugn GSF... (3 Replies)
Discussion started by: mohsin.quazi
3 Replies

8. UNIX for Dummies Questions & Answers

Formatting a line of data into columns

Hi all, I'm a little stuck with a data file I've been collecting data in. The file contains one field of data running continuously down the file and I can't work out how to format the data into three columns. This is a mock up of the file: Each r# is a random number and varies in length, this... (3 Replies)
Discussion started by: nistleloy
3 Replies

9. Shell Programming and Scripting

Formatting info into columns

Hi This question has kind of been asked before but I couldn't get any of the solutions to work. I need to format fields being cut from a file into columns so it looks like a table. e.g Full name Address Hiredate Joe Smith London 11.01.01 Bill King ... (8 Replies)
Discussion started by: straight_edge
8 Replies

10. UNIX for Dummies Questions & Answers

Text formatting to 132 columns

I want to take a file that is generated in 132 columns from a unix based report generator and transfer it to a windows environment and preserve the column length. Any ideas how I can do this so that whatever windows based text editor that reads the document will know it should be in 132 columns?... (16 Replies)
Discussion started by: jmossman
16 Replies
Login or Register to Ask a Question