Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help on awk.. reformating a file
Top Forums Shell Programming and Scripting Help on awk.. reformating a file Post 302130408 by blowtorch on Monday 6th of August 2007 05:43:30 AM
Old 08-06-2007
Do you have to use awk? Something like this works just as well:

Code:
#!/usr/bin/bash

changenumber=0
prevcol=""
while read col1 col2; do if [ "$prevcol" != "$col1" ]; then 
   prevcol=$col1
   changenumber=$(($changenumber+1))
fi
echo $col1 $col2 $changenumber
done < /path/to/file

 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk - reformating rows into columns

looking to do the following... What the data looks like server1 02/01/2008 groups 10 server1 03/01/2008 groups 15 server1 04/01/2008 groups 20 server2 02/01/2008 users 50 server2 03/01/2008 users 75 server2 04/01/2008 users 100 server2 04/01/2008 users 125 What I would like the... (1 Reply)
Discussion started by: jmd2004
1 Replies

2. UNIX for Advanced & Expert Users

Selectively Reformating a file using AWK

Dear users, I am new to AWK and have been battling with this one for close to a week now. Some of you did offer some help last week but I think I may not have explained myself very well. So I am trying again. I have a dataset that has the following format where the datasets repeat every... (5 Replies)
Discussion started by: sda_rr
5 Replies

3. Shell Programming and Scripting

Reformating ascii file with awk

Hello, I've a lot of ascii files that I would like to reformat : One of files's column (for exemple $5) contains increasing numbers (see exemple) : $5= 1 1 1 1 1 2 2 2 2 3 3 (2 Replies)
Discussion started by: Caribou
2 Replies

4. Shell Programming and Scripting

Rows to columns transposing and reformating.

----File attached. Input file =========== COL_1 <IP Add 1> COL_2 <Service1> COL_3 <ABCDEFG> COL_4 <IP ADD:PORT> COL_4 <IP ADD:PORT> COL_1 <IP Add 2> COL_2 <Service2> COL_2 <Service3> COL_2 <Service4> COL_3 <AAAABBB> COL_4 <IP ADD:PORT> COL_4 <IP ADD:PORT> COL_4 <IP... (27 Replies)
Discussion started by: bluethunder
27 Replies

5. Shell Programming and Scripting

Parse file using awk and work in awk output

hi guys, i want to parse a file using public function, the file contain raw data in the below format i want to get the output like this to load it to Oracle DB MARWA1,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 MARWA2,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 this the file raw format: Number of... (6 Replies)
Discussion started by: dagigg
6 Replies

6. Shell Programming and Scripting

reformating non-uniform strings

I have a set of free-form phone numbers that are not uniform and I want to reformat them into a standard uniform string. These are embedded at the end of a colon seperated file built by a large nawk + tr piping like such: XXXXX:YYYYY:ZZZZZ:(333)333-3333x33333 XXXXX:YYYYY:ZZZZZ:x44444... (9 Replies)
Discussion started by: lordsmiter
9 Replies

7. Shell Programming and Scripting

Splitting & reformating a single file

I have a bif text file with the following format: d1_03 fr:23 d1_03 fr:56 d1_03 fr:67 d1_03 fr:78 d1_01 fr:35 d1_01 fr:29 d1_01 fr:45 d2_09 fr:34 d2_09 fr:78 d3_98 fr:90 d3_98 fr:104 d3_98 fr:360 I have like thousands of such lines I want to reformat this file based on column 1... (3 Replies)
Discussion started by: Lucky Ali
3 Replies

8. UNIX for Dummies Questions & Answers

Reformating unix data

Hi i have a unix date in file a file like this '1313675999' in oracle i would do it like this select TO_CHAR ( TO_DATE ('01011970', 'DDMMYYYY')+ 1 / 24 / 60 / 60 * 1313675999,'YYYYMMDD') from dual how to achive the same in unix ? (8 Replies)
Discussion started by: phpsnook
8 Replies

9. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

LEARN ABOUT SUNOS

iconv_852

iconv_852(5)						Standards, Environments, and Macros					      iconv_852(5)

NAME

       iconv_852 - code set conversion tables for MS 852 (MS-DOS Latin 2)

DESCRIPTION

       The following code set conversions are supported:

       +--------------------------------------------------------------------+
       |		  Code Set Conversions Supported		    |
       +--------------+--------+--------------+--------+--------------------+
       |    Code      |Symbol  |Target Code   |Symbol  |   Target Output    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |ISO 8859-2    |iso2    | ISO Latin 2	    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |MS 1250       |win2    | Windows Latin 2    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |Mazovia       |maz     | Mazovia	    |
       +--------------+--------+--------------+--------+--------------------+
       |MS 852	      |dos2    |DHN	      |dhn     | Dom Handlowy Nauki |
       +--------------+--------+--------------+--------+--------------------+

CONVERSIONS

       The conversions are performed according to the following tables. All values in the tables are given in octal.

   MS 852 to ISO 8859-2
       For the conversion of MS 852 to ISO 8859-2, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |  ISO 8859-2	|    MS 852	 |  ISO 8859-2	 |
       |24-177	       | 40		|271-274	 |40		 |
       |200	       | 307		|275		 |257		 |
       |201	       | 374		|276		 |277		 |
       |202	       | 351		|277-305	 |40		 |
       |203	       | 342		|306		 |303		 |
       |204	       | 344		|307		 |343		 |
       |205	       | 371		|310-316	 |40		 |
       |206	       | 346		|317		 |244		 |
       |207	       | 347		|320		 |360		 |
       |210	       | 263		|321		 |320		 |
       |211	       | 353		|322		 |317		 |
       |212	       | 325		|323		 |313		 |
       |213	       | 365		|324		 |357		 |
       |214	       | 356		|325		 |322		 |
       |215	       | 254		|326		 |315		 |
       |216	       | 304		|327		 |316		 |
       |217	       | 306		|330		 |354		 |
       |220	       | 311		|331-334	 |40		 |
       |221	       | 305		|335		 |336		 |
       |222	       | 345		|336		 |331		 |
       |223	       | 364		|337		 |40		 |
       |224	       | 366		|340		 |323		 |
       |225	       | 245		|341		 |337		 |
       |226	       | 265		|342		 |324		 |
       |227	       | 246		|343		 |321		 |
       |230	       | 266		|344		 |361		 |
       |231	       | 326		|345		 |362		 |
       |232	       | 334		|346		 |251		 |
       |233	       | 253		|347		 |271		 |
       |234	       | 273		|350		 |300		 |
       |235	       | 243		|351		 |332		 |
       |236	       | 327		|352		 |340		 |
       |237	       | 350		|353		 |333		 |
       |240	       | 341		|354		 |375		 |
       |241	       | 355		|355		 |335		 |
       |242	       | 363		|356		 |376		 |
       |243	       | 372		|357		 |264		 |
       |244	       | 241		|360		 |255		 |
       |245	       | 261		|361		 |275		 |
       |246	       | 256		|362		 |262		 |
       |247	       | 276		|363		 |267		 |
       |250	       | 312		|364		 |242		 |
       |251	       | 352		|365		 |247		 |
       |252	       | 40		|366		 |367		 |
       |253	       | 274		|367		 |270		 |
       |254	       | 310		|370		 |260		 |
       |255	       | 272		|371		 |250		 |
       |256-264        | 40		|372		 |377		 |
       |265	       | 301		|374		 |330		 |
       |266	       | 302		|375		 |370		 |
       |267	       | 314		|376		 |40		 |
       |270	       | 252		|		 |		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to MS 1250
       For the conversion of MS 852 to MS 1250, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |    MS 1250	|    MS 852	 |   MS 1250	 |
       |200	       | 307		|270		 |252		 |
       |201	       | 374		|271-274	 |40		 |
       |202	       | 351		|275		 |257		 |
       |203	       | 342		|276		 |277		 |
       |204	       | 344		|277-305	 |40		 |
       |205	       | 371		|306		 |303		 |
       |206	       | 346		|307		 |343		 |
       |207	       | 347		|310-316	 |40		 |
       |210	       | 263		|317		 |244		 |
       |211	       | 353		|320		 |360		 |
       |212	       | 325		|321		 |320		 |
       |213	       | 365		|322		 |317		 |
       |214	       | 356		|323		 |313		 |
       |215	       | 217		|324		 |357		 |
       |216	       | 304		|325		 |322		 |
       |217	       | 306		|326		 |315		 |
       |220	       | 311		|327		 |316		 |
       |221	       | 305		|330		 |354		 |
       |222	       | 345		|331-334	 |40		 |
       |223	       | 364		|335		 |336		 |
       |224	       | 366		|336		 |331		 |
       |225	       | 274		|337		 |40		 |
       |226	       | 276		|340		 |323		 |
       |227	       | 214		|341		 |337		 |
       |230	       | 234		|342		 |324		 |
       |231	       | 326		|343		 |321		 |
       |232	       | 334		|344		 |361		 |
       |233	       | 215		|345		 |362		 |
       |234	       | 235		|346		 |212		 |
       |235	       | 243		|347		 |232		 |
       |236	       | 327		|350		 |300		 |
       |237	       | 350		|351		 |332		 |
       |240	       | 341		|352		 |340		 |
       |241	       | 355		|353		 |333		 |
       |242	       | 363		|354		 |375		 |
       |243	       | 372		|355		 |335		 |
       |244	       | 245		|356		 |376		 |
       |245	       | 271		|357		 |264		 |
       |246	       | 216		|360		 |255		 |
       |247	       | 236		|361		 |275		 |
       |250	       | 312		|362		 |262		 |
       |251	       | 352		|363		 |241		 |
       |252	       | 254		|364		 |242		 |
       |253	       | 237		|365		 |247		 |
       |254	       | 310		|366		 |367		 |
       |255	       | 272		|367		 |270		 |
       |256	       | 253		|370		 |260		 |
       |257	       | 273		|371		 |250		 |
       |260-264        | 40		|372		 |377		 |
       |265	       | 301		|374		 |330		 |
       |266	       | 302		|375		 |370		 |
       |267	       | 314		|376		 |40		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to Mazovia
       For the conversion of MS 852 to Mazovia, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |    Mazovia	|    MS 852	 |   Mazovia	 |
       |205	       | 40		|246-247	 |40		 |
       |206	       | 215		|250		 |220		 |
       |210	       | 222		|251		 |221		 |
       |212-213        | 40		|253		 |246		 |
       |215	       | 240		|254-270	 |40		 |
       |217	       | 225		|275		 |241		 |
       |220-226        | 40		|276		 |247		 |
       |227	       | 230		|306-336	 |40		 |
       |230	       | 236		|340		 |243		 |
       |233-234        | 40		|342		 |40		 |
       |235	       | 234		|343		 |245		 |
       |236-243        | 40		|344		 |244		 |
       |244	       | 217		|345-375	 |40		 |
       |245	       | 206		|		 |		 |
       +---------------+----------------+----------------+---------------+

   MS 852 to DHN
       For the conversion of MS 852 to DHN, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |    MS 852     |      DHN	|    MS 852	 |     DHN	 |
       |200-205        | 40		|244		 |200		 |
       |206	       | 212		|245		 |211		 |
       |207	       | 40		|246-247	 |40		 |
       |210	       | 214		|250		 |202		 |
       |211-214        | 40		|251		 |213		 |
       |215	       | 207		|253		 |220		 |
       |216	       | 40		|254-270	 |40		 |
       |217	       | 201		|275		 |210		 |
       |220-226        | 40		|276		 |221		 |
       |227	       | 206		|306-336	 |40		 |
       |230	       | 217		|340		 |205		 |
       |233-234        | 40		|342		 |40		 |
       |235	       | 203		|343		 |204		 |
       |236-237        | 40		|344		 |215		 |
       |242	       | 216		|345-375	 |40		 |
       |252	       | 254		|		 |		 |
       +---------------+----------------+----------------+---------------+

FILES

       /usr/lib/iconv/*.so	       conversion modules

       /usr/lib/iconv/*.t	       conversion tables

       /usr/lib/iconv/iconv_data       list of conversions supported by conversion tables

SEE ALSO

       iconv(1), iconv(3C), iconv(5)

SunOS 5.10							    18 Apr 1997 						      iconv_852(5)
All times are GMT -4. The time now is 03:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy