Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Reducing file lines in awk
Top Forums Shell Programming and Scripting Reducing file lines in awk Post 302574955 by vasanth.vadalur on Saturday 19th of November 2011 05:09:15 AM
Old 11-19-2011
Hi,

Thanks.

With Same Logic...
For the below input file

Code:
 
1 2 3 4       
1.275 3 1.325 3 
1.275 3 1.225 3.025 
1.325 3 1.375 3
1.375 3 1.425 3 
1.425 3 1.475 3 
1.475 3 1.525 3
1.525 3 1.575 3
1.625 3 1.575 3 
1.625 3 1.675 3 
1.675 3 1.725 3 
1.725 3 1.775 3 
1.775 3 1.825 3 
1.825 3 1.875 3 
1.875 3 1.925 3


Expected output
Code:
1 2 3 4    
1.275 3 1.925 3 
1.275 3 1.225 3.025

But output got is
Code:
1 2 3 4
1.275 3 1.325 3
1.275 3 1.225 3.025
1.325 3 1.575 3
1.625 3 1.575 3
1.625 3 1.925 3

Still repeats are there.

Where went wrong...

Smilie

---------- Post updated at 02:09 AM ---------- Previous update was at 12:36 AM ----------

Hi,

Since it is becoming confusing algorithm.

I have changed my algorithm to,

if $2==$4 add extra column as $5 which us a value of $2.

Find min.of $1 and maximum of $3 .

And final output will be,

Min.$1 $com.value max.$3 $com.value
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Help with splitting lines in a file using awk

I have a file which is one big long line of text about 10Kb long. Can someone provide a way using awk to introduce carriage returns every 40 chars in this file. Any other solutions would also be welcome. Thank you in advance. (5 Replies)
Discussion started by: martinbarretto
5 Replies

2. UNIX for Dummies Questions & Answers

Reducing file names

I have a script which includes an FTP. The filename is too long for my target area. The filename is HD012_ABCD_EFGH_061004_F_300_40. I need to the filename to be HD012_ABCD_EFGH_061004_F_. Any ideas. (5 Replies)
Discussion started by: paul1s
5 Replies

3. Solaris

reducing to root file size

My root file size has reached 80% and I am looking where all i can reduce the file size . Here is the output of top directories in / . To me none of this looks useful but not sure . We use an appplication and email. Which all can be deleted . Please advise . 2016989 989445 /var 930059 ... (2 Replies)
Discussion started by: Hitesh Shah
2 Replies

4. Shell Programming and Scripting

Select some lines from a txt file and create a new file with awk

Hi there, I have a text file with several colums separated by "|;#" I need to search the file extracting all columns starting with the value of "1" or "2" saving in a separate file just the first 7 columns of each row maching the criteria, with replacement of the saparators in the nearly created... (4 Replies)
Discussion started by: capnino
4 Replies

5. Shell Programming and Scripting

Reducing text file using similar lines

Hello, I am a java programmer but want to try unix for a purpose where I need to reduce a file using its first field.. Here is the sample data: admin;2;0;; admission;8;0;; aman;1;0;; caroline;0;4;; cook;0;4;; cook;2;0;; far;0;3;; far;1;5;; I am explaining the dataset first. There... (5 Replies)
Discussion started by: shekhar2010us
5 Replies

6. Shell Programming and Scripting

Counting lines in a file using awk

I want to count lines of a file using AWK (only) and not in the END part like this awk 'END{print FNR}' because I want to use it. Does anyone know of a way? Thanks a lot. (7 Replies)
Discussion started by: guitarist684
7 Replies

7. Shell Programming and Scripting

Reducing the decimal points of numbers (3d coordinates) in a file; how to input data to e.g. Python

I have a file full of coordinates of the form: 37.68899917602539 58.07500076293945 57.79100036621094 The numbers don't always have the same number of decimal points. I need to reduce the decimal points of all the numbers (there are 128 rows of 3 numbers) to 2. I have tried to do this... (2 Replies)
Discussion started by: crunchgargoyle
2 Replies

8. Shell Programming and Scripting

awk last n lines of file

Just my second week working on awk I need a hint for the following tasks. I want to limit my logfile from the very outset to 200 lines. All I do until now is head -c 10K >> /home/uplog.txt | awk 'END{print NR " swap " NF$5; exit}' /home/uplog.txt; After being read it shall print the very... (27 Replies)
Discussion started by: 1in10
27 Replies

9. Shell Programming and Scripting

awk remove/grab lines from file with pattern from other file

Sorry for the weird title but i have the following problem. We have several files which have between 10000 and about 500000 lines in them. From these files we want to remove lines which contain a pattern which is located in another file (around 20000 lines, all EAN codes). We also want to get... (28 Replies)
Discussion started by: SDohmen
28 Replies

10. UNIX for Beginners Questions & Answers

Reducing input file size after pattern search

I have a very large file with millions of entries identified by @M. I am using the following script to "extract" entries based on specific strings/patterns: #!/bin/bash if ] then file=$1 else echo "Input_file passed as an argument $1 is NOT found." exit; fi MID=(NULL "string-1"... (10 Replies)
Discussion started by: Xterra
10 Replies

LEARN ABOUT SUNOS

iconv_1251

iconv_1251(5)						Standards, Environments, and Macros					     iconv_1251(5)

NAME

       iconv_1251 - code set conversion tables for MS 1251 (Windows Cyrillic)

DESCRIPTION

       The following code set conversions are supported:

       +-------------------------------------------------------------------------+
       |		     Code Set Conversions Supported			 |
       +--------------+--------+--------------+--------+-------------------------+
       |    Code      |Symbol  |Target Code   |Symbol  |      Target Output	 |
       +--------------+--------+--------------+--------+-------------------------+
       |MS 1251       |win5    |ISO 8859-5    |iso5    | ISO 8859-5 Cyrillic	 |
       +--------------+--------+--------------+--------+-------------------------+
       |MS 1251       |win5    |KOI8-R	      |koi8    | KOI8-R 		 |
       +--------------+--------+--------------+--------+-------------------------+
       |MS 1251       |win5    |PC Cyrillic   |alt     | Alternative PC Cyrillic |
       +--------------+--------+--------------+--------+-------------------------+
       |MS 1251       |win5    |Mac Cyrillic  |mac     | Macintosh Cyrillic	 |
       +--------------+--------+--------------+--------+-------------------------+

CONVERSIONS

       The conversions are performed according to the following tables. All values in the tables are given in octal.

   MS 1251 to ISO 8859-5
       For the conversion of MS 1251 to ISO 8859-5, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |   MS 1251     |  ISO 8859-5	|   MS 1251	 |  ISO 8859-5	 |
       |24	       | 4		|310		 |270		 |
       |200	       | 242		|311		 |271		 |
       |201	       | 243		|312		 |272		 |
       |202	       | 40		|313		 |273		 |
       |203	       | 363		|314		 |274		 |
       |204-207        | 40		|315		 |275		 |
       |210	       | 255		|316		 |276		 |
       |211	       | 40		|317		 |277		 |
       |212	       | 251		|320		 |300		 |
       |213	       | 40		|321		 |301		 |
       |214	       | 252		|322		 |302		 |
       |215	       | 254		|323		 |303		 |
       |216	       | 253		|324		 |304		 |
       |217	       | 257		|325		 |305		 |
       |220	       | 362		|326		 |306		 |
       |221-227        | 40		|327		 |307		 |
       |230	       | 255		|330		 |310		 |
       |231	       | 40		|331		 |311		 |
       |232	       | 371		|332		 |312		 |
       |233	       | 40		|333		 |313		 |
       |234	       | 372		|334		 |314		 |
       |235	       | 374		|335		 |315		 |
       |236	       | 373		|336		 |316		 |
       |237	       | 377		|337		 |317		 |
       |241	       | 256		|340		 |320		 |
       |242	       | 376		|341		 |321		 |
       |243	       | 250		|342		 |322		 |
       |244-247        | 40		|343		 |323		 |
       |250	       | 241		|344		 |324		 |
       |251	       | 40		|345		 |325		 |
       |252	       | 244		|346		 |326		 |
       |253-254        | 40		|347		 |327		 |
       |255	       | 55		|350		 |330		 |
       |256	       | 40		|351		 |331		 |
       |257	       | 247		|352		 |332		 |
       |260-261        | 40		|353		 |333		 |
       |262	       | 246		|354		 |334		 |
       |263	       | 366		|355		 |335		 |
       |264-267        | 40		|356		 |336		 |
       |270	       | 361		|357		 |337		 |
       |271	       | 360		|360		 |340		 |
       |272	       | 364		|361		 |341		 |
       |273	       | 40		|362		 |342		 |
       |274	       | 370		|363		 |343		 |
       |275	       | 245		|364		 |344		 |
       |276	       | 365		|365		 |345		 |
       |277	       | 367		|366		 |346		 |
       |300	       | 260		|367		 |347		 |
       |301	       | 261		|370		 |350		 |
       |302	       | 262		|371		 |351		 |
       |303	       | 263		|372		 |352		 |
       |304	       | 264		|373		 |353		 |
       |305	       | 265		|374		 |354		 |
       |306	       | 266		|375		 |355		 |
       |307	       | 267		|376		 |356		 |
       +---------------+----------------+----------------+---------------+

   MS 1251 to KOI8-R
       For the conversion of MS 1251 to KOI8-R , all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |   MS 1251     |    KOI8-R	|   MS 1251	 |   KOI8-R	 |
       |24	       | 4		|310		 |351		 |
       |200	       | 261		|311		 |352		 |
       |201	       | 262		|312		 |353		 |
       |202	       | 40		|313		 |354		 |
       |203	       | 242		|314		 |355		 |
       |204-207        | 40		|315		 |356		 |
       |210	       | 255		|316		 |357		 |
       |211	       | 40		|317		 |360		 |
       |212	       | 271		|320		 |362		 |
       |213	       | 40		|321		 |363		 |
       |214	       | 272		|322		 |364		 |
       |215	       | 274		|323		 |365		 |
       |216	       | 273		|324		 |346		 |
       |217	       | 277		|325		 |350		 |
       |220	       | 241		|326		 |343		 |
       |221-227        | 40		|327		 |376		 |
       |230	       | 255		|330		 |373		 |
       |231	       | 40		|331		 |375		 |
       |232	       | 251		|332		 |377		 |
       |233	       | 40		|333		 |371		 |
       |234	       | 252		|334		 |370		 |
       |235	       | 254		|335		 |374		 |
       |236	       | 253		|336		 |340		 |
       |237	       | 257		|337		 |361		 |
       |241	       | 276		|340		 |301		 |
       |242	       | 256		|341		 |302		 |
       |243	       | 270		|342		 |327		 |
       |244-247        | 40		|343		 |307		 |
       |250	       | 263		|344		 |304		 |
       |251	       | 40		|345		 |305		 |
       |252	       | 264		|346		 |326		 |
       |253-254        | 40		|347		 |332		 |
       |255	       | 55		|350		 |311		 |
       |256	       | 40		|351		 |312		 |
       |257	       | 267		|352		 |313		 |
       |260-261        | 40		|353		 |314		 |
       |262	       | 266		|354		 |315		 |
       |263	       | 246		|355		 |316		 |
       |264-267        | 40		|356		 |317		 |
       |270	       | 243		|357		 |320		 |
       |271	       | 260		|360		 |322		 |
       |272	       | 244		|361		 |323		 |
       |273	       | 40		|362		 |324		 |
       |274	       | 250		|363		 |325		 |
       |275	       | 265		|364		 |306		 |
       |276	       | 245		|365		 |310		 |
       |277	       | 247		|366		 |303		 |
       |300	       | 341		|367		 |336		 |
       |301	       | 342		|370		 |333		 |
       |302	       | 367		|371		 |335		 |
       |303	       | 347		|372		 |337		 |
       |304	       | 344		|373		 |331		 |
       |305	       | 345		|374		 |330		 |
       |306	       | 366		|375		 |334		 |
       |307	       | 372		|376		 |300		 |
       +---------------+----------------+----------------+---------------+

   MS 1251 to PC Cyrillic
       For the conversion of MS 1251 to PC Cyrillic, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |   MS 1251     |  PC Cyrillic	|   MS 1251	 | PC Cyrillic	 |
       |24	       | 4		|332		 |232		 |
       |200-207        | 40		|333		 |233		 |
       |210	       | 260		|334		 |234		 |
       |211-227        | 40		|335		 |235		 |
       |230	       | 260		|336		 |236		 |
       |231-247        | 40		|337		 |237		 |
       |250	       | 360		|340		 |240		 |
       |251-254        | 40		|341		 |241		 |
       |255	       | 55		|342		 |242		 |
       |256-267        | 40		|343		 |243		 |
       |270	       | 361		|344		 |244		 |
       |271-277        | 40		|345		 |245		 |
       |300	       | 200		|346		 |246		 |
       |301	       | 201		|347		 |247		 |
       |302	       | 202		|350		 |250		 |
       |303	       | 203		|351		 |251		 |
       |304	       | 204		|352		 |252		 |
       |305	       | 205		|353		 |253		 |
       |306	       | 206		|354		 |254		 |
       |307	       | 207		|355		 |255		 |
       |310	       | 210		|356		 |256		 |
       |311	       | 211		|357		 |257		 |
       |312	       | 212		|360		 |340		 |
       |313	       | 213		|361		 |341		 |
       |314	       | 214		|362		 |342		 |
       |315	       | 215		|363		 |343		 |
       |316	       | 216		|364		 |344		 |
       |317	       | 217		|365		 |345		 |
       |320	       | 220		|366		 |346		 |
       |321	       | 221		|367		 |347		 |
       |322	       | 222		|370		 |350		 |
       |323	       | 223		|371		 |351		 |
       |324	       | 224		|372		 |352		 |
       |325	       | 225		|373		 |353		 |
       |326	       | 226		|374		 |354		 |
       |327	       | 227		|375		 |355		 |
       |330	       | 230		|376		 |356		 |
       |331	       | 231		|		 |		 |
       +---------------+----------------+----------------+---------------+

   MS 1251 to Mac Cyrillic
       For the conversion of MS 1251 to Mac Cyrillic, all characters not in the following table are mapped unchanged.

       +-----------------------------------------------------------------+
       |	       |     Conversions|Performed	 |		 |
       |   MS 1251     | Mac Cyrillic	|   MS 1251	 | Mac Cyrillic  |
       |24	       | 4		|260		 |241		 |
       |200	       | 253		|262		 |247		 |
       |201	       | 256		|263		 |264		 |
       |202	       | 40		|264		 |266		 |
       |203	       | 257		|266		 |246		 |
       |204	       | 327		|267		 |245		 |
       |205	       | 311		|270		 |336		 |
       |206	       | 240		|271		 |334		 |
       |207-211        | 40		|272		 |271		 |
       |212	       | 274		|273		 |310		 |
       |213	       | 40		|274		 |300		 |
       |214	       | 276		|275		 |301		 |
       |215	       | 315		|276		 |317		 |
       |216	       | 40		|277		 |273		 |
       |217	       | 332		|300		 |200		 |
       |220	       | 254		|301		 |201		 |
       |221	       | 324		|302		 |202		 |
       |222	       | 325		|303		 |203		 |
       |223	       | 322		|304		 |204		 |
       |224	       | 323		|305		 |205		 |
       |225	       | 40		|306		 |206		 |
       |226	       | 320		|307		 |207		 |
       |227	       | 321		|310		 |210		 |
       |230	       | 40		|311		 |211		 |
       |231	       | 252		|312		 |212		 |
       |232	       | 275		|313		 |213		 |
       |233	       | 40		|314		 |214		 |
       |234	       | 277		|315		 |215		 |
       |235	       | 316		|316		 |216		 |
       |236	       | 40		|317		 |217		 |
       |237	       | 333		|320		 |220		 |
       |240	       | 312		|321		 |221		 |
       |241	       | 330		|322		 |222		 |
       |242	       | 331		|323		 |223		 |
       |243	       | 267		|324		 |224		 |
       |244	       | 377		|325		 |225		 |
       |245	       | 242		|326		 |226		 |
       |246	       | 40		|327		 |227		 |
       |247	       | 244		|330		 |230		 |
       |250	       | 335		|331		 |231		 |
       |252	       | 270		|332		 |232		 |
       |253	       | 307		|333		 |233		 |
       |254	       | 302		|334		 |234		 |
       |255	       | 55		|335		 |235		 |
       |256	       | 250		|336		 |236		 |
       |257	       | 272		|337		 |237		 |
       |355	       | 316		|		 |		 |
       +---------------+----------------+----------------+---------------+

FILES

       /usr/lib/iconv/*.so	       conversion modules

       /usr/lib/iconv/*.t	       conversion tables

       /usr/lib/iconv/iconv_data       list of conversions supported by conversion tables

SEE ALSO

       iconv(1), iconv(3C), iconv(5)

SunOS 5.10							    18 Apr 1997 						     iconv_1251(5)
All times are GMT -4. The time now is 11:18 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy