Independent column sorting Post: 302896483

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Independent column sorting Post 302896483 by drl on Monday 7th of April 2014 05:21:45 PM

04-07-2014

Registered User

Hi.

I like the solution of radoulov. I also like to break tasks down into manageable steps. One way to do that is to use code that packages up common tasks. A source for that is the missing routines.

One of those perl codes is colwise. It extracts a field (column) from the data on STDIN, operates on it, and pastes it back into STDOUT. Here's how it would work:

Code:

#!/usr/bin/env bash

# @(#) s2	Demonstrate colwise, extract, operate, paste.
# See: http://www.cuni.cz/~obo/textutils

# Utility functions: print-as-echo, print-line-with-visual-space, debug.
# export PATH="/usr/local/bin:/usr/bin:/bin"
LC_ALL=C ; LANG=C ; export LC_ALL LANG
pe() { for _i;do printf "%s" "$_i";done; printf "\n"; }
pl() { pe;pe "-----" ;pe "$*"; }
db() { ( printf " db, ";for _i;do printf "%s" "$_i";done;printf "\n" ) >&2 ; }
db() { : ; }
pe 
what $(which colwise)
C=$HOME/bin/context && [ -f $C ] && $C colwise perl sort

FILE=${1-data1}
cp original $FILE

pl " Input data file $FILE:"
cat $FILE

pl " Expected output:"
cat expected-output.txt

# Function to obtain number of fields.
fields() {
  awk -F"," '{print NF;exit}' $1
}

n=$( fields $FILE )
pl " Results for $n fields in $FILE:"
for c in $( seq 1 $n )
do
  colwise --delim="," $c sort < $FILE > scratch
  cp scratch $FILE
done
cat $FILE
rm -f scratch

exit 0

producing:

Code:

$ ./s2

colwise	Cut a column, run command, paste results.

Environment: LC_ALL = C, LANG = C
(Versions displayed with local utility "version")
OS, ker|rel, machine: Linux, 2.6.26-2-amd64, x86_64
Distribution        : Debian 5.0.8 (lenny, workstation) 
bash GNU bash 3.2.39
colwise - ( local: RepRev 1.2, ~/bin/colwise, 2014-03-20 )
perl 5.10.0
sort (GNU coreutils) 6.10

-----
 Input data file data1:
1,5,7
3,4,9
2,6,8

-----
 Expected output:
1,4,7
2,5,8
3,6,9

-----
 Results for 3 fields in data1:
1,4,7
2,5,8
3,6,9

One could try optimizing this by keeping the data file in a shell variable. The shell overhead would probably swamp the saving for small files, but it might be useful for larger collections of data. In any event, left as an exercise.

Best wishes ... cheers, drl

These 2 Users Gave Thanks to drl For This Post:

drl

View Public Profile for drl

Find all posts by drl

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sorting a column in this scenario

Hi, I need to sort the 3rd column in ascending order , each and every column are seperated by ~. sample input file : 2~Lead Time Metrics~jennife1 2~Lead Time Metrics~mmullis 2~Lead Time Metrics~lisah 2~Lead Time Metrics~pros 2~Lead Time Metrics~kenward can any one help me out . i...

2. Shell Programming and Scripting

Sorting By Column

I have almost got my unix program working that im working on as a personal project, my file tvs.txt has around 500 records so this would make it alot easier for me to find specific information. I have a file called tvs.txt, I'm using pico to edit the files and i want to be able to sort on the a...

3. Shell Programming and Scripting

Sorting a particular column in PERL

I have a file abc.txt which contains data in th following format abc,23 hgfh,87 tweg,89 jdfjn,74 I want to sort on the basis of column (the second one). It should be numerical sort. output should be abc,23 jdfjn,74 hgfh,87 tweg,89 I know how to do it in unix. I need a PERL code

4. Shell Programming and Scripting

sorting on one column

Hello all, Is there a way to sort only one column while keeping everything else intact. Take for example this situation: (all columns are space separated) 11 AA asdf 1 -0.5 xx 11 AA axdf 1 -0.6 xx 11 AA csls 1 -0.7 xx 11 AA hjkj 1 -0.4 xx 11 AA uius 1 -0.8 xx 22 AA asdf 1 -0.4 xx 22 AA...

5. Shell Programming and Scripting

[Solved] Sorting a column in a file based on a column in a second file

Hello, I have two files as the following: File1: F0100020 A G F0100030 A T F0100040 A G File2: F0100040 A G BTA-28763-no-rs 77.2692 F0100030 A T BTA-29334-no-rs 11.4989 F0100020 A G BTA-29515-no-rs 127.006 I want to sort the second file based on the...

6. Shell Programming and Scripting

[Solved] Sorting a column based on another column

hello, I have a file as follows: F0100010 A C F0100040 A G BTA-28763-no-rs 77.2692 F0100020 A G F0100030 A T BTA-29334-no-rs 11.4989 F0100030 A T F0100020 A G BTA-29515-no-rs 127.006 F0100040 A G F0100010 A C BTA-29644-no-rs 7.29827 F0100050 A...

7. UNIX for Dummies Questions & Answers

Sorting one column underneath another

I am trying to arrange these columns so that they look like this: Xray2_1255555 Number of Copies: 1 Boxcar_1387305895 Number of Copies: 2 Fox_1387305896 Number of Copies: 2 But I have one column after another like this: Xray2_1255555 Number of Copies: 1 Xray2_12444444 Number of...

8. Shell Programming and Scripting

Sorting unique by column

I am trying to sort, do uniq by 1st column and report this 4 columns tab delimiter table , eg chr10:112174128 rs2255141 2E-10 Cholesterol, total chr10:112174128 rs2255141 7E-16 LDL chr10:17218291 rs10904908 3E-11 HDL Cholesterol chr10:17218291 rs970548 8E-9 TG...

9. Shell Programming and Scripting

Sorting a specific column!

What im trying to do is sort the output by the number on the second column and than limit the result to only the first three lines. This is the code idlist="x23s52; f34233; 2343xs; 25x34; si342d" cntr=1 idcnt=$(print $nidlist |tr ';' '\n' |wc -l) numofgrps=0 while (($cntr <= $idcnt))...

10. Shell Programming and Scripting

Sorting a column according to the number of names

Hey, So I'm having issues sorting a data set. The data set contains entries as such; # key: sex, time, athlete, athlete's nationality, date, city, country M, 2:30:57.6, Harry Payne, GBR, 1929-07-05, Stamford Bridge, England M, 2:5:42, Khalid Khannouchi, MAR, 1999-10-24, Chicago, USA M,...

LEARN ABOUT DEBIAN

column

COLUMN(1)						    BSD General Commands Manual 						 COLUMN(1)

NAME

     column -- columnate lists

SYNOPSIS

     column [-entx] [-c columns] [-s sep] [file ...]

DESCRIPTION

     The column utility formats its input into multiple columns.  Rows are filled before columns.  Input is taken from file operands, or, by
     default, from the standard input.	Empty lines are ignored unless the -e option is used.

     The options are as follows:

     -c      Output is formatted for a display columns wide.

     -s      Specify a set of characters to be used to delimit columns for the -t option.

     -t      Determine the number of columns the input contains and create a table.  Columns are delimited with whitespace, by default, or with
	     the characters supplied using the -s option.  Useful for pretty-printing displays.

     -x      Fill columns before filling rows.

     -n      By default, the column command will merge multiple adjacent delimiters into a single delimiter when using the -t option; this option
	     disables that behavior. This option is a Debian GNU/Linux extension.

     -e      Do not ignore empty lines.

ENVIRONMENT

     The COLUMNS, LANG, LC_ALL and LC_CTYPE environment variables affect the execution of column as described in environ(7).

EXIT STATUS

     The column utility exits 0 on success, and >0 if an error occurs.

EXAMPLES

	   (printf "PERM LINKS OWNER GROUP SIZE MONTH DAY " ; 
	   printf "HH:MM/YEAR NAME
" ; 
	   ls -l | sed 1d) | column -t

SEE ALSO

     colrm(1), ls(1), paste(1), sort(1)

HISTORY

     The column command appeared in 4.3BSD-Reno.

BUGS

     Input lines are limited to LINE_MAX (2048) bytes in length.

BSD
								   July 29, 2004							       BSD