Independent column sorting


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Independent column sorting
# 8  
Old 04-07-2014
Hi.

I like the solution of radoulov. I also like to break tasks down into manageable steps. One way to do that is to use code that packages up common tasks. A source for that is the missing routines.

One of those perl codes is colwise. It extracts a field (column) from the data on STDIN, operates on it, and pastes it back into STDOUT. Here's how it would work:
Code:
#!/usr/bin/env bash

# @(#) s2	Demonstrate colwise, extract, operate, paste.
# See: http://www.cuni.cz/~obo/textutils

# Utility functions: print-as-echo, print-line-with-visual-space, debug.
# export PATH="/usr/local/bin:/usr/bin:/bin"
LC_ALL=C ; LANG=C ; export LC_ALL LANG
pe() { for _i;do printf "%s" "$_i";done; printf "\n"; }
pl() { pe;pe "-----" ;pe "$*"; }
db() { ( printf " db, ";for _i;do printf "%s" "$_i";done;printf "\n" ) >&2 ; }
db() { : ; }
pe 
what $(which colwise)
C=$HOME/bin/context && [ -f $C ] && $C colwise perl sort

FILE=${1-data1}
cp original $FILE

pl " Input data file $FILE:"
cat $FILE

pl " Expected output:"
cat expected-output.txt

# Function to obtain number of fields.
fields() {
  awk -F"," '{print NF;exit}' $1
}

n=$( fields $FILE )
pl " Results for $n fields in $FILE:"
for c in $( seq 1 $n )
do
  colwise --delim="," $c sort < $FILE > scratch
  cp scratch $FILE
done
cat $FILE
rm -f scratch

exit 0

producing:
Code:
$ ./s2

colwise	Cut a column, run command, paste results.

Environment: LC_ALL = C, LANG = C
(Versions displayed with local utility "version")
OS, ker|rel, machine: Linux, 2.6.26-2-amd64, x86_64
Distribution        : Debian 5.0.8 (lenny, workstation) 
bash GNU bash 3.2.39
colwise - ( local: RepRev 1.2, ~/bin/colwise, 2014-03-20 )
perl 5.10.0
sort (GNU coreutils) 6.10

-----
 Input data file data1:
1,5,7
3,4,9
2,6,8

-----
 Expected output:
1,4,7
2,5,8
3,6,9

-----
 Results for 3 fields in data1:
1,4,7
2,5,8
3,6,9

One could try optimizing this by keeping the data file in a shell variable. The shell overhead would probably swamp the saving for small files, but it might be useful for larger collections of data. In any event, left as an exercise.

Best wishes ... cheers, drl
These 2 Users Gave Thanks to drl For This Post:
# 9  
Old 04-09-2014
Thank you all very much for your helps..
all of them where very helpful and its great to have a way to deal with columns independently
cheers
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sorting a column according to the number of names

Hey, So I'm having issues sorting a data set. The data set contains entries as such; # key: sex, time, athlete, athlete's nationality, date, city, country M, 2:30:57.6, Harry Payne, GBR, 1929-07-05, Stamford Bridge, England M, 2:5:42, Khalid Khannouchi, MAR, 1999-10-24, Chicago, USA M,... (1 Reply)
Discussion started by: DNM_UKN
1 Replies

2. Shell Programming and Scripting

Sorting a specific column!

What im trying to do is sort the output by the number on the second column and than limit the result to only the first three lines. This is the code idlist="x23s52; f34233; 2343xs; 25x34; si342d" cntr=1 idcnt=$(print $nidlist |tr ';' '\n' |wc -l) numofgrps=0 while (($cntr <= $idcnt))... (3 Replies)
Discussion started by: ajetangay
3 Replies

3. Shell Programming and Scripting

Sorting unique by column

I am trying to sort, do uniq by 1st column and report this 4 columns tab delimiter table , eg chr10:112174128 rs2255141 2E-10 Cholesterol, total chr10:112174128 rs2255141 7E-16 LDL chr10:17218291 rs10904908 3E-11 HDL Cholesterol chr10:17218291 rs970548 8E-9 TG... (4 Replies)
Discussion started by: fat
4 Replies

4. UNIX for Dummies Questions & Answers

Sorting one column underneath another

I am trying to arrange these columns so that they look like this: Xray2_1255555 Number of Copies: 1 Boxcar_1387305895 Number of Copies: 2 Fox_1387305896 Number of Copies: 2 But I have one column after another like this: Xray2_1255555 Number of Copies: 1 Xray2_12444444 Number of... (5 Replies)
Discussion started by: newbie2010
5 Replies

5. Shell Programming and Scripting

[Solved] Sorting a column based on another column

hello, I have a file as follows: F0100010 A C F0100040 A G BTA-28763-no-rs 77.2692 F0100020 A G F0100030 A T BTA-29334-no-rs 11.4989 F0100030 A T F0100020 A G BTA-29515-no-rs 127.006 F0100040 A G F0100010 A C BTA-29644-no-rs 7.29827 F0100050 A... (9 Replies)
Discussion started by: Homa
9 Replies

6. Shell Programming and Scripting

[Solved] Sorting a column in a file based on a column in a second file

Hello, I have two files as the following: File1: F0100020 A G F0100030 A T F0100040 A G File2: F0100040 A G BTA-28763-no-rs 77.2692 F0100030 A T BTA-29334-no-rs 11.4989 F0100020 A G BTA-29515-no-rs 127.006 I want to sort the second file based on the... (6 Replies)
Discussion started by: Homa
6 Replies

7. Shell Programming and Scripting

sorting on one column

Hello all, Is there a way to sort only one column while keeping everything else intact. Take for example this situation: (all columns are space separated) 11 AA asdf 1 -0.5 xx 11 AA axdf 1 -0.6 xx 11 AA csls 1 -0.7 xx 11 AA hjkj 1 -0.4 xx 11 AA uius 1 -0.8 xx 22 AA asdf 1 -0.4 xx 22 AA... (7 Replies)
Discussion started by: jaysean
7 Replies

8. Shell Programming and Scripting

Sorting a particular column in PERL

I have a file abc.txt which contains data in th following format abc,23 hgfh,87 tweg,89 jdfjn,74 I want to sort on the basis of column (the second one). It should be numerical sort. output should be abc,23 jdfjn,74 hgfh,87 tweg,89 I know how to do it in unix. I need a PERL code (1 Reply)
Discussion started by: centurion_13
1 Replies

9. Shell Programming and Scripting

Sorting By Column

I have almost got my unix program working that im working on as a personal project, my file tvs.txt has around 500 records so this would make it alot easier for me to find specific information. I have a file called tvs.txt, I'm using pico to edit the files and i want to be able to sort on the a... (6 Replies)
Discussion started by: john123
6 Replies

10. Shell Programming and Scripting

Sorting a column in this scenario

Hi, I need to sort the 3rd column in ascending order , each and every column are seperated by ~. sample input file : 2~Lead Time Metrics~jennife1 2~Lead Time Metrics~mmullis 2~Lead Time Metrics~lisah 2~Lead Time Metrics~pros 2~Lead Time Metrics~kenward can any one help me out . i... (1 Reply)
Discussion started by: krishnan_6015@y
1 Replies
Login or Register to Ask a Question