Convert rows to columns


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Convert rows to columns
# 1  
Old 11-24-2014
Convert rows to columns

hi folks,

I have a sample data like what is shown below:

Code:
1,ID=1000
1,Org=CedarparkHospital
1,cn=john
1,sn=doe
1,uid=User001
2,uid=User002
2,ID=2000
2,cn=steve
2,sn=jobs
2,Org=Providence

I would like to convert it into the below format:

Code:
1,1000,CedarparkHospital,john,doe,User001
2,2000,Providence,steve,jobs,User002

Thanks for your help.

Kumar
# 2  
Old 11-24-2014
Kumar,

Is the data ordered? That is, all the information for record 1 is followed by all the information for record 2, record 3, etc. Are the key=value pairs in column order? Or is there a preferred column for each key?

(From your small example, each record is ordered, but the key=value pairs are not)
# 3  
Old 11-24-2014
Can you post what you have tried to solve this on your own...
# 4  
Old 11-24-2014
First attempt in perl - assumes records and keys are unordered, as of yet untested:
Code:
use strict;
use warnings;

my @KEYS = qw{ recid };
my %KEYS = ( recid => 1 );
my @DATA = ();

$\ = "\n";

while (<>) {
  chomp;
  my ($recid, $key, $value) = m{^(\d+),([^=]+)=(.*)$};

  unless (defined $value) {
    print STDERR $ARGV, ': invalid record - ', $_;
    next;
  }

  # keys are ordered by occurrence

  unless (defined $KEYS{$key}) {
    push @KEYS, $key;
    $KEYS{$key}++;
  }

  # initial each data-record with the record-id

  unless (defined $DATA[$recid]) {
    $DATA[$recid]->{recid} = $recid;
  }

  $DATA[$recid]->{$key} = $value;
}

$, = ',';

print 0, @KEYS;

foreach my $D (@DATA) {
  next unless defined $D;
  print map { defined $D->{$_} ? $D->{$_} : '' } @KEYS;
}

which generates
Code:
0,recid,ID,Org,cn,sn,uid
1,1000,CedarparkHospital,john,doe,User001
2,2000,Providence,steve,jobs,User002


Last edited by derekludwig; 11-24-2014 at 08:13 PM.. Reason: added results
# 5  
Old 11-24-2014
Yes, I can ensure that the dataand keys are ordered. That should not be an issue.

Kumar
# 6  
Old 11-24-2014
The keys are not ordered: "ID" is the first key of record 1 and the second of record 2; "uid" is the fifth key of record 1 and the first of record 2.
# 7  
Old 11-24-2014
A possible solution for scrambled data

Code:
#!/bin/bash

sort -k 1 col2rodata -o /dev/null
ro=1
lines=
while read line
do
    lines=$(( lines + 1 ))

    case ${line:2:2} in
        ID) ID=${line##*=} ;;
        Or) Org=${line##*=} ;;
        cn) cn=${line##*=} ;;
        sn) sn=${line##*=} ;;
        ui) uid=${line##*=} ;;
    esac

    if [ $(( lines % 5 )) = 0 ]; then
        echo "$ro,$ID,$Org,$cn,$sn,$uid"
        ro=$(( $ro + 1 ))
    fi
done < col2rodata

# output
# ------
# 1,1000,CedarparkHospital,john,doe,User001
# 2,2000,Providence,steve,jobs,User002

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Convert rows to columns

I am looking to print the data in columns and after every 3 words it should be a new row. cat example.out | awk 'END { for (i = 0; ++i < m;) print _;print _ }{ _ = _ x ? _ OFS $1 : $1}' m=1| grep -i INNER I am looking to print in a new line after every 3 words. ... (2 Replies)
Discussion started by: lazydev
2 Replies

2. Shell Programming and Scripting

Convert Rows to Columns

Hi Everyone, Could someone shed some lights on how to convert the records in rows form into column basis. 172.29.59.12 IBM,8255-E8B 102691P 8 65536 MB 6100-04-11-1140 172.29.59.15 IBM,8255-E8B 102698P 4 45056 MB 6100-04-11-1140 IP SYS MODEL ... (6 Replies)
Discussion started by: ckwan
6 Replies

3. Shell Programming and Scripting

How to Convert rows in to columns?

Hi Gurus, How to convert rows in to columns using linux shell scripting Input is like (sample.txt) ABC DEF GHI JKL MNO PQR STU VWX YZA BCD output should be (sampleoutput.csv) ABC,DEF,GHI,JKL,MNO PQR,STU,VWX,YZA,BCD (2 Replies)
Discussion started by: infasriniit
2 Replies

4. Shell Programming and Scripting

Convert few columns to rows

Hi! Does anybody help me in converting following data: INPUT looks like this: 20. 100. 30 200. 40. 400. 50. 100. 60. 200. 70. 400. 80. 200. 150. 210. 30. 100. OUTPUT should look like this: 20. 100. 30 200. 40. 400. 50. 100. 60. 200. 70.... (5 Replies)
Discussion started by: lovelinux
5 Replies

5. Shell Programming and Scripting

Convert columns to rows in a file

Hello, I have a huge tab delimited file with around 40,000 columns and 900 rows I want to convert columns to a row. INPUT file look like this. the first line is a headed of a file. ID marker1 marker2 marker3 marker4 b1 A G A C ... (5 Replies)
Discussion started by: ryan9011
5 Replies

6. Shell Programming and Scripting

convert rows to columns

hi, i have the file as below: abc def ghi jkl i want the output as abc,def,ghi,jki please reply, Thanks (4 Replies)
Discussion started by: namitai
4 Replies

7. Shell Programming and Scripting

convert rows (with spaces) to columns

Hey all, I have a list in the format ; variable length with spaces more variable information some more variable information and I would like to transform that 'column' into rows ; variable length with spaces more variable information some more variable information Any... (8 Replies)
Discussion started by: TAPE
8 Replies

8. Shell Programming and Scripting

convert columns into rows

hi, Apologies if this has been covered. I have requirement where i have to convert a single column into multiple column. My data will be like this - 2 3 4 5 6 Output required - 2 3 4 5 6 (1 Reply)
Discussion started by: Nishithinfy
1 Replies

9. Shell Programming and Scripting

convert rows into columns

Hi guys Could anyone advise me how to convert my rows into columns from a file My file would be similar to this: A11 A12 A13 A14 A15 ... A1n A21 A22 A23 A31 A41 A51 ... Am1 Am2 Am3 Am4 Am5 ... Amn The number of rows is not the same to the number of columns Thanks in advance (2 Replies)
Discussion started by: loperam
2 Replies

10. Shell Programming and Scripting

how to convert columns to rows

Hi, I need a shell script for below requirement Input file P1 - 173310 P2 - 173476 P3 - 173230 P4 - 172737 P1 - 173546 P2 - 173765 P3 - 173876 P4 - 172989 Out put file P1 173310 173546 P2 173476 173765 P3 173230 173876 P4 172737 172989 Suresh (6 Replies)
Discussion started by: suresh3566
6 Replies
Login or Register to Ask a Question