Sponsored Content
Top Forums Shell Programming and Scripting Transpose columns to Rows : Big data Post 302443667 by cjcox on Monday 9th of August 2010 08:11:49 PM
Old 08-09-2010
A bit ole school... but here's a possible shell solution:

Code:
#!/bin/sh

filein="$1"
fileout="$2"
cols=`head -1 <"$filein" | wc -w`
count=1
while [ $count -le $cols ]; do
        if [ $count = 1 ]; then
                tr -s ' ' ' ' <"$filein" | cut -f$count -d' ' | tr '\012' ' ' >"$fileout"
        else
                tr -s ' ' ' ' <"$filein" | cut -f$count -d' ' | tr '\012' ' ' >>"$fileout"
        fi
        echo "" >>"$fileout"
        count=`expr $count + 1`
done

In some cases, this may actually work better than reading everything into memory and processing... Anyhow... something to consider...
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Rows to Columns - File Transpose

Hi I have an input file and I want to transpose it but I need to take care that if any field is missing for a record it should be popoulated with space for that field - using a shell script INFILE ---------- emp=1 sal=2 loc=abc emp=2 sal=21 sal=22 loc=xyz emp=5 loc=abc OUTFILE... (10 Replies)
Discussion started by: 46019
10 Replies

2. Shell Programming and Scripting

Transpose Rows Into Columns

I'm aware there are a lot of resources dedicated to the question of transposing rows and columns, but I'm a total newbie at this and the task appears to be beyond me. I have 40 text files with content that looks like this: Dokument 1 von 146 Orange County Register (California) June 26, 2010... (2 Replies)
Discussion started by: spindoctor
2 Replies

3. Shell Programming and Scripting

Transpose columns to Rows

I have a data A 1 B 2 C 3 D 4 E 5 i would like to change the data A B C D E 1 2 3 4 5 Pls suggest how we can do it in UNIX. Start using code tags, thanks. Also start reading your PM's you get from Mods as well read the Forum Rules. That might not do any harm. (24 Replies)
Discussion started by: aravindj80
24 Replies

4. Shell Programming and Scripting

transpose rows to columns

Any tips on how I can awk the input data to display the desired output per below? Thanking you in advance. input test data: 2 2010-02-16 10:00:00 111111111111 bytes 99999999999 bytes 90% 4 2010-02-16 12:00:00 333333333333 bytes 77777777777 bytes 88% 5 2010-02-16 11:00:00... (4 Replies)
Discussion started by: ux4me
4 Replies

5. Shell Programming and Scripting

Transpose Data from Columns to rows

Hello. very new to shell scripting and would like to know if anyone could help me. I have data thats being pulled into a txt file and currently have to manually transpose the data which is taking a long time to do. here is what the data looks like. Server1 -- Date -- Other -- value... (7 Replies)
Discussion started by: Mikes88
7 Replies

6. Shell Programming and Scripting

Columns to Rows - Transpose - Special Condition

Hi Friends, Hope all is well. I have an input file like this a gene1 10 b gene1 2 c gene2 20 c gene3 10 d gene4 5 e gene5 6 Steps to reach output. 1. Print unique values of column1 as column of the matrix, which will be a b c (5 Replies)
Discussion started by: jacobs.smith
5 Replies

7. Shell Programming and Scripting

awk to transpose every 7 rows into columns

input: a1 a2 a3 a4 a5 a6 a7 b1 b2 b3 .. b7 .. z1 .. z7 (12 Replies)
Discussion started by: ux4me
12 Replies

8. Shell Programming and Scripting

Transpose rows to columns complex

Input: IN,A,1 IN,B,3 IN,B,2 IN,C,7 BR,A,1 BR,A,5 BR,C,9 AR,C,9 Output: CNTRY,A,B,C IN,1,5,7 BR,6,0,9 AR,0,0,9 (7 Replies)
Discussion started by: unme
7 Replies

9. Shell Programming and Scripting

Transpose comma delimited data in rows to columns

Hello, I have a bilingual database with the following structure a,b,c=d,e,f The right half is in a Left to right script and the second is in a Right to left script as the examples below show What I need is to separate out the database such that the first word on the left hand matches the first... (4 Replies)
Discussion started by: gimley
4 Replies

10. UNIX for Beginners Questions & Answers

Transpose rows to certain columns

Hello, I have the following data and I want to use awk to transpose each value to a certain column , so in case the value is not available the column should be empty. Example: Box Name: BoxA Weight: 1 Length :2 Depth :3 Color: red Box Name: BoxB Weight: 3 Length :4 Color: Yellow... (5 Replies)
Discussion started by: rahman.ahmed
5 Replies
RECOVERDM(1)						      General Commands Manual						      RECOVERDM(1)

NAME
recoverdm - recover filesdisks with damaged sectors SYNOPSIS
recoverdm -t type -i filedevicein -o fileout [-l list] [-n retries] [-s speed] DESCRIPTION
recoverdm This program will help you recover disks with bad sectors. You can recover files as well complete devices. In case if finds sec- tors which simply cannot be recoverd, it writes an empty sector to the output file and continues. If you're recovering a CD or a DVD and the program cannot read the sector in "normal mode", then the program will try to read the sector in "RAW mode" (without error-checking etc.). This toolkit also has a utility called 'mergebad': mergebad merges multiple images into one. This can be useful when you have, for example, multiple CD's with the same data which are all damaged. In such case, you can then first use recoverdm to retrieve the data from the damaged CD's into image-files and then combine them into one image with mergebad. OPTIONS
-t type is 1 for files, 10 for floppy disks and 40 for IDE disks (try -h for a complete list) -i filedevicein is the device or file you want to recover. -o fileout is the file where to write to. This file should not already exists. -l list This file will contain the offsets of the bad blocks as well as the size of the bad blocks. This file can be used together with the image with the mergebad utility. -n retries Number of retries before going on with next sector, defaults to 6. -r RAW read Number of retries while reading in RAW mode before going on with next sector, default to 6. -s rotation speed Speed of the CD-ROMDVD, defaults to 1. -h Gives the help message. SEE ALSO
gddrescue(1), dd_rescue(1), testdisk(1), gpart(1) AUTHOR
Folkert van Heusden <flok@xs4all.nl>, Home page is <http://www.vanheusden.com/recoverdm/> recoverdm Version 0.19 RECOVERDM(1)
All times are GMT -4. The time now is 12:51 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy