Transposing a huge space delimited file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Transposing a huge space delimited file
# 1  
Old 01-31-2013
Transposing a huge space delimited file

Hi,

How do I transpose a huge space delimited file with more than 2 million columns and about 100 rows? Thanks!
# 2  
Old 01-31-2013
Transpose into what? Vice versa?
This User Gave Thanks to Corona688 For This Post:
# 3  
Old 01-31-2013
Quote:
Originally Posted by evelibertine
How do I transpose a huge space delimited file with more than 2 million columns and about 100 rows?
The correct procedure involves candles, the sacrifice of rum, tobacco and a living chicken, then invoking the following ritual chant ....

Seriously: if we are supposed to help you with a problem you have to explain first which problem you have: what have you tried and in which way did it fail? Or are you just lonely and seeking conversation?

bakunin
This User Gave Thanks to bakunin For This Post:
# 4  
Old 01-31-2013
Some more information on the file would be nice, too. Do the columns have a maximum width? Or better yet, a fixed width?
This User Gave Thanks to Corona688 For This Post:
# 5  
Old 02-01-2013
I'm sorry the question was vague. By transpose I mean flipping the rows into columns and the columns into rows. The file basically has 2,000,000 columns and 100 rows that all have digits ranging from 0 to 9, except the first row which has strings corresponding to column names. I hope this makes sense. Thanks a lot! Smilie

---------- Post updated at 01:58 PM ---------- Previous update was at 01:57 PM ----------

Quote:
Originally Posted by bakunin
The correct procedure involves candles, the sacrifice of rum, tobacco and a living chicken, then invoking the following ritual chant ....

Seriously: if we are supposed to help you with a problem you have to explain first which problem you have: what have you tried and in which way did it fail? Or are you just lonely and seeking conversation?

bakunin
hahahaha Smilie. I have tried tranposing in RGui but it seemed to take forever!
# 6  
Old 02-01-2013
Does the first column have a fixed width?
This User Gave Thanks to Corona688 For This Post:
# 7  
Old 02-02-2013
I'm not sure any tool will handle lines at least 4 million chars long (one char cols assumed). Where do these loooong lines come from? A database? Can't they be created in a different way from the start?
This User Gave Thanks to RudiC For This Post:
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help/Advise please for converting space delimited string variable to comma delimited with quote

Hi, I am wanting to create a script that will construct a SQL statement based on a a space delimited string that it read from a config file. Example of the SQL will be For example, it will read a string like "AAA BBB CCC" and assign to a variable named IN_STRING. I then concatenate... (2 Replies)
Discussion started by: newbie_01
2 Replies

2. Shell Programming and Scripting

Output file with <Tab> or <Space> Delimited

Input file: xyz,pqrs.lmno,NA,NA,NA,NA,NA,NA,NA abcd,pqrs.xyz,NA,NA,NA,NA,NA,NA,NA Expected Output: xyz pqrs.lmno NA NA NA NA NA NA NA abcd pqrs.xyz NA NA NA NA NA NA NA Command Tried so far: awk -F"," 'BEGIN{OFS=" ";} {print}' $File_Path/File_Name.csv Issue:... (5 Replies)
Discussion started by: TechGyaann
5 Replies

3. Shell Programming and Scripting

Remove space before numbers in delimited file

Hi, I have a file which looks like this FORD|1333-1| 10000100010203| 100040507697|0002|356.45|5555| SSSSY|KKKKM|1000005|10| N096|10043| C987 I need the output to look like this FORD|1333-1|10000100010203|100040507697|0002|356.45|5555| SSSSY|KKKKM|1000005|10| N096|10043| C987 The leading... (8 Replies)
Discussion started by: wahi80
8 Replies

4. Shell Programming and Scripting

Converting varied space delimited file to Pipedemilited

Hi all, I have source file, data looks like 12345 abc def 01 / 001200 C 2000 12345 abc def 01 / 001200 C 2500 12345 abcd def 01 / 001200 C 3500 18945 xyz pqr 01 / 009900 D 4000 5000 2800 9900 Expected ouput... (3 Replies)
Discussion started by: srk409
3 Replies

5. Shell Programming and Scripting

How to make tab delimited file to space delimited?

Hi How to make tab delimited file to space delimited? in put file: ABC kgy jkh ghj ash kjl o/p file: ABC kgy jkh ghj ash kjl Use code tags, thanks. (1 Reply)
Discussion started by: jagdishrout
1 Replies

6. UNIX for Dummies Questions & Answers

Changing only the first space to a tab in a space delimited text file

Hi, I have a space delimited text file but I only want to change the first space to a tab and keep the rest of the spaces intact. How do I go about doing that? Thanks! (3 Replies)
Discussion started by: evelibertine
3 Replies

7. Shell Programming and Scripting

How to convert a space delimited file into a pipe delimited file using shellscript?

Hi All, I have space delimited file similar to the one as shown below.. I need to convert it as a pipe delimited, the values inside the pipe delimited file should be as highlighted... AA ATIU2345098809 009697 005374 BB ATIU2345097809 005445 006518 CC ATIU9685098809 003215 003571 DD... (7 Replies)
Discussion started by: nithins007
7 Replies

8. UNIX for Dummies Questions & Answers

Deleting columns from a space delimited text file

I have a space delimited text file with 1,000,000+ columns and 100 rows. I want to delete columns 2 through 5 (2 and 5) included from the text file. How do I do that? Thanks. (3 Replies)
Discussion started by: evelibertine
3 Replies

9. UNIX for Dummies Questions & Answers

Converting Space delimited file to Tab delimited file

Hi all, I have a file with single white space delimited values, I want to convert them to a tab delimited file. I tried sed, tr ... but nothing is working. Thanks, Rajeevan D (16 Replies)
Discussion started by: jeevs81
16 Replies

10. UNIX for Dummies Questions & Answers

Searching for text in a Space delimited File

Hi I am trying to search a firewall syslog space delimeted file for all of the different tcp and udp destination ports. I know that grep will find lines that contain specific text. And I have tried using the the the cut command to cut out of the file certain colums. However the test I am... (6 Replies)
Discussion started by: andyblaylock
6 Replies
Login or Register to Ask a Question