File transpose problem


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting File transpose problem
# 1  
Old 11-05-2012
File transpose problem

Hi Friends,

I have a file with a structure like this:

<file1.csv>
field1,field2,field3,field4,field5,field6,field7,field8,field9,field10,field11,field12

Few Salient points on the file's structure
(1)The fields from field1 to field6 is fixed and they would always be present in the file
(2)The field7-field8 is a block and that block of two fields gets repeated variably from three as in the present example ([field7,field8],[field9,field10],[field11,field12]) to any number. There can 10 such instances of these blocks of two fields as well as 20 or even lower down to only 1(wherein you have only field7,field8)

My objective is to create two such files from this file
(1) file1 will have seven fields, the fixed six fields from field1 to field6 and a seventh field with values containing filename and a sequencenumber(unique for each record)
(2) file2 will have the three fields. the first field will contain the filename and the sequencenumber. This is such to tie the records of file2 to file1.
And the other two fields will be for the block of two fields.
So if in the original file we have 3 instances of these blocks, we would have three records in the file for them.

Please help me in this.

regards
# 2  
Old 11-06-2012
Hi,

it would be nice if you could show the sample data for input and output files.
# 3  
Old 11-06-2012
Here is some sample data of the files:

The source file is having data like:
<file1.csv>
field1,field2,field3,field4,field5,field6,field7,field8,field9,field10,field11,field12

sample data:
1,ABC001,Tropical Rainforest,Americas,Sacramento,Mr David Cemes,123,Subway,456,McDonalds,977,KFC

Depending on my requirement,

New file1 should have:
field1,field2,field3,field4,field5,field6,field7,field8

sample data being:
1,ABC001,Tropical Rainforest,Americas,Sacramento,Mr David Cemes,file1_0001

and file2 should have:
field1,field2,field3

sample data being:
file1_0001,123,Subway
file1_0002,456,McDonalds
file1_003,977,KFC
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Transpose a file

Hello, I have a file which looks like this Input: Sample Genotype Assay Well plate Sample1 T xx A01 1 Sample2 T xx A01 2 Sample3 T xx A01 3 Sample4 T xx A02 4 Sample5 T xx A02 5 Sample6 T xx A02 ... (4 Replies)
Discussion started by: nans
4 Replies

2. Shell Programming and Scripting

Transpose a txt file

Hello, I have a text file with 148 rows and 2532691 columns. I need to transpose the data. The command that I am using is awk ' { for (i=1; i<=NF; i++) { a = $i } } NF>p { p = NF } END { for(j=1; j<=p; j++) { str=a for(i=2; i<=NR; i++){ ... (6 Replies)
Discussion started by: nans
6 Replies

3. UNIX for Dummies Questions & Answers

Transpose File

Have various files like this: InSlot=0x00000001 InPort=0x00000000 Inref=0x0000002f InSID=0x00000001 OutSlot=0x00000001 OutPort=0x00000002 Outref=0x00000000 OutSID=0x0000000b OutUName_2=14 InSlot=0x00000001 InPort=0x00000000 Inref=0x000001a8 InSID=0x00000001 OutSlot=0x00000001... (5 Replies)
Discussion started by: K@rlos
5 Replies

4. Shell Programming and Scripting

Transpose whole file and specific columns

Hi, I have a file like this a b c d e f g h i j k l Case1: I want to transpose the whole file Output1 a d g j b e h k c f i l Case2 Transpose a specific column - Say 3rd (6 Replies)
Discussion started by: jacobs.smith
6 Replies

5. Shell Programming and Scripting

Transpose few columns alone in a Text file

Hi Friends, I am Stuck up with a problem on transposing Rows to Coloumns.. Though there are many threads on this my problem is little difficult.. I have a tab separated file like Below, computer selling_loc currency_type manufacturer_name salesweek-wk1 sales-wk2 ...wk-3 ..wk4 till... (7 Replies)
Discussion started by: heinz_holan
7 Replies

6. Shell Programming and Scripting

Transpose a text file.

Hello, I have a text file which is like a matrix m rows and n columns. Now I want to convert it into n rows and m columns. Thanks for hint. (1 Reply)
Discussion started by: zhshqzyc
1 Replies

7. Shell Programming and Scripting

Transpose a file

input IndID ID1 ID2 ID3 a1 a/a b/b c/c a2 a/a b/b c/c a3 a/b b/b c/d a6 a/b b/b c/e a8 a/a b/c c/e a9 b/b b/d c/e output IDName IndID IDtype C_No ID1 a1 a/a 1 ID1 a2 a/a 1 ID1 a8 ... (1 Reply)
Discussion started by: stateperl
1 Replies

8. Shell Programming and Scripting

Rows to Columns - File Transpose

Hi I have an input file and I want to transpose it but I need to take care that if any field is missing for a record it should be popoulated with space for that field - using a shell script INFILE ---------- emp=1 sal=2 loc=abc emp=2 sal=21 sal=22 loc=xyz emp=5 loc=abc OUTFILE... (10 Replies)
Discussion started by: 46019
10 Replies

9. Shell Programming and Scripting

File Transpose

Hi ALL I have one input file say FILE1 which looks as below. a=1 b=2 c=3 a=4 b=5 c=6 . . . Here a,b,c...etc are variable names. The output file(FILE2) should look like 1,2,3 4,5,6 ..... ..... (5 Replies)
Discussion started by: 46019
5 Replies

10. Shell Programming and Scripting

transpose file

Hi all, I have a file in the below format.... <A> B C <A> E F <A> G H I need the result file to be: <A>BC <A>EF <A>GH (3 Replies)
Discussion started by: new_ds_man
3 Replies
Login or Register to Ask a Question