Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Reformat a file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Reformat a file
# 1  
Old 08-30-2011
Reformat a file
I have a csv file with 11 columns. The first columns contains the User Id. One User id can have multiple sub Id.
The value of Sub Id is in column 10.
Code:
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969, ,US, ,96761 ,15 ,seg_id
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969, ,n/a, ,96761 ,15 ,seg_id
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969, ,US, ,96761 ,10 ,seg_id
1000153,jshytleer@fuse.net ,Jason ,Shytle ,8/16/1976, ,US, ,45245 ,12 ,seg_id
1000153,jshytleer@fuse.net ,Jason ,Shytle ,8/16/1976, ,n/a, ,45245 ,12 ,seg_id
1000153,jshytleer@fuse.net ,Jason ,Shytle ,8/16/1976, ,US, ,45245 ,15 ,seg_id

the requirement is to publish one line per USER_ID group with 11th field having all the sub id in that group
Code:
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969 ,US ,96761 ,15|10 ,seg_id
1000153,jshytleer@fuse.net ,Jason ,Shytle ,8/16/1976 ,US ,45245 ,12|15 ,seg_id

Last edited by pludi; 08-30-2011 at 07:52 AM..
# 2  
Old 08-30-2011
Code:
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969, ,US, ,96761 ,15 ,seg_id 
100026,captjason@hawaii.rr.com ,jason ,wolford ,1/16/1969, ,n/a, ,96761 ,15 ,seg_id

how to handle the red part if two lines with same userId and subId?
# 3  
Old 08-30-2011
For rows having same userid and subuserid , discard the rows which have the country specified as 'n/a'
# 4  
Old 08-30-2011
Code:
awk -F',' 'BEGIN{OFS=","}NR==FNR{ if($1 in s && !match(s[$1],$10)) s[$1]=s[$1]"|"$10; else s[$1]=$10; } NR>FNR{ if(!($1 in a)){ a[$1]=1; $10=s[$1]; gsub(/ /,"",$10); print $0 } }' yourFile yourFile

'n/a' handling is not considered.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to reformat output if input file is empty, but not if file has data in it

The below awk improved bu @MadeInGermany, works great as long as the input file has data in it in the below format: input chrX 25031028 25031925 chrX:25031028-25031925 ARX 631 18 chrX 25031028 25031925 chrX:25031028-25031925 ARX 632 14... (3 Replies)
Discussion started by: cmccabe
3 Replies

2. Shell Programming and Scripting

Reformat csv file

Hi, I have a csv file with content like: 1,0,100 1,1,150 2,0,200 2,1,250 3,0,300 3,1,350 I want an output such that all numbers in 3rd col where 2nd col is "0" come in the same col in the output. The same goes for numbers where 2nd col is "1". 1 100 150 2 200 250 3 300 350 Tnx... (2 Replies)
Discussion started by: jamaje
2 Replies

3. Shell Programming and Scripting

[Solved] File reformat

I am using the code below to reformat the input (hp.txt). The output (newhp.txt) is not in the desired format and I can not seem to figure it out. I have attached both. Thank you. perl -aF/\\t/ -lne 'print join(" ",@F) for ("0 A","0 G","0 C","0 T","A 0","G 0","C 0","T 0")' hp.txt > newhp.txt ... (4 Replies)
Discussion started by: cmccabe
4 Replies

4. Shell Programming and Scripting

awk reformat file

Hello: When I tried a perl-oneliner to re-format fasta file. infile.fasta >YAL069W-1.334 Putative promoter CCACACCACACCCACACACC ACACCACACCCACACACACA ACAGCCCTAATCTAACCC >YAL068C-7235.2170 Putative ABC sequence TACGAGAATAATTT ACGTAAATGAAGTT TATATATAAA >gi|31044174|gb|AY143560.1|... (15 Replies)
Discussion started by: yifangt
15 Replies

5. Shell Programming and Scripting

Major File Reformat

Hello, I have many lengthy files that need to be reformatted. I was hoping a sed or awk script could fix this. Here is an example of the original format: P0037 # Degree: 32.999981 # COMMAND: 03 (#01A) Scale 1.296875, 52 (Wooden Crate w/ #2 Label, Bahko) v -3328.000000 12.101541 437.000000... (2 Replies)
Discussion started by: Blue Solo
2 Replies

6. Shell Programming and Scripting

Reformat file using nawk

Hi all, I have a file with records that look something like this, "Transaction ID",Date,Email,"Card Type",Amount,"NETBANX Ref","Root Ref","Transaction Type","Merchant Ref",Status,"Interface ID","Interface Name","User ID" nnnnnnnnn,"21 Nov 2011 00:10:47",someone@hotmail.co.uk,"Visa... (2 Replies)
Discussion started by: dazedandconfuse
2 Replies

7. Shell Programming and Scripting

Reformat the data of a file.

I have a file which have data like A.txt a 1Jan I am in a1. 1Jan I was born. 2Jan I am here. 3Jan I am in a3. b 1Jan I am in b1. c 2Jan I am in c2. d 2Jan I am in d2. 5jan I am in d5. date in the file might be vary evertime. (9 Replies)
Discussion started by: samkhu
9 Replies

8. Shell Programming and Scripting

Please help me reformat this file

I am working with a file of the form; 4256 7726 1 6525 716 1 7626 0838 1 8726 7623 2 8625 1563 2 1662 2628 3 1551 3552 3 1542 7984 ... (3 Replies)
Discussion started by: digipak
3 Replies

9. Shell Programming and Scripting

Reformat Crontab file

I need help writing a script that will reformat a crontab file. The first thing the script is doing is a crontab -l > crontab.txt. I need the crontab.txt file to read "8.00 PM every weekday (Mon-Fri) only in Oct." instead of the orig format "0 20 * 10 1-5" (1 Reply)
Discussion started by: alnita
1 Replies

10. Shell Programming and Scripting

reformat the file

Hi all, I ran into this problem, hope you can help I have a text file like this: Spriden ID First Name Last Name Term Code Detail Code Amount Trans Date Description ... (3 Replies)
Discussion started by: CamTu
3 Replies
Login or Register to Ask a Question