awk to reformat a text file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk to reformat a text file
# 1  
Old 02-25-2011
awk to reformat a text file

I am definitely not an expert with awk, and I want to reformat a text file like the following. This is probably a very easy one for an expert out there. I would like to keep the lines in the same order, but move the heading to only be listed once above the lines.

This is what the text file looks like....

APPLE: This line should be first
APPLE: this line could, but should be second
APPLE: this should be last
BANANA: First
BANANA: Second
BANANA: third
BANANA: fourth
BANANA: fifth
COOKIE: 1
COOKIE: 2
COOKIE: 3
DOG: 1
DOG: 2
DOG: 3
DOG: 4

I would like to reformat this to say:

APPLE:
This line should be first
this line could, but should be second
this should be last

BANANA:
First
Second
third
fourth
fifth

COOKIE:
1
2
3

DOG:
1
2
3
4


Thanks in advance! Smilie
# 2  
Old 02-25-2011
Code:
awk '{if(++a[$1]==1){sub(" ","\n");print "\n"$0}else{sub($1" ","");print}}' file

This User Gave Thanks to yinyuemi For This Post:
# 3  
Old 02-25-2011
Thanks!! You're the man/woman!
# 4  
Old 02-25-2011
Here is another way of doing it:
Code:
#!/bin/ksh
IFS=':'
mPrev=""
while read mTitle mDesc
do
  if [[ "${mTitle}" != "${mPrev}" ]]; then
    echo ${mTitle}':'
    mPrev=${mTitle}
  fi
  echo ${mDesc}
done < inp_file

# 5  
Old 02-25-2011
@yinyuemi
can you please explain me the code in detail plzz....
# 6  
Old 02-25-2011
awk '{
if(++a[$1]==1) ## ++a[$1] is the count of $1, if ++a[$1]==1,means the first count, then we keep it,
{sub(" ","\n");print "\n"$0} ## using sub function to modify the format of whole line to fit the requirement, and print it.
else
{sub($1" ","");print} ## if ++a[$1]!=1, means the second, or thrid .., we don't print $1, so still using sub function to delete $1" " from the whole line.
}'
# 7  
Old 02-26-2011
Code:
$ ruby -e 'BEGIN{h={}};File.open("file").each{|x|a,b=x.split(/\s+/,2);(h[a]||= [])<<b};END{h.each{|k,v| puts k;v.each{|y|puts y }}}'
APPLE:
This line should be first
this line could, but should be second
this should be last
BANANA:
First
Second
third
fourth
fifth
COOKIE:
1
2
3
DOG:
1
2
3
4


Last edited by kurumi; 02-26-2011 at 03:14 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk to reformat output if input file is empty, but not if file has data in it

The below awk improved bu @MadeInGermany, works great as long as the input file has data in it in the below format: input chrX 25031028 25031925 chrX:25031028-25031925 ARX 631 18 chrX 25031028 25031925 chrX:25031028-25031925 ARX 632 14... (3 Replies)
Discussion started by: cmccabe
3 Replies

2. Shell Programming and Scripting

awk to reformat text file

Howdy. AWK beginner here. I need to reformat a text file in the following format: TTGS08-2014001 6018.00 143563.00 ... (2 Replies)
Discussion started by: c47v3770
2 Replies

3. Shell Programming and Scripting

Reformat awk output

I need to rearrange the output but i am unable to arrange it to match the format. In the output i need NAME=\"To in the column . Bash: #!/bin/bash cd /cygdrive/c/output/a cat *.txt > output.txt i=/cygdrive/c/output/a/output.csv #echo "NE_Name, Source, Destination, OSPF_AREA_ID"... (4 Replies)
Discussion started by: adgjmpt
4 Replies

4. Shell Programming and Scripting

Using awk to reformat file output

Hi there. I need to reformat a large file. Here is a sample of the file. NETIK0102_UCS_Boot_a,NETIK0102_UCS_Boot_b 5200 2438 70G 5200 2439 70G NETIK0102_UCS_HBA0_a,NETIK0102_UCS_HBA1_b,NETIK0102_UCS_HBA2_a,NETIK0102_UCS_HBA3_b 2673 19D7 55G 2673 19C0 30G 2673 19F5 120G... (5 Replies)
Discussion started by: kieranfoley
5 Replies

5. Shell Programming and Scripting

awk reformat file

Hello: When I tried a perl-oneliner to re-format fasta file. infile.fasta >YAL069W-1.334 Putative promoter CCACACCACACCCACACACC ACACCACACCCACACACACA ACAGCCCTAATCTAACCC >YAL068C-7235.2170 Putative ABC sequence TACGAGAATAATTT ACGTAAATGAAGTT TATATATAAA >gi|31044174|gb|AY143560.1|... (15 Replies)
Discussion started by: yifangt
15 Replies

6. Shell Programming and Scripting

awk to reformat text

I have this input and want output like below, how can I achieve that through awk: Input: CAT1 FRY-01 CAT1 FRY-04 CAT1 DRY-03 CAT1 FRY-02 CAT1 DRY-04 CAT2 FRY-03 CAT2 FRY-02 CAT2 DRY-01 FAT3 DRY-12 FAT3 FRY-06 Output: category CAT1 item FRY-01 (7 Replies)
Discussion started by: aydj
7 Replies

7. Shell Programming and Scripting

Reformat MLS Data - Use AWK?

I am helping my wife set up a real estate site and I am starting to integrate MLS listings. We are using a HostGator level 5 VPS running CentOS and have full root and SSH access to the VPS. Thus far I have automated the daily FTP download of listings from our MLS server using a little sh script.... (4 Replies)
Discussion started by: Chicago_Realtor
4 Replies

8. Shell Programming and Scripting

Reformat text table

Hello, I have a challenge here to reformat a text table. The original table follows: Item01: m1, m2, m3: A; m4, m5, m6: B; m7, m8: C; m9 m10: D Item02: m1, m9, m10: A; m7, m5, m6: C; m2, m3, m4, m8: D Item03: m1, m6, m7: A; m2: B; m3, m4: C; m5 m8 m9 m10: D . . . Please note: 1)... (7 Replies)
Discussion started by: yifangt
7 Replies

9. Shell Programming and Scripting

help reformat data with awk

I am trying to write an awk program to reformat a data table and convert the date to julian time. I have all the individual steps working, but I am having some issues joing them into one program. Can anyone help me out? Here is my code so far: # This is an awk program to convert the dates from... (4 Replies)
Discussion started by: climbak
4 Replies
Login or Register to Ask a Question