calculating unique strings values


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting calculating unique strings values
# 1  
Old 02-14-2012
calculating unique strings values

Hi,

Im looking for a script which will calculate the unique strings column 2 & 3 values in a log as mentioned in example

eg:-
Code:
bag  12   12 
bag  18   15 
bags  15   13 
bags  15   14 
blazer  24   24 
blazer  33   32 
boots  19   15

Result should be:-
Code:
bag 30 27
bags 30 27
blazer 57 56
boots 19 15

Please help on this

Regards
wintech

Last edited by Franklin52; 02-16-2012 at 03:36 AM.. Reason: Please use code tags for code and data samples, thank you
# 2  
Old 02-14-2012
Try:
Code:
awk '{a[$1]+=$2;b[$1]+=$3}END{for (i in a) print i,a[i],b[i]}' file

This User Gave Thanks to bartus11 For This Post:
# 3  
Old 02-14-2012
Code:
$
$ cat f60
bag 12 12
bag 18 15
bags 15 13
bags 15 14
blazer 24 24
blazer 33 32
boots 19 15
$
$ perl -lane '$i=0; map{$x{$F[0]}->[$i++]+=$_} @F[1,2]}{for (sort keys %x){print "$_ @{$x{$_}}"}' f60
bag 30 27
bags 30 27
blazer 57 56
boots 19 15
$
$

tyler_durden
This User Gave Thanks to durden_tyler For This Post:
# 4  
Old 02-14-2012
If infile is sorted:
Code:
awk 'p!=$1{if(p)print p,s,t;s=t=x;p=$1}{s+=$2;t+=$3}END{print p,s,t}' infile

otherwise:
Code:
sort infile | awk 'p!=$1{if(p)print p,s,t;s=t=x;p=$1}{s+=$2;t+=$3}END{print p,s,t}'

This User Gave Thanks to Scrutinizer For This Post:
# 5  
Old 02-15-2012
Thank You!!! Hurray it works perfect..... Thank you so much

---------- Post updated at 11:47 PM ---------- Previous update was at 11:34 PM ----------

Hi,

i have another small request, need to remove double/triple space in between a content to single space in a file as below example.

File
bags 15 13
bags 15 14
blazer 24 24
blazer 33 32
boots 19 15

Result should be single space between the content
bags 15 13
bags 15 14
blazer 24 24
blazer 33 32
boots 19 15

Thanks
wintech

Last edited by Paulwintech; 02-15-2012 at 02:40 PM..
# 6  
Old 02-15-2012
Code:
sed 's/  */ /g' file_many_spaced >file_single_spaced

Code:
tr -s ' ' <file_many_spaced >file_single_spaced

# 7  
Old 02-15-2012
Hi,

Sorry!! double space is not removed to single space.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Code to get unique values

Hello All, I am trying to write a script which returns me clientID,programId,userID indicated in bold from the below log files.Log file is having many such data , iam just presenting sample . Sample Log file. hostname 1525867288264 UA:MP:EP491418 http-nio-8080-exec-11 ERROR Get Price... (13 Replies)
Discussion started by: nextStep
13 Replies

2. Shell Programming and Scripting

Command to show unique strings in two files

how to display the unique strings in two files using shell script or commands. I tried diff and cmp but it shows the entire line, i need only the mismatched strings. File1: sat,sun,mon,tue rose,lilly,lotus white,red,blue,green,pink File2: sat,sun,mon,tue rose,sunflower,lotus... (4 Replies)
Discussion started by: Arun_Linux
4 Replies

3. Shell Programming and Scripting

Finding a text in files & replacing it with unique strings

Hallo Everyone. I have to admit I'm shell scripting illiterate . I need to find certain strings in several text files and replace each of the string by unique & corresponding text. I prepared a csv file with 3 columns: <filename>;<old_pattern>;<new_pattern> ... (5 Replies)
Discussion started by: gordom
5 Replies

4. Shell Programming and Scripting

AWK, Perl or Shell? Unique strings and their maximum values from 3 column data file

I have a file containing data like so: 2012-01-02 GREEN 4 2012-01-02 GREEN 6 2012-01-02 GREEN 7 2012-01-02 BLUE 4 2012-01-02 BLUE 3 2012-01-02 GREEN 4 2012-01-02 RED 4 2012-01-02 RED 8 2012-01-02 GREEN 4 2012-01-02 YELLOW 5 2012-01-02 YELLOW 2 I can't always predict what the... (4 Replies)
Discussion started by: rich@ardz
4 Replies

5. Shell Programming and Scripting

Calculating frequency of values within bins

Hi, I am working with files containing 2 columns in which i need to come up with the frequency/count of values in col. 2 falling within specifics binned values of col. 1. the contents of a sample file is shown below: 15 12.5 15 11.2 16 0.2 16 1.4 17 1.6 18 4.5 17 5.6 12 8.6 11 7.2 9 ... (13 Replies)
Discussion started by: ida1215
13 Replies

6. UNIX for Dummies Questions & Answers

Calculating the Hours between two time values

Dear Folks, I want to calculate the elapsed hours between two time columns. I am using timestampdiff method for the same. I am able to get the value. But facing an issue of decimal values. For example the elapsed hours between 09:00:00 and 20:30:00 is coming as 11 instead of 11.5. I am using below... (1 Reply)
Discussion started by: dinesh1985
1 Replies

7. Shell Programming and Scripting

How to count unique strings

How do I count the total number of unique strings from a file using Perl? Any help is appreciated.. (6 Replies)
Discussion started by: my_Perl
6 Replies

8. UNIX for Dummies Questions & Answers

Finding Unique strings which match pattern

I need to grep for a pattern in a file. Files are huge and have several repeated occurances of the strings which match pattern. I just need the strings which contain the pattern in the output. For eg. The contents of my file are as follows. The pattern I want to match by is ABCD ... (5 Replies)
Discussion started by: tektips
5 Replies

9. Shell Programming and Scripting

Getting Unique values in a file

Hi, I have a file like this: Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321 I would like to find only the unique values in the files and get the following output: Some_String_Here 123 321 3432 3221 557 886 I am trying to get this done using awk. Can someone please... (5 Replies)
Discussion started by: Legend986
5 Replies

10. Shell Programming and Scripting

to retrieve unique values

Hi all, I have a 10.txt file. In this file 2 words are present by name Active and Inactive and these words are repeated 7000 times. I want to take the unique 2 words from this 7000 lines. Thanks Mahalakshmi.A (3 Replies)
Discussion started by: mahalakshmi
3 Replies
Login or Register to Ask a Question