Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Counting non-specific occurrences within a file.

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Counting non-specific occurrences within a file.
Prev   Next
# 1  
Old 11-19-2012
Counting non-specific occurrences within a file.
I'm pretty new to scripting and didn't see an example of this issue yet. I am trying to count and print the total number of times each value is found within a file. Here is a short example of my starting file.

Code:
value	3
value	3
value	3
value	3
value	4
value	6
value	6
value	6
value	6
value	8
value	8
value	8

The entire file I am working with is very large and I will not be able to know each value in advance. I'm trying to get to a file that looks like this

Code:
value	3	4
value	4	1
value	6	4
value	8	3
...	....	...

with column 3 being the total number of times a specific value (i.e value 3) is found within the file.

I've tried a couple different grep and wc commands but these seem to be fore specific searches. Any help would be appreciated.

Thanks
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Counting specific column and add result in output

Hi all, I have a quick question: I have a 4 column tab-separated file. I want to count the number of times each unique value in column 2 appears and add that number in a 5th column. I have the following input file: waterline-n below-sheath-v 14.8097 A dock-n below-sheath-v ... (4 Replies)
Discussion started by: owwow14
4 Replies

2. UNIX for Dummies Questions & Answers

Awk: Counting occurrences between two files

Hi, I have two text files (1.txt and 2.txt). 2.txt contains two columns which are extracted from 1.txt using a simple if(condition) print. I want to: - count how many times the values contained in 2.txt appear in 1.txt -if they appear just one time, I have to delete the entire row in... (5 Replies)
Discussion started by: Pintug
5 Replies

3. UNIX for Dummies Questions & Answers

BASH - Counting word occurrences in a Web Page

Hi all, I have to do a script bash (for university) that counts all word occurrences in a specific web page. anyone can help me?. Thanks :) (1 Reply)
Discussion started by: piacentero
1 Replies

4. Shell Programming and Scripting

[Solved] Counting specific characters within each field

Hello, I have a file like following: ALB_13554 1 1 1 ALB_13554 1 2 1 ALB_18544 2 0 2 ALB_18544 1 0 1 This is a sample of my file, my real file has 441845 number of fields. What I want to do is to calculate the number of 1 and 2 in each column using AWK, so, the output file looks like... (5 Replies)
Discussion started by: Homa
5 Replies

5. Shell Programming and Scripting

How to count occurrences in a specific column

Hi, I need help to count the number of occurrences in $3 of file1.txt. I only know how to count by checking one by one and the code is like this: awk '$3 ~ /aku hanya poyo/ {++c} END {print c}' FS="\t" file1.txt But this is not wise to do as i have hundreds of different occurrences in that... (10 Replies)
Discussion started by: redse171
10 Replies

6. Shell Programming and Scripting

Counting occurrences of all words in multiple files

Hey Unix gurus, I would like to count the number occurrences of all the words (regardless of case) across multiple files, preferably outputting them in descending order of occurrence. This is well beyond my paltry shell scripting ability. Researching, I can find many scripts/commands that... (4 Replies)
Discussion started by: twjolson
4 Replies

7. Shell Programming and Scripting

Counting specific words from the log

Hi, I need a shell script which can provide details from error logs like this Aug 23 21:19:41 red mountd: authenticated mount request from bl0110.bang.m pc.local:651 for /disk1/jobs (/disk1) Aug 23 08:49:52 red dhcpd: DHCPDISCOVER from 00:25:90:2b:cd:7c via eth0: unknown client Aug 24... (2 Replies)
Discussion started by: ratheeshp
2 Replies

8. Shell Programming and Scripting

counting number of pattern occurrences

Hi All, Is it possible to count number of occurrences of a pattern in a single record using awk?? for example: a line like this: abrsjdfhafa I want to count the number of a character occurrences. but still use the default RS, I don't want to set RS to single character. (1 Reply)
Discussion started by: ghoda2_10
1 Replies

9. Shell Programming and Scripting

Counting the differences based on a specific rule

Hi, I've been trying to create a perl file to run something very specific. But I'm not getting any success. I'm not very good with hashing. I have a file with two columns (tab separated) (already sorted) 99890 + 100281 + 104919 - 109672 + 113428 - 114501 + 115357 + 115598 ... (7 Replies)
Discussion started by: labrazil
7 Replies

10. UNIX for Dummies Questions & Answers

Counting occurences of specific charachter in a file

Hi, I need to count the number of occurences of the character " in a file that contains huge number of records. What command could I use? Please specify in detail since I am new :| Thanks much. (3 Replies)
Discussion started by: GMMike
3 Replies
Login or Register to Ask a Question

LEARN ABOUT MOJAVE

iotop

iotop(1m)							   USER COMMANDS							 iotop(1m)

NAME

       iotop - display top disk I/O events by process. Uses DTrace.

SYNOPSIS

       iotop [-C] [-D|-o|-P] [-j|-Z] [-d device] [-f filename] [-m mount_point] [-t top] [interval [count]]

DESCRIPTION

       iotop tracks disk I/O by process, and prints a summary report that is refreshed every interval.

       This is measuring disk events that have made it past system caches.

       Since this uses DTrace, only users with root privileges can run this command.

OPTIONS

       -C     don't clear the screen

       -D     print delta times - elapsed, us

       -j     print project ID

       -o     print disk delta times, us

       -P     print %I/O (disk delta times)

       -Z     print zone ID

       -d device
	      instance name to snoop (eg, dad0)

       -f filename
	      full pathname of file to snoop

       -m mount_point
	      mountpoint for filesystem to snoop

       -t top print top number only

EXAMPLES

       Default output, print summary every 5 seconds
	      # iotop

       One second samples,
	      # iotop 1

       print %I/O (time based),
	      # iotop -P

       Snoop events on the root filesystem only,
	      # iotop -m /

       Print top 20 lines only,
	      # iotop -t 20

       Print 12 x 5 second samples, scrolling,
	      # iotop -C 5 12

FIELDS

       UID    user ID

       PID    process ID

       PPID   parent process ID

       PROJ   project ID

       ZONE   zone ID

       CMD    command name for the process

       DEVICE device name

       MAJ    device major number

       MIN    device minor number

       D      direction, Read or Write

       BYTES  total size of operations, bytes

       ELAPSED
	      total elapsed times from request to completion, us (this is the elapsed time from the disk request (strategy) to the disk completion
	      (iodone))

       DISKTIME
	      total times for disk to complete request, us (this is the time for the disk to complete that  event  since  it's	last  event  (time
	      between iodones), or, the time to the strategy if the disk had been idle)

       %I/O   percent disk I/O, based on time (DISKTIME)

       load   1 minute load average

       disk_r total disk read Kb for sample

       disk_w total disk write Kb for sample

DOCUMENTATION

       See the DTraceToolkit for further documentation under the Docs directory. The DTraceToolkit docs may include full worked examples with ver-
       bose descriptions explaining the output.

EXIT

       iotop will run forever until Ctrl-C is hit, or the specified interval is reached.

AUTHOR

       Brendan Gregg [Sydney, Australia]

SEE ALSO

       iosnoop(1M), dtrace(1M)

version 0.75							   Oct 25, 2005 							 iotop(1m)