Data mining a text file. Post: 302205119

Sponsored Content

Top Forums Shell Programming and Scripting Data mining a text file. Post 302205119 by drl on Friday 13th of June 2008 02:03:43 PM

06-13-2008

Registered User

Hi.
If you want to enumerate all the like items:

Code:

#!/bin/bash -

# @(#) s1       Demonstrate counting occurrences.

echo
echo "(Versions displayed with local utility \"version\")"
version >/dev/null 2>&1 && version =o $(_eat $0 $1) cut sort uniq
echo

FILE=${1-data1}

cut -d" " -f3- $FILE |
sort |
uniq -c

exit 0

Producing:

Code:

$ ./s1

(Versions displayed with local utility "version")
SunOS 5.10
GNU bash 3.00.16
cut - no version provided for /usr/bin/cut.
sort - no version provided for /usr/xpg4/bin/sort.
uniq - no version provided for /usr/bin/uniq.

   2 adm 4
   2 bin 2
   2 daemon 1
   2 gdm 50
   2 listen 37
   2 lp 71
   1 noaccess 60002
   1 noaccess 60003
   2 nobody 60001
   2 nuucp 9
   2 root 0
   2 smmsp 25
   2 sys 3
   2 uucp 5
   2 webservd 80

See man pages for details ... cheers, drl

drl

View Public Profile for drl

Find all posts by drl

4 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extracting data from text file based on configuration set in config file

Hi , a:) i have configuration file with pattren <Range start no>,<Range end no>,<type of records to be extracted from the data file>,<name of the file to store output> eg: myfile.confg 9899000000,9899999999,DATA,b.dat 9899000000,9899999999,SMS,a.dat b:) Stucture of my data file is...

2. Shell Programming and Scripting

Find and replace data in text file with data in same file

OK I will do my best to explain what I need help with. I am trying to format an ldif file so I can import it into Oracle oid. I need the file to look like this example. Keep in mind there are 3000 of these in the file. changetype: modify replace: userpassword dn:...

3. Shell Programming and Scripting

Filter a .kml file (xml) with data set from text file

I have a .kml file. So I want filter the .kml to get only the tags that have this numeric codes that they are in a text file 11951 11952 74014 11964 11965 11969 11970 11971 11972 60149 74018 74023 86378 11976 11980 11983 11984 11987

4. Shell Programming and Scripting

Compare 2 text file with 1 column in each file and write mismatch data to 3rd file

Hi, I need to compare 2 text files with around 60000 rows and 1 column. I need to compare these and write the mismatch data to 3rd file. File1 - file2 = file3 wc -l file1.txt 58112 wc -l file2.txt 55260 head -5 file1.txt 101214200123 101214700300 101250030067 101214100500...

LEARN ABOUT XFREE86

xmark

Xmark(1)						      General Commands Manual							  Xmark(1)

NAME

       Xmark - summarize x11perf results

SYNTAX

       Xmark datafile

DESCRIPTION

       Xmark  is  a  shell  script that reads the indicated datafile and compiles a benchmark which it writes to standard output.  It writes three
       numbers:

	      A weighted performance number for the x11perf results.

	      A weighted performance number for a standard SparcStation 1, with SunOS 4.1.2, X11R5 Xsun, and a CG3 dumb Color Frame Buffer.

	      The Xmark, which is the ratio of the two numbers above.

       The datafile must be an ordinary file, produced by x11perf in the following way:

       x11perf -display display -v1.3 -rop GXcopy GXxor -all > datafile

       It is possible to run the GXcopy and GXxor tests separately, as long as they are concatenated to the same output file:

       x11perf -display display -v1.3 -rop GXcopy -all > datafile
       x11perf -display display -v1.3 -rop GXxor -all >> datafile

       or

       x11perf -display display -v1.3 -rop GXxor -all > datafile
       x11perf -display display -v1.3 -rop GXcopy -all >> datafile

FILES

       temp.$$
	      Temporary file created in the current directory, deleted after use.

DIAGNOSTICS

       Usage: Xmark datafile
	      Xmark was invoked without arguments or with more than one argument, or with options.  Xmark takes no options.

       Error: data file does not exist or is not ordinary.
	      Xmark cannot find the datafile named on its command line, or the datafile is a special file such as a directory.

       WARNING: datafile contains nnn, not 441 or 447 'trep' results;
	      The file named on the command line does not seem to be a file generated by x11perf in the expected way.

       Diagnostic: ERROR: sum of weights =nnn, not equal to 4566.0;
	      There is an internal error in Xmark.

SEE ALSO

       X(7), x11perf(1), x11perfcomp(1)

XFree86 							   Version 4.7.0							  Xmark(1)