Extract Unique Values from file Post: 302349713

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Getting Unique values in a file

Hi, I have a file like this: Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321 I would like to find only the unique values in the files and get the following output: Some_String_Here 123 321 3432 3221 557 886 I am trying to get this done using awk. Can someone please...

2. Shell Programming and Scripting

Unique values from a Terabyte File

Hi, I have been dealing with a files only a few gigs until now and was able to get out by using the sort utility. But now, I have a terabyte file which I want to filter out unique values from. I have a server having 8 processor and 16GB RAM with a 5 TB hdd. Is it worthwhile trying to use...

3. UNIX Desktop Questions & Answers

Fetching unique values from file

After giving grep -A4 "feature 1," <file name> I have extracted the following text feature 1, subfeat 2, type 1, subtype 5, dump '30352f30312f323030392031313a33303a3337'H -- "05/01/2009 11:30:37" -- -- ...

4. Shell Programming and Scripting

extract unique pattern from large text file

Hi All, I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like 12345- , i tried with egrep ,eg : egrep "+" text.txt but which returns all the lines which contains any number of digits followed by hyhen ,...

5. Shell Programming and Scripting

How to count Unique Values from a file.

Hi I have the following info in a file - <Cell id="25D"/> <Cell id="26A"/> <Cell id="26B"/> <Cell id="26C"/> <Cell id="27A"/> <Cell id="27B"/> <Cell id="27C"/> <Cell id="28A"/> I would like to know how would you go about counting all...

6. Shell Programming and Scripting

Create shell script to extract unique information from one file to a new file.

Hi to all, I got this content/pattern from file http.log.20110808.gz mail1 httpd: Account Notice: close igchung@abc.com 2011/8/7 7:37:36 0:00:03 0 0 1 mail1 httpd: Account Information: login sastria9@abc.com proxy sid=gFp4DLm5HnU mail1 httpd: Account Notice: close sastria9@abc.com...

7. Shell Programming and Scripting

List unique values and count instances in .csv file

I need to take the second column of a .csv file and count the number of instances of each unique value in that same second column. I'd like the output to be value,count sorted by most instances. Thanks for any guidance! Data example: 317476,317756,0 816063,318861,0 313123,319091,0...

8. Shell Programming and Scripting

Extract UNIque records from File

Hi, I have a file with 20GB Pipe Delimited file where i have too many duplicate records. I need an awk script to extract the unique records from the file and put it into another file. Kindly help. Thanks, Arun

9. Shell Programming and Scripting

Extracting unique values of a column from a feed file

Hi Folks, I have the below feed file named abc1.txt in which you can see there is a title and below is the respective values in the rows and it is completely pipe delimited file ,. ...

10. Shell Programming and Scripting

Using grep and a parameter file to return unique values

Hello Everyone! I have updated the first post so that my intentions are easier to understand, and also attached sample files (post #18). I have over 500 text files in a directory. Over 1 GB of data. The data in those files is organised in lines: My intention is to return one line per...

LEARN ABOUT LINUX

extractor

EXTRACTOR(1)						  The Canonical Csound Reference					      EXTRACTOR(1)

NAME

       extractor - Extract a section of audio from an audio file. .

DESCRIPTION

       Extract a section of audio, by time or sample, from an existing sound file.

SYNTAX

	   extractor [OPTIONS ... ] infile

INITIALIZATION

       Flags:

       o   -S integer = Start the extract at the given sample number.

       o   -Z integer = End the extract at the given sample number.

       o   - Q integer = Extract given number of samples.

       o   -T fpnum = Start the extract at the given time in seconds.

       o   -E fpnum = End the extract at the given time in seconds.

       o   -D fpnum = Extract given time in seconds.

       o   -v = Verbose mode.

       o   -R = Continually rewrite the header while writing soundfile (WAV/AIFF).

       o   -H integer = Show a "heart-beat" to indicate progress, in style 1, 2 or 3.

       o   -N = Alert call (usually ringing the bell) when finished.

       o   -v = Verbose mode.

       o   -o fname = output file name (default: test.wav)

EXAMPLES

       The default values are

	       extractor -S 0 -Z end-of-file -otest

       For example

	       extractor -S 10234 -D 2.13 in.aiff -o out.wav

       This creates a new sound file taken from sample 10234 and lasting 2.13 seconds.

CREDITS

       Author: John ffitch

       1994

AUTHORS

       Barry Vercoe
       MIT Media Lab

	   Author.

       Dan Ellis
       MIT Media Lab,
		 Cambridge
		 Massachussetts

	   Author.

COPYRIGHT

5.07								    06/23/2009							      EXTRACTOR(1)