08-31-2009
Extract Unique Values from file
Hello all,
I have a file with following sample data
2009-08-26 05:32:01.65 spid5 Process ID 86:214 owns resources that are blocking processes on Scheduler 0.
2009-08-26 05:32:01.65 spid5 Process ID 86:214 owns resources that are blocking processes on Scheduler 0.
2009-08-26 05:32:01.65 spid5 Process ID 84:127 owns resources that are blocking processes on Scheduler 2.
2009-08-26 09:49:53.46 spid5 Process ID 86:214 owns resources that are blocking processes on Scheduler 0.
2009-08-26 15:51:28.51 spid5 Process ID 102:17 owns resources that are blocking processes on Scheduler 12.
2009-08-26 15:51:28.51 spid5 Process ID 102:17 owns resources that are blocking processes on Scheduler 12.
2009-08-26 15:51:28.51 spid5 Process ID 102:17 owns resources that are blocking processes on Scheduler 12.
I need to extract the unique Process IDs
So the output should be { though the order does not matter }
86
84
102
Its the unique values occuring between "Process ID" and the ":" on each line excluding the blank white space after ID . Process ID 102:
Any suggestions ?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I have a file like this:
Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321
I would like to find only the unique values in the files and get the following output:
Some_String_Here 123 321 3432 3221 557 886
I am trying to get this done using awk. Can someone please... (5 Replies)
Discussion started by: Legend986
5 Replies
2. Shell Programming and Scripting
Hi,
I have been dealing with a files only a few gigs until now and was able to get out by using the sort utility. But now, I have a terabyte file which I want to filter out unique values from.
I have a server having 8 processor and 16GB RAM with a 5 TB hdd. Is it worthwhile trying to use... (6 Replies)
Discussion started by: Legend986
6 Replies
3. UNIX Desktop Questions & Answers
After giving
grep -A4 "feature 1," <file name>
I have extracted the following text
feature 1,
subfeat 2,
type 1,
subtype 5,
dump '30352f30312f323030392031313a33303a3337'H -- "05/01/2009 11:30:37" --
--
... (1 Reply)
Discussion started by: shivi707
1 Replies
4. Shell Programming and Scripting
Hi All,
I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like
12345- , i tried with egrep ,eg : egrep "+" text.txt
but which returns all the lines which contains any number of digits followed by hyhen ,... (19 Replies)
Discussion started by: shijujoe
19 Replies
5. Shell Programming and Scripting
Hi
I have the following info in a file -
<Cell id="25D"/>
<Cell id="26A"/>
<Cell id="26B"/>
<Cell id="26C"/>
<Cell id="27A"/>
<Cell id="27B"/>
<Cell id="27C"/>
<Cell id="28A"/>
I would like to know how would you go about counting all... (4 Replies)
Discussion started by: Prega
4 Replies
6. Shell Programming and Scripting
Hi to all,
I got this content/pattern from file http.log.20110808.gz
mail1 httpd: Account Notice: close igchung@abc.com 2011/8/7 7:37:36 0:00:03 0 0 1
mail1 httpd: Account Information: login sastria9@abc.com proxy sid=gFp4DLm5HnU
mail1 httpd: Account Notice: close sastria9@abc.com... (16 Replies)
Discussion started by: Mr_47
16 Replies
7. Shell Programming and Scripting
I need to take the second column of a .csv file and count the number of instances of each unique value in that same second column. I'd like the output to be value,count sorted by most instances. Thanks for any guidance!
Data example:
317476,317756,0
816063,318861,0
313123,319091,0... (4 Replies)
Discussion started by: batcho
4 Replies
8. Shell Programming and Scripting
Hi,
I have a file with 20GB Pipe Delimited file where i have too many duplicate records.
I need an awk script to extract the unique records from the file and put it into another file.
Kindly help.
Thanks,
Arun (1 Reply)
Discussion started by: Arun Mishra
1 Replies
9. Shell Programming and Scripting
Hi Folks,
I have the below feed file named abc1.txt in which you can see there is a title and below is the respective values in the rows and it is completely pipe delimited file ,.
... (4 Replies)
Discussion started by: punpun66
4 Replies
10. Shell Programming and Scripting
Hello Everyone!
I have updated the first post so that my intentions are easier to understand, and also attached sample files (post #18).
I have over 500 text files in a directory. Over 1 GB of data. The data in those files is organised in lines:
My intention is to return one line per... (23 Replies)
Discussion started by: clippertm
23 Replies
LEARN ABOUT MOJAVE
tap::parser::iterator::process5.18
TAP::Parser::Iterator::Process(3pm) Perl Programmers Reference Guide TAP::Parser::Iterator::Process(3pm)
NAME
TAP::Parser::Iterator::Process - Iterator for process-based TAP sources
VERSION
Version 3.26
SYNOPSIS
use TAP::Parser::Iterator::Process;
my %args = (
command => ['python', 'setup.py', 'test'],
merge => 1,
setup => sub { ... },
teardown => sub { ... },
);
my $it = TAP::Parser::Iterator::Process->new(\%args);
my $line = $it->next;
DESCRIPTION
This is a simple iterator wrapper for executing external processes, used by TAP::Parser. Unless you're writing a plugin or subclassing,
you probably won't need to use this module directly.
METHODS
Class Methods
"new"
Create an iterator. Expects one argument containing a hashref of the form:
command => @command_to_execute
merge => $attempt_merge_stderr_and_stdout?
setup => $callback_to_setup_command
teardown => $callback_to_teardown_command
Tries to uses IPC::Open3 & IO::Select to communicate with the spawned process if they are available. Falls back onto "open()".
Instance Methods
"next"
Iterate through the process output, of course.
"next_raw"
Iterate raw input without applying any fixes for quirky input syntax.
"wait"
Get the wait status for this iterator's process.
"exit"
Get the exit status for this iterator's process.
"handle_unicode"
Upgrade the input stream to handle UTF8.
"get_select_handles"
Return a list of filehandles that may be used upstream in a select() call to signal that this Iterator is ready. Iterators that are not
handle based should return an empty list.
ATTRIBUTION
Originally ripped off from Test::Harness.
SEE ALSO
TAP::Object, TAP::Parser, TAP::Parser::Iterator,
perl v5.18.2 2014-01-06 TAP::Parser::Iterator::Process(3pm)