|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Need help with finding unique string in log file
Post 302318496 by gubbu on Thursday 21st of May 2009 04:58:18 PM
05-21-2009
Need help with finding unique string in log file
Shell script help
Here is 3 sample lines from a log file
<date> INFO <java.com.blah> abcd:ID= user login
<date> DEBUG <java.com.blah> <nlah bla> abcd:ID=123 user login
<date> INFO <java.com.blah> abcd:ID=3243 user login
I want to find unique "ID" from this log file which has thousands of rows. Problem is that "ID" is not in the same delimiter field and also as null sometimes "ID=" without any value which I like to ignore .
Any pointers or even possible with simple grep/awk command if not script?
Here is 3 sample lines from a log file
<date> INFO <java.com.blah> abcd:ID= user login
<date> DEBUG <java.com.blah> <nlah bla> abcd:ID=123 user login
<date> INFO <java.com.blah> abcd:ID=3243 user login
I want to find unique "ID" from this log file which has thousands of rows. Problem is that "ID" is not in the same delimiter field and also as null sometimes "ID=" without any value which I like to ignore .
Any pointers or even possible with simple grep/awk command if not script?
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a pipe delimited flat file. I want to grep the records that are unique in the 4th field and repeat only once in the file
for e.g.. if the file contains this 3 records
i want to get the o/p as:
I just gave a sample here and the file is huge one and i cant just grep from the... (7 Replies)
Discussion started by: dsravan
7 Replies
2. UNIX for Advanced & Expert Users
hi all..
I dont know how to search for a string in a file.. I have tried doing.. I did google but didnt get effective answers..my code is as follows:
int search(char* filename,const char*
username,const char* passwd)
{
int flag=0;
unsigned long fsize=0;
unsigned long current=0;... (2 Replies)
Discussion started by: Ume1986
2 Replies
3. UNIX for Dummies Questions & Answers
I need to grep for a pattern in a file. Files are huge and have several repeated occurances of the strings which match pattern. I just need the strings which contain the pattern in the output.
For eg.
The contents of my file are as follows. The pattern I want to match by is ABCD
... (5 Replies)
Discussion started by: tektips
5 Replies
4. Shell Programming and Scripting
I have an archive file that holds a batch of statements. I would like to be able to extract a certain statement based on the unique customer # (ie. 123456). The end for each statement is noted by "ENDSTM".
I can find the line number for the beginning of the statement section with sed.
... (5 Replies)
Discussion started by: andrewsc
5 Replies
5. Shell Programming and Scripting
Hi Guys,
I have two files that I am using:
File1 is as follows:
wwe
khfgv
jfo
jhgfd
hoaha
hao
lkahe
This is like a master file which has entries in the order which I want. (4 Replies)
Discussion started by: npatwardhan
4 Replies
6. Shell Programming and Scripting
find the number of unique words in a file using sort com-
mand. (7 Replies)
Discussion started by: abhikamune
7 Replies
7. Shell Programming and Scripting
Hello All,
I have a text file, i want to search for a string in it and the string is repeated multiple times in a file i want to get the first occurence of the string in a variable.
the content of file is like:
I want to grepthe first occurance of "Configuration flow done" and store the... (7 Replies)
Discussion started by: anand2308
7 Replies
8. Shell Programming and Scripting
Hi,
I have a hash with unique keys associated with some data.
my %FINALcontigs = (
'mira_rep_c765:119reads**', 'ctctactggaagactgac',
'mira_rep_c7454:54reads**', 'atggatactgcgctgttgctaactactgga',
'mira_rep_c6803:12reads**', 'atcgactggatgcagggttgtggtttcta',
... (2 Replies)
Discussion started by: jdilts
2 Replies
9. Shell Programming and Scripting
Hi,
I have multiple files that each contain one column of strings:
File1:
123abc
456def
789ghi
File2:
123abc
456def
891jkl
File3:
234mno
123abc
456def
In total I have 25 of these type of file. (5 Replies)
Discussion started by: owwow14
5 Replies
10. Shell Programming and Scripting
Hello
Take this file...
Test01
Ref test
Version 01
Test02
Ref test
Version 02
Test66
Ref test
Version 66
Test99
Ref test
Version 99
I want to substitute every occurrence of Test{2} with a unique random number, so for example, if I was using sed, substitution would be something... (1 Reply)
Discussion started by: funkman
1 Replies
LEARN ABOUT HPUX
chsh
chsh(1) General Commands Manual chsh(1) NAME
chsh - change default login shell SYNOPSIS
login-name [shell] login-name [shell] login-name [shell] login-name [shell] DESCRIPTION
The command changes the login-shell for a user's login name in the repository (see passwd(1)). The DCE repository is only available if Integrated Login has been configured; see auth.adm(1M). If Integrated Login has been configured, other considerations apply. A user with appropriate DCE privileges is capable of modifying a user's shell; this is not dependent upon superuser privileges. If the repository is not specified (as in [login-name]), the login shell is changed in the file only. Run after running to make sure the information was processed correctly. Notes The command is a hard link to the command. When is executed, actually the command gets executed with appropriate arguments to change the user login shell in the repository specified in command line. If no repository is specified, the login shell is changed in the file. Arguments login-name A login name of a user. shell The absolute path name of a shell. If the file exists, the new login shell must be listed in that file. Otherwise, you can specify one of the standard shells listed in the getusershell(3C) manual entry. If shell is omitted, it defaults to the POSIX shell, Options The following option is recognized: Specify the repository to which the operation is to be applied. Supported repositories include and Security Restrictions You must have appropriate privileges to use the optional login-name argument to change another user's login shell. NETWORKING FEATURES
NFS File can be implemented as a Network Information Service (NIS) database. EXAMPLES
To change the login shell for user to the default: To change the login shell for user to the C shell: To change the login shell for user to the Korn shell in the DCE registry: WARNINGS
If two or more users try to write the file at the same time, a passwd locking mechanism was devised. If this locking fails after subse- quent retrying, terminates. AUTHOR
was developed by HP and the University of California, Berkeley. FILES
SEE ALSO
chfn(1), csh(1), ksh(1), passwd(1), sh(1), sh-posix(1), getusershell(3C), pam(3), passwd(4), shells(4). chsh(1)