Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

grep variable

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting grep variable
# 8  
Old 09-22-2012
Haha you are amazing that works like a charm.

The source file is about 30,000 lines and it churned through it in just a few seconds.

Kudos to you
tiberione
# 9  
Old 09-23-2012
Code:
sort file | awk -F "_" '{if($0 !~ a){print k;max=0};{s=$2;a=$1;if(s > max){max=s;k=$0}}}END{print k}'

This User Gave Thanks to pamu For This Post:
# 10  
Old 09-23-2012
Code:
sort -t_ -k1,1 -k2,2rn file | awk -F_ '!A[$1]++'

This User Gave Thanks to Scrutinizer For This Post:
# 11  
Old 09-23-2012
ok let's make things more complicated.

the source is now going to contain what is essentially a list of old database files that are stored in a hierarchical format, for example (yes this is keyboard bashing to indicate random miscellaneous words)

Code:
siubgsuafoua/orugaourga/aerga/alpha1,1_3*.dbcache
sfsudbgs/asfs/sfgsgsegrg/rgegsg/eegegaaregaeg/alpha1,1_4*.dbcache
ffunafrua/awfanfa/awefa/aaawefawf/beta2,5_9*.dbcache
rfserg/awerawer/awr/aeawrea/weraw/erawer/awer/beta2,5_1*.dbcache
sd/zszs/gamma8,6_7*.dbcache

so the output i would then need is:
Code:
sfsudbgs/asfs/sfgsgsegrg/rgegsg/eegegaaregaeg/alpha1,1_4*.dbcache
ffunafrua/awfanfa/awefa/aaawefawf/beta2,5_9*.dbcache
sd/zszs/gamma8,6_7*.dbcache

the commands you guys have posted above seem to get muddled because its trying to sort the lines without understanding they need to ignore everything before the final "/"
Last edited by Scrutinizer; 09-23-2012 at 10:32 AM.. Reason: code tags
tiberione
# 12  
Old 09-23-2012
Hi tiberione,

It helps if the data sample is an accurate representation from the start... Data samples also need code tags around them so that they are easy to read...

Try:
Code:
sort -t_ -k1,1 -k2,2rn file | awk -F'[_*/]' '!A[$(NF-2)]++'

Last edited by Scrutinizer; 09-23-2012 at 11:06 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to use $variable in grep?

hi i have a file which contains some messages counters. below is the snippet on the file. 17-05-29::22:36:21|message|231 17-05-29::22:36:31|message|222 17-05-29::22:36:41|message|213 17-05-30::22:36:51|message|221 17-05-30::22:37:01|message|227 17-05-30::22:37:11|message|207... (5 Replies)
Discussion started by: scriptor
5 Replies

2. Shell Programming and Scripting

Help grep one variable over other

Hi, I am trying to grep one variable over the other variable Example: i=abc j=ab grep $j $i I am getting this error: The error is due to $i being variable and not file. I know I could do it by putting the value of abc in a file and then greping it. (1 Reply)
Discussion started by: pinnacle
1 Replies

3. Shell Programming and Scripting

grep in a variable

Hello, I usually search extensively and have to date found what I've needed. However, this one's got me stumped. I need to create a variable as follow. The issue however is that upon execution, it freezes. $var1 isn't always present in usage.log and this is fine but I'd like it to continue with... (6 Replies)
Discussion started by: shadyuk
6 Replies

4. Shell Programming and Scripting

grep using variable

I have a pattern like: column "5" is missing PS: the no is in double quotes. The number usally changes, so we use a loop to grep. grep 'column "$number" is missing' filename.txt But it is not working.... How to solve this? (2 Replies)
Discussion started by: karumudi7
2 Replies

5. Shell Programming and Scripting

Grep through a variable

I want to search a text in file but that file is pointing to variable. ex: file=there was nothing special grep "there was nothing" $file but its not working . Can u let me know that how we can use variable($file) in grep command. Please use code tags (6 Replies)
Discussion started by: allthanksquery
6 Replies

6. Shell Programming and Scripting

grep using variable

how can I use grep with a variable to find a value? cat data.out Hello World grep "Hello World" data.out Hello World ## Value found I want to do something like this but can't seem to get it to work any suggestions would be appreciated. var="Hello World" grep $var data.out (3 Replies)
Discussion started by: BeefStu
3 Replies

7. Shell Programming and Scripting

grep a variable

can i grep a variable say i have a variable var=`hostname` and I want to make an if statement like if grep "esp-ueh" $var;then...... how can i do this I dont want to store this variable in a file and the grep it because my script will be used at the same time on multiple stations and then that... (9 Replies)
Discussion started by: lassimanji
9 Replies

8. Shell Programming and Scripting

grep a variable

Hi all, I am trying to do a simple thing in my mind. However I am fairly new to bash. What I need to do is create a folder for each partition on each CD, and each partition has a unique name (with spaces in it, do not ask why, it is already done :confused: ) . All CD's will show up... (2 Replies)
Discussion started by: sgstuart
2 Replies

9. Shell Programming and Scripting

grep with variable

Hi, I can't get this script to work (returns 0, should return 3): $ cat A.lst | \ while read LINE do echo "$LINE" grep -c "$LINE" B.tmp done> > > > > Socket 0 $ but in contrast this one works fine (returns 3 as expected): $ LINE=Socket $ grep -c $LINE B.tmp 3 $ (5 Replies)
Discussion started by: ozvena
5 Replies

10. Shell Programming and Scripting

How to grep a variable?

Hi, I'd like to grep a variable that I saved in the program. Like grep '0\$variable1' file1 Does someone know what's wrong with this command? Thanks a lot! (2 Replies)
Discussion started by: whatisthis
2 Replies
Login or Register to Ask a Question