Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Grep number between Square [] brackets

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Grep number between Square [] brackets
# 15  
Old 04-01-2014
You cannot usefully execute sort on a single record (i.e. your variable)
Code:
$ var="1|2|4|3|5"
$ echo $var | sort
1|2|4|3|5
$

You would need to put the sort in before building the variable up.

Have you tried the suggestion from wisecracker?

An alternate might be:-
Code:
cat get_vals.sh
#/bin/ksh
# get_vals.sh
ifs_str="$IFS"
IFS="$IFS"'[]'
echo "20140320 00:08:23.846 INFO  [WebContainer : 84] - anything in line
20140320 00:08:23.846 Test  [translate : 589] - Virtual and lab lab anything
20140320 00:08:23.846 Data  [anything : 60] - anything in line
20140320 00:08:23.847 anyting  [anything : 5] - anything in line" > /tmp/file1
temp=""
text=""
while read line
do
        temp=($line)
        echo ${temp[5]}            # Just put to standard output for sort and next loop
done < /tmp/file1 | sort -un | while read item
do
        text="${text}${item}|"
done

text="${text%\|}"
echo "$text"
IFS="$ifs_str"
exit 0

$ ./get_vals.sh
5|60|84|589

Last edited by rbatte1; 04-01-2014 at 10:11 AM.. Reason: Highlighting
These 2 Users Gave Thanks to rbatte1 For This Post:
nes wisecracker
# 16  
Old 04-01-2014
Quote:
Originally Posted by nes
Hi Don Cragun,

I have log file which is mixed of all users, so perticular user log not getting from common log file. I have already captured lines based on userid. But thread I wanted to get in one variable. So here thread value is in between squre brackets after colon ( : ).
I repeat: What are you going to do with this variable with hundreds of thousands of values separated by vertical bars in it once you get it? Now that you've said you want to get rid of duplicates, maybe it is only thousands of elements in the list instead of hundreds of thousands, but it still seems like you are focusing on an output format that is going to make it hard for you to use the results!

After you answer that question, also answer the following:
  1. Do you care if the values are sorted, or do you just want to be sure your list has no duplicates?
  2. Is it OK if the list separator is a <newline> character instead of a vertical bar? (If not, explain why!)

If you refuse to answer these three simple questions, I feel that we are all wasting our time in this thread.
These 4 Users Gave Thanks to Don Cragun For This Post:
jim mcnamara nes rbatte1 wisecracker
# 17  
Old 04-14-2014
Quote:
Originally Posted by Don Cragun
I repeat: What are you going to do with this variable with hundreds of thousands of values separated by vertical bars in it once you get it? Now that you've said you want to get rid of duplicates, maybe it is only thousands of elements in the list instead of hundreds of thousands, but it still seems like you are focusing on an output format that is going to make it hard for you to use the results!


After you answer that question, also answer the following:
  1. Do you care if the values are sorted, or do you just want to be sure your list has no duplicates?
  2. Is it OK if the list separator is a <newline> character instead of a vertical bar? (If not, explain why!)
If you refuse to answer these three simple questions, I feel that we are all wasting our time in this thread.

I just wanted no duplicate entry,So if we will do sort and then remove duplicate it will be easy.
Any seperator is fine.

Thanks for helping Smilie
# 18  
Old 04-14-2014
The following seems pretty easy to me and doesn't need sort or uniq to get a list with no duplicates:
Code:
#!/bin/ksh
var=$(awk -F '( : )|[]]' '!($2 in a) {a[$2]; print $2}' Input)
printf 'var=%s\n' "$var"

If the file Input contains:
Code:
20140320 00:08:23.846 INFO  [WebContainer : 84] - anything in line
20140320 00:08:23.846 Test  [translate : 589] - Virtual and lab lab anything
20140320 00:08:23.846 Data  [anything : 60] - anything in line
20140320 00:08:23.847 anyting  [anything : 5] - anything in line
20140320 00:08:23.846 INFO  [WebContainer : 84] - anything in line
20140320 00:08:23.846 Test  [translate : 589] - Virtual and lab lab anything
20140320 00:08:23.846 Data  [anything : 60] - anything in line
20140320 00:08:23.847 anyting  [anything : 5] - anything in line

the output produced is:
Code:
var=84
589
60
5

I still question the need for storing a list of hundreds of thousands of values in a variable. In most cases it would be better to process the values one at a time as in:
Code:
awk -F '( : )|[]]' '!($2 in a) {a[$2]; print $2}' Input | while read num
do      ... do whatever you want with $num ...
done

These 2 Users Gave Thanks to Don Cragun For This Post:
nes rbatte1
# 19  
Old 04-15-2014
Hi Don Cragun,

It is working.... Thank you very much.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

IF statement with square brackets

Hi All, Hope you all are doing good. Yesterday in my project i came across a scenario which i can not guess why it was working in one region and why it was not in another region. Please find my issue below. I am using AIX version 6.0 of UNIX in my project, in shell scripting i have the... (1 Reply)
Discussion started by: mad man
1 Replies

2. Shell Programming and Scripting

Problem with occurence of square brackets

Hello all, I have the following problem: $ cat infile this is spam and i need this too this is spam and i need this too $ perl -nwe '$_ =~ /]+ \]+)\]\]*\]? (\+)$/; print "$1 - $2\n";' infile i need this - too i need this - and i need this too I am not sure how many occurences of... (13 Replies)
Discussion started by: zaxxon
13 Replies

3. Shell Programming and Scripting

Compare the value in between square brackets in file

I wanted to compare the value inside the Squre bracket after Colon ( : ) based on any value(seperated by or operator | ) inside the variable Thread and if match found then wnated to store in output file Input file : 20140320 00:08:43.918 INO 35] - Corporate hub is 20140320 00:08:43.918... (2 Replies)
Discussion started by: nes
2 Replies

4. UNIX for Dummies Questions & Answers

Single or double square brackets

Hi frieds, I don't understand the difference between single square bracket and double square brackets in a IF condition. Ex. if ; then RETURNJOB=1 else RETURNJOB=0 fi It run, but this if ]; then RETURNJOB=1 else RETURNJOB=0 fi (4 Replies)
Discussion started by: dogshort
4 Replies

5. Shell Programming and Scripting

Delete text between square brackets and also delete those square brackets using sed or awk

Hi All, I have a text file which looks like this: computer programming systems engineering I want to get rid of these square brackets and also the text that is inside these brackets. So that my final text file looks like this: computer programming systems engineering I am using... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

6. UNIX for Dummies Questions & Answers

Test command - Two square brackets

Hello, Can someone please explain to me the following line, ] && break I do not understand why two test square brackets are used. Thanks, Shantanu ---------- Post updated at 03:38 PM ---------- Previous update was at 03:35 PM ---------- And, also why there's a $ before (echo $c |... (5 Replies)
Discussion started by: Shan_u2005
5 Replies

7. Shell Programming and Scripting

Double square brackets question

Hi, I just came across an interesting shell script syntax like the one below: ] && (trap 'rm -rf ${WORK_DIR}/*.$$; echo "\n\nInterrupted !!\n\n"; exit 4' 1 2 3 15) Can someone please explain the code snippet above? The trap command bit is fine but ] && is the hazy part. Generally we use an... (2 Replies)
Discussion started by: King Nothing
2 Replies

8. Shell Programming and Scripting

Use of double square brackets in ksh

Hi First apologies if this has been raised before. I've got the following in a ksh script: if ] For some reason this does not work. But if I remove the double square brackets to: if This works. I thought ksh supported the ]. Or is there more to it? Thanks in advance. (3 Replies)
Discussion started by: tsu3000
3 Replies

9. Shell Programming and Scripting

WHy the double square brackets?

One of the senior administrators gave me a shell script to modify and it begins as follows: if ] && ] {more code follows} Why the double square brackets? (10 Replies)
Discussion started by: mojoman
10 Replies

10. UNIX for Dummies Questions & Answers

square brackets

I would like to substitute a phrase which contains square brackets. change TO how? Thanks (2 Replies)
Discussion started by: gilead29
2 Replies
Login or Register to Ask a Question