05-08-2009
Please delete and see other post.
please delete and see other post.
Hi,
Im using awk to go through every line, but i have to use it twice as the first awk finds all the lines with a number in one field and the pipes it to wc, and the second does the same as the first but it has a extra pipe into sort and uniq that finds all the unique lines.
eg
awk... | wc -l
awk... | sort | uniq | wc-l
the output should be 2 lines, the frist being the numbers of lines that match the text given, and the second the number of unique lines that match the text.
is it possible to shorten this to one line as its not very efficient having to go through the whole file twice.
Thanks
Last edited by fredted40x; 05-08-2009 at 12:53 PM..
9 More Discussions You Might Find Interesting
1. Filesystems, Disks and Memory
Hello!
How I can increase or decrease predefined pipe buffer size?
System FreeBSD 4.9 and RedHat Linux 9.0
Thanks! (1 Reply)
Discussion started by: Jus
1 Replies
2. Shell Programming and Scripting
There is directory test:
> ls -rtl
total 12
drwxr-xr-x 2 root sys 4096 Aug 17 09:57 test2
-rw-r--r-- 1 user1 group1 16 Aug 17 10:00 test
-rw-r--r-- 1 user1 group1 16 Aug 17 10:00 test1
-rw-r--r-- 1 user1 group1 16 Aug 17 10:01 test12
-rw-r--r-- 1 user1 group1 16 Aug 17 10:01 test13
... (5 Replies)
Discussion started by: user_junior
5 Replies
3. Solaris
Hi All ,
I am unable to reinstall the OS on my Ultra Sparc 10. After the 1st CD is loaded when it goes for reboot its goes to ok prompt an its unable to boot.
What could be reason for this behavior? while loading the OS its seems fine but unable to boot!!
Then i tried changing the... (2 Replies)
Discussion started by: kumarmani
2 Replies
4. AIX
Hello everyone
I updated a partition from TL06 to TL09, everything looks ok.
I check the errpt comand, lppchk -v and both are fine.
But when I type this command I got this
$ instfix -i |grep ML
All filesets for 5300-02_AIX_ML were found.
All filesets for 5.3.0.0_AIX_ML were... (3 Replies)
Discussion started by: lo-lp-kl
3 Replies
5. Shell Programming and Scripting
in /etc/init.d/networking of an ubuntu computer, I found this code:
if ifdown -a --exclude=lo; then
log_action_end_msg $?
else
log_action_end_msg $?
fi
Shouldn't it be replace by
ifdown -a --exclude=lo
... (0 Replies)
Discussion started by: raphinou
0 Replies
6. Ubuntu
hello,
before i have install solaris 9, is good.
I would like to install Ubuntu 10.04 on a Sun Blade 150 blade.
I create cdrom iso burning with a 10x
was open I made a boot ok: boot cdrom
I get the following error:
fast data access mmu miss
i do
probe-ide all
reset-all
always
... (2 Replies)
Discussion started by: philo_71
2 Replies
7. Shell Programming and Scripting
I've been finding myself using a log file colorizer written in perl to reformat and colorize the output from many different programs. Mainly, however, I use it to make the output from "tail -f" commands more readable.
The base perl script I use is based on "colorlogs.pl" available from the... (1 Reply)
Discussion started by: rcsteiner
1 Replies
8. Shell Programming and Scripting
hello
this script should show all users and space they used without problem :
ls /home >> /root/users.txt
cat /root/users.txt | while read line; do
space=`du -s /home/$line`
echo "$line space is $space"
shift
done
but when i remove pipe ,script run without any output:
ls /home... (4 Replies)
Discussion started by: nimafire
4 Replies
9. Solaris
Hello,
We have a T5140 server with Solaris 10 and its suddenly throwing "segmentation core" when I login into the server and not showing any output for commands like df, mount etc. so I had to reboot the server to fix this issue. Please note that there's no boot disk mirroring.
But... (2 Replies)
Discussion started by: prvnrk
2 Replies
UNIQ(1) BSD General Commands Manual UNIQ(1)
NAME
uniq -- report or filter out repeated lines in a file
SYNOPSIS
uniq [-c | -d | -u] [-i] [-f num] [-s chars] [input_file [output_file]]
DESCRIPTION
The uniq utility reads the specified input_file comparing adjacent lines, and writes a copy of each unique input line to the output_file. If
input_file is a single dash ('-') or absent, the standard input is read. If output_file is absent, standard output is used for output. The
second and succeeding copies of identical adjacent input lines are not written. Repeated lines in the input will not be detected if they are
not adjacent, so it may be necessary to sort the files first.
The following options are available:
-c Precede each output line with the count of the number of times the line occurred in the input, followed by a single space.
-d Only output lines that are repeated in the input.
-f num Ignore the first num fields in each input line when doing comparisons. A field is a string of non-blank characters separated from
adjacent fields by blanks. Field numbers are one based, i.e., the first field is field one.
-s chars
Ignore the first chars characters in each input line when doing comparisons. If specified in conjunction with the -f option, the
first chars characters after the first num fields will be ignored. Character numbers are one based, i.e., the first character is
character one.
-u Only output lines that are not repeated in the input.
-i Case insensitive comparison of lines.
ENVIRONMENT
The LANG, LC_ALL, LC_COLLATE and LC_CTYPE environment variables affect the execution of uniq as described in environ(7).
EXIT STATUS
The uniq utility exits 0 on success, and >0 if an error occurs.
COMPATIBILITY
The historic +number and -number options have been deprecated but are still supported in this implementation.
SEE ALSO
sort(1)
STANDARDS
The uniq utility conforms to IEEE Std 1003.1-2001 (``POSIX.1'') as amended by Cor. 1-2002.
HISTORY
A uniq command appeared in Version 3 AT&T UNIX.
BSD
July 3, 2004 BSD