09-22-2009
remove duplicating lines
Hi,
i have a webserver logfile and want to count how many page views there have been.
I was thinking about removing lines that begin with the same user and same date&time, because it indicates they were just looking at one page and multiple hits were counted.
My question is how do I do this? I know how to remove lines that are completely alike (with uniq), but the problem is the lines aren't exactly alike, just the beginning.
for example, if you have:
i don't know how.
i don't know this.
how do i make sure the second line gets removed, because it begins with the same word(s)?
10 More Discussions You Might Find Interesting
1. Post Here to Contact Site Administrators and Moderators
SORRY FOR DUPLICATING POSTS, COULD U JUST REMOVE THE FIRST ONE.
Thank u. (1 Reply)
Discussion started by: vrguha
1 Replies
2. Red Hat
Hi guys,
Suppose you have a server with two ethernet cards (1GB each) and each cards are connecting to two different switches cisco 3750. My question is:
How can I setup my server's network interfaces to increase the throughput up to 2GB? is it possible? If not, do you know another way to up... (3 Replies)
Discussion started by: iga3725
3 Replies
3. Shell Programming and Scripting
Hi,
I'm not a expert in shell programming, so i've come here to take help from u gurus.
I'm trying to tailor a csv file that i got to make it work for the LOAD FROM command.
I've a datatable csv of the below format -
--in file format
xx,xx,xx ,xx , , , , ,,xx,
xxxx,, ,, xxx,... (11 Replies)
Discussion started by: dvah
11 Replies
4. Shell Programming and Scripting
Hi Folks,
I've put together a script for sorting my backup files into sub folders to be run from a cron job. Each file is named username.tar.gz and the file /etc/trueuserowners contains all users and their owner in the format "user: owner".
The script works fine identifying users and their owners... (10 Replies)
Discussion started by: beddo
10 Replies
5. UNIX for Dummies Questions & Answers
I have a text file which is the results of running a tests hundreds of times. For simplicity let's say that each test consists of 5 lines of text numbered 1-5 e.g.
1 aaa aaa aaa
2 bbb bbb bbb
3 ccc ccc ccc
4 ddd ddd ddd
5 eee eee eee
1 aaa aaa aaa
2 bbb bbb bbb
3 ccc... (4 Replies)
Discussion started by: millsy5
4 Replies
6. Shell Programming and Scripting
Hello,
I have a file named file_1.sh that I want to duplicate into file_2.sh, file_3.sh,..., etc.
I also need to change the text within each file so that it would fit the file name. For example, in file_1.sh there is a command to save some output as 'output_1.txt', and also there is an input... (3 Replies)
Discussion started by: haguyw
3 Replies
7. UNIX for Dummies Questions & Answers
Hi,
I have a huge file which has Lacs of lines. File system got full.
I want your guys help to suggest me a solution so that I can remove all lines from that file but not last 50,000 lines. I want solution which can remove lines from existing file so that I can have some space left with. (28 Replies)
Discussion started by: prashant2507198
28 Replies
8. Shell Programming and Scripting
I have two files, a keepout.txt and a database.csv. They're unsorted, but could be sorted.
keepout:
user1
buser3
anuser19
notheruser27
database:
user1,2343,"information about",field,blah,34
user2,4231,"mo info",etc,stuff,43
notheruser27,4344,"hiya",thing,more thing,423... (4 Replies)
Discussion started by: esoffron
4 Replies
9. Shell Programming and Scripting
Hello everyone,
Although it seems easy, I've been stuck with this problem for a moment now and I can't figure out a way to get it done.
My problem is the following:
I have a file where each line is a sequence of IP addresses, example :
10.0.0.1 10.0.0.2
10.0.0.5 10.0.0.1 10.0.0.2... (5 Replies)
Discussion started by: MisterJellyBean
5 Replies
10. Shell Programming and Scripting
I have been searching and trying to come up with an awk that will perform the following on a
converted text file (original is a pdf).
1. Since the first two lines are (begin with) text they are removed
2. if $1 is a number then all text is merged (combined) into one line until the next... (3 Replies)
Discussion started by: cmccabe
3 Replies
LEARN ABOUT HPUX
uuencode
uuencode(4) Kernel Interfaces Manual uuencode(4)
NAME
uuencode - format of an encoded uuencode file
DESCRIPTION
Files output by consist of a header line followed by a number of body lines, and a trailer line. The command ignores any lines preceding
the header or following the trailer (see uuencode(1)). Lines preceding a header must not look like a header.
The header line consists of the word followed by a space, a mode (in octal), another space, and a string which specifies the name of the
remote file.
The body consists of a number of lines, each containing 62 or fewer characters (including trailing new-line). These lines consist of a
character count, followed by encoded characters, followed by a newline.
The character count is a single printing character, which represents an integer. This integer is the number of bytes in the rest of the
line, and always ranges from 0 to 63. The byte count can be determined by subtracting the equivalent octal value of an ASCII space charac-
ter (octal 40) from the character.
Groups of 3 bytes are stored in 4 characters, 6 bits per character. All are offset by a space to make the characters printable. The last
line may be shorter than the normal 45 bytes. If the size is not a multiple of 3, this fact can be determined by the value of the count on
the last line. Extra meaningless data will be included, if necessary, to make the character count a multiple of 4. The body is terminated
by a line with a count of zero. This line consists of one ASCII space.
The trailer line consists of the word on a line by itself.
SEE ALSO
mail(1), uuencode(1), uucp(1).
uuencode(4)