02-08-2011
One more thing I wanted was to remove any duplicate lines in a bunch of hundreds of lines.
For e.g - If I have following,
portal-test-domain-com
portal-test-domain-com
portal-test-domain-com
I just need them to be only one line saying portal-test-domain-com instead of 3.
Also I need to remove certain parts of each line.
For e.g -
abbbs://porta-test-domain.com/wps/urportal/weber/localbr&ticket=ST-385945-1cdbuEe1o57neMuMgIWa-1681078B-DFC2-7B56-E58B-AA15B18411AD&pgtUrl=https
I need to remove first abbbs and remove everything after domain.com.
If someone can help me, that would be really great since I am still learning these things and it will be at least good couple of weeks before I would do them on my own.
Thanks in advance,
Andy.
---------- Post updated at 05:05 PM ---------- Previous update was at 04:30 PM ----------
Ok, I have just managed to remove the first http:// part from ALL lines of the log file and have also remove the https part of ALL lines to have a much better output for now.
The only part remaining for now is to find and remove all duplicate URLs as mentioned above. Will post a fix here if I find any; till then all suggestions are welcome.
Thanks,
Andy
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi everyone.
Could u be so kind and help me with on "simple" shell script?
1. i need to search a file line by line for a pattern.
example of a lines in that file
2947 domain = feD,id = 00 0A 02 48 17 1E 1D 39 DE 00 0E 00,Name
Values:snNo = f10
Add AttFlag = 0
2. i need to find... (0 Replies)
Discussion started by: dusoo
0 Replies
2. Shell Programming and Scripting
Hi ,
I have a doubt about a shell script to find an ERROR from the log file. But I need to specify a the scan from a particular date and time in the log. Till now I have developed the following script. Please suggest what shall I add in this for date and time. If the script finds a particular... (5 Replies)
Discussion started by: himvat
5 Replies
3. Shell Programming and Scripting
hi All,
how to find a pattern in the log file & display the above and below line
for example in the log file, i have many lines, whenever i search for "Category" it should display the above line with only few parameter like i want only the location name & department name
Thu Jul 02 11:05:23... (2 Replies)
Discussion started by: rithick256
2 Replies
4. Homework & Coursework Questions
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
Write an automated shell program(s) that can create, monitor the log files and report the issues for matching... (0 Replies)
Discussion started by: itian2010
0 Replies
5. Shell Programming and Scripting
I have logs files which are generated each day depending on how many processes are running. Some days it could spin up 30 processes. Other days it could spin up 50. The log files all have the same pattern with the number being the different factor. e.g.
LOG_FILE_1.log
LOG_FILE_2.log etc etc
... (2 Replies)
Discussion started by: atelford
2 Replies
6. Shell Programming and Scripting
i have little challenge, help me out.i have a file where i have a value declared and and i have to replace the value when called. for example i have the value for abc and ccc. now i have to substitute the value of
value abc and ccc in the place of them.
Input File:
go to &abc=ddd;
if... (16 Replies)
Discussion started by: saaisiva
16 Replies
7. Shell Programming and Scripting
Hi,
I've to find the file which has the pattern
"Delete Report for History Tables"
and need to search this file pattern from directory which has sub directories as well.
I'm using ksh 88
Please suggest me which command will be used to find the file pattern .
Thanks. (1 Reply)
Discussion started by: smile689
1 Replies
8. Shell Programming and Scripting
Hello All,
I have to write a script which will search for diffrent patterns like "Struck" "Out of Memory" , etc from a log file in Linux box's.
Now I will be executing a cron job to find out the results by executing the script once in every 30 minutes.
suppose time is
14-04-29:05:31:09
So I... (3 Replies)
Discussion started by: Shubhasis Mathr
3 Replies
9. Shell Programming and Scripting
I very new to C Shell. I am trying to do is read from Command line.
Find the if the file is zip, .txt, symbloic link,pipe, unknow (if file is not zip, txt, sy....)
here is what I what got so far. I am very stuck atm Please help me out :
If the file is symblooc link what file is link to
... (12 Replies)
Discussion started by: madbull41
12 Replies
10. Shell Programming and Scripting
I need to find the latest file -filename_YYYYMMDD in the directory DIR. the below is not working as the position is shifting each time because of the spaces between(occuring mostly at file size field as it differs every time.)
please suggest if there is other way.
report =‘ls -ltr... (2 Replies)
Discussion started by: archana25
2 Replies
learn(1) General Commands Manual learn(1)
NAME
learn - Provides computer-aided instruction for the C shell
SYNOPSIS
learn [-directory] [subject] [lesson]
The learn command provides computer-aided instruction courses and practice in the use of Tru64 UNIX.
OPTIONS
Allows you to exercise a script in a nonstandard place.
DESCRIPTION
To get started, enter learn; if this is the first time that you are invoking the learn command, you are guided through a series of ques-
tions to determine what type of instruction you want to receive.
If you have used learn before and left your last session without completing a subject, the program uses information in $HOME/.learnrc to
start you up in the same place you left off.
To bypass questions, enter a subject or lesson. In order to enter a lesson, you must know the lesson number that you received in a previ-
ous learn command session. If you do not know the lesson number, enter the lesson number as a subject. The learn command searches for the
first lesson containing the subject you specified. If the lesson is a - (dash), learn prompts for each lesson; this is useful for debug-
ging.
You can specify the following subjects:
files editor vi morefiles macros eqn C
SUBCOMMANDS
There are a few special commands. The bye command terminates a learn session, and the where command tells you of your progress (where m
tells you more.) The again command redisplays the text of the lesson and again lesson lets you review lesson. The hint command prints the
last part of the lesson script used to evaluate a response, while hint m prints the entire lesson script. This is useful for debugging
lessons and might possibly give you an idea about what is expected.
EXAMPLES
To take the online lesson about files, enter: learn files
You are then prompted for further input.
FILES
Playpen directories. Start-up information.
SEE ALSO
Commands: csh(1), ex(1)
learn(1)