04-24-2006
if and sed statement
this is my output for my crawler.
/about.html
/ads/
/advanced_search?hl=en
froogle.google.com/frghp?hl=en&tab=wf&ie=UTF-8
groups.google.com/grphp?hl=en&tab=wg&ie=UTF-8
/imghp?hl=en&tab=wi&ie=UTF-8
/intl/en/options/
/language_tools?hl=en
/maphp?hl=en&tab=wl&ie=UTF-8
news.google.com/nwshp?hl=en&tab=wn&ie=UTF-8
/preferences?hl=en
scholar.google.com/schhp?hl=en&tab=ws&ie=UTF-8
/services/
what i am trying to do is add the website to the beginning of the output
e.g: for instance the first line of the output reads "/about.html" then after the website is added this is what it would read "www.google.com/about.html" i am trying to pass the website through variable "$1". and i am trying to write an if statement to where if the output has "/" in front at the begnning it would add $1 {www.google.com} it will add and if it does'nt it will leave it alone. can anyone help?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am just wondering if it's possible to refer to variables within a sed statement as follows:-
cat $file | sed -e 1's/$oldtext/$newtext/' > $file
as when I run the script, the variables are not recognised and nothing happens..??
Thanks (5 Replies)
Discussion started by: sirtrancealot
5 Replies
2. Shell Programming and Scripting
I am having some problems with sed, that I am hoping that I can get some assistance with. I am trying to remove two subsets of a string, and cannot figure out how to have it work.
Here is an example string:
auth_ldap authenticate: user joe authentication failed; URI /svn/
I want to... (4 Replies)
Discussion started by: Guyverix
4 Replies
3. UNIX for Dummies Questions & Answers
The file dbnames.txt has 5 columns, what i'm trying to do is that when the fifth column equals A, store in the variable "access" the word, "admin access". If it equals B, then "business access" etc. I think their is a problem with my sed command, because it is not substibstituting the words... (1 Reply)
Discussion started by: ross_one
1 Replies
4. Shell Programming and Scripting
I'm searching the most effective way of doing the following task, so if someone can either provide a working solution with sed or one totally different but more effective then what I've got so far then please go ahead!
The debugme directory has 3 subdirectorys and each of them has one .txt file... (7 Replies)
Discussion started by: TehOne
7 Replies
5. Shell Programming and Scripting
I have following requirement.
Say, my text file contains following patterns
{2010501005|XXGpvertex|9|0|17|0|{|{30100001|XXparameter_set|@@@@{{30001002|XXparameter|!prototype_path|$AB_COMPONENTS/Sort/Sort.mpc|3|2|Pf$|@{0|}}
}}@0|@315000|78500|335000|99000|114000|87000|17|And the Sort|Ab... (8 Replies)
Discussion started by: Shell_Learner
8 Replies
6. Shell Programming and Scripting
Hi,
I tried to go through a lot of online material but could not find concrete solution.
My issues is like this :
I've got a input file like this :
<a>
<startDate>19700101000000</startDate>
<endDate>20300101000000</endDate>
</a>
... (12 Replies)
Discussion started by: Shaishav Shah
12 Replies
7. Shell Programming and Scripting
Is there an easy way of checking for the existence of a file that ends with the extension .order and if it exists do something? if not do nothing (7 Replies)
Discussion started by: firefox2k2
7 Replies
8. Shell Programming and Scripting
Hello Guys,
I am new here and this is my first post, hope someone can help me
I am writing a script that is supposed to go in 9 different directories and edit a given file in each of the directories. I am using sed to edit the file as
sed -i 'line# s/#to be changed/#to be replaced with/... (5 Replies)
Discussion started by: Madiouma Ndiaye
5 Replies
9. Shell Programming and Scripting
Hi folks,
I have a scenario to convert the update statements into insert statements using shell script (awk, sed...) or in database using regex.
I have a bunch of update statements with all columns in a file which I need to convert into insert statements.
UPDATE TABLE_A SET COL1=1 WHERE... (0 Replies)
Discussion started by: dev123
0 Replies
10. Shell Programming and Scripting
input
| Jan 8 2018 11:28PM| 24 | 75 | 51 | 1 | 1.600|
| Jan 8 2018 12:01PM| 52 | 823 | 21 | 6 | 2.675|
desired output
Jan-8-2018-11:28PM 24 75 51 1 1.600
Jan-8-2018-12:01PM 52 823 21 6 2.675
Dear friends,
I have input file , as shown above and... (10 Replies)
Discussion started by: sagar_1986
10 Replies
LEARN ABOUT MOJAVE
ppi::token::bom
PPI::Token::BOM(3) User Contributed Perl Documentation PPI::Token::BOM(3)
NAME
PPI::Token::BOM - Tokens representing Unicode byte order marks
INHERITANCE
PPI::Token::BOM
isa PPI::Token
isa PPI::Element
DESCRIPTION
This is a special token in that it can only occur at the beginning of documents. If a BOM byte mark occurs elsewhere in a file, it should
be treated as PPI::Token::Whitespace. We recognize the byte order marks identified at this URL:
<http://www.unicode.org/faq/utf_bom.html#BOM>
UTF-32, big-endian 00 00 FE FF
UTF-32, little-endian FF FE 00 00
UTF-16, big-endian FE FF
UTF-16, little-endian FF FE
UTF-8 EF BB BF
Note that as of this writing, PPI only has support for UTF-8 (namely, in POD and strings) and no support for UTF-16 or UTF-32. We support
the BOMs of the latter two for completeness only.
The BOM is considered non-significant, like white space.
METHODS
There are no additional methods beyond those provided by the parent PPI::Token and PPI::Element classes.
SUPPORT
See the support section in the main module
AUTHOR
Chris Dolan <cdolan@cpan.org>
COPYRIGHT
Copyright 2001 - 2011 Adam Kennedy.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
The full text of the license can be found in the LICENSE file included with this module.
perl v5.18.2 2011-02-25 PPI::Token::BOM(3)