Help with shell script for url processing


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with shell script for url processing
# 1  
Old 03-01-2010
Question Help with shell script for url processing

Hi,

My objective is to make a shell script that, when run, you can input multiple links at once.
text is then inserted between the http:// part and the following url.
example :
Code:
http://google.be  ==>  http://sometext.google.be

it would be great if it could then open all the created links (wich will be download links to rar files.) in the default browser or download the files through the terminal (i work on a mac btw). it's also good if it just echo's the created links in the terminal.

could someone provide me with good instructions or the script to do this so i can study it and use / tweak it.

the only part i found was the substitution for the links but i didn't get it to work Smilie

Thnx in Advance!!
# 2  
Old 03-01-2010
Quote:
Originally Posted by tooster
My objective is to make a shell script that, when run, you can input multiple links at once.
text is then inserted between the http:// part and the following url.
example :
Code:
http://google.be  ==>  http://sometext.google.be


To insert the text:
Code:
url=http://google.be
insert=sometext
newurl=${url%%://*}://$insert.${url#*://}


Note that there is no reason to use an external command.

Last edited by cfajohnson; 03-01-2010 at 07:26 PM..
# 3  
Old 03-01-2010
Code:
$ echo "url=http://google.be" |sed 's/\(url=http:\/\/\)\(google.be\)/\1sometext.\2/'
url=http://sometext.google.be

# 4  
Old 03-02-2010
Dear friend,

You can use the following code also

Code:
 
echo "url=http://google.be" | sed 's!url=http://!url=http://sometext.!'

# 5  
Old 03-02-2010
You can achieve this using Perl as follows
Code:
my $string = "http://google.be";
if ( $string =~ s/(http:\/\/)(google.be)/$1sometext.$2/ )
{
print $string;
}

Now the string will contain the following

http://sometext.google.be
# 6  
Old 03-02-2010
MySQL

It you want to open the sites of created links just use this ,

Code:
url="http://google.be"
count=0;
while [ $count -le 4 ]
do
        read text
        f_url=`echo $url | sed -r "s/(:\/\/)/\1$text./"`
        let count=$count+1;
        gnome-www-browser $f_url
done


Here you can open 5 url's.

Thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M... (5 Replies)
Discussion started by: ajayram
5 Replies

2. Shell Programming and Scripting

How to Parse the XML data along with the URL in Shell Script?

Hi, Can anybody help to solve this. I want to parse some xmldata along with the URL in the Shell. I'm calling the URL via the curl command Given below is my shell script file export... (7 Replies)
Discussion started by: Megala
7 Replies

3. Shell Programming and Scripting

fire an URL using shell script

Hi, Can anyone tell me how to fire an URL using a shell script? :wall: (8 Replies)
Discussion started by: arijitsaha
8 Replies

4. Shell Programming and Scripting

Shell script for cron url

Hi guys, I have a serious issue with running cron command. My host not supported format below mentioned, just the URL.) http://www.mysite/example.php ( I’m affraid a bit, the host do not going to support the sh as well…anyway) Somehow I need to „wrap” this command, to able to call cron: ... (1 Reply)
Discussion started by: vazzeg
1 Replies

5. Shell Programming and Scripting

How to find invalid URL in a text file using shell script?

How to find and remove invalid URLs in a text file using shell script? (1 Reply)
Discussion started by: vel4ever
1 Replies

6. Shell Programming and Scripting

Refresh a URL from shell script

I have a php page which i run in a browser, it has a the refresh meta tag which refreshes the page after every 15 mins. Now i am running this on a browser. It will refresh and do something and update the database every 15 mins. So now is there any way i can simulate this using a simple shell... (2 Replies)
Discussion started by: tonan
2 Replies

7. Shell Programming and Scripting

picking file from a particular URL and the processing

body { margin: 0 0 0 0; padding:0 0 0 0 }td,div { font-family:Courier New;font-size:10pt;vertical-align:top }body { margin: 0 0 0 0; padding:0 0 0 0 }.transcript { background-color:#d2d2d2; }.messageBlock { margin-left:4px; margin-bottom:3px }.message { margin-left:100px; word-wrap:break-word;... (0 Replies)
Discussion started by: priyanka3006
0 Replies

8. Shell Programming and Scripting

Shell Script to hit a url

Hi all, I have a php file that grabs xml, parses it and updates my db accordingly. I want to automate the execution of this process, rather than having to hit the url manually. I have been looking into using cron to execute a script to do this, however i'm not exactly sure what command i would... (1 Reply)
Discussion started by: restivz77
1 Replies

9. Shell Programming and Scripting

URL call from SHELL script

My system does not have wget, curl and lynx. The chances are low that the SA would install them for me. Do I have any other way out? I need to invoke a few URL calls from my SHELL script. Thought of using a PERL script or writing a simple Java client, but that adds in more dependencies. Any... (37 Replies)
Discussion started by: chengwei
37 Replies

10. UNIX for Advanced & Expert Users

url calling and parameter passing to url in script

Hi all, I need to write a unix script in which need to call a url. Then need to pass parameters to that url. please help. Regards, gander_ss (1 Reply)
Discussion started by: gander_ss
1 Replies
Login or Register to Ask a Question