Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Batch download

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Batch download
# 1  
Old 03-24-2012
Batch download
.............
Last edited by hoo; 04-04-2012 at 01:53 AM.. Reason: .
# 2  
Old 03-24-2012
try this (but you must be sure that domains are like registered and avaliable)
Code:
# mylink=$(curl -s "http://www.domain.com/play.php?key=uu67j567jj6y"|sed '/<div class/s/.*>\(.*\)<.*/\1/')
# wget -O /tmp/mytest.flv "$link"

# 3  
Old 03-24-2012
.............
Last edited by hoo; 04-04-2012 at 01:53 AM.. Reason: .
# 4  
Old 03-24-2012
Quote:
Originally Posted by hoo
thanks but i didn't.
I have a url list (7000+) and file names are random.
did you test this for single URL?
what about the source code?
"div class" is uniq in the web source code ?
i have no idea ,contents of that URLs, because of your URLS are like seem invalid.

---------- Post updated at 05:06 PM ---------- Previous update was at 04:58 PM ----------

if you dont test try this Smilie
Code:
#!/bin/bash
DESTFOLD=flvvideos ; mkdir $DESTFOLD # change your it with your dest folder
cd $DESTFOLD ; while read -r URL ; do
getlnk=$(curl -s "$URL"|grep ".flv"|sed '/<div class/s/.*>\(.*\)<.*/\1/')
wget $getlink ; done<URLfile

# 5  
Old 03-24-2012
...........
Last edited by hoo; 04-04-2012 at 01:54 AM.. Reason: ..
# 6  
Old 03-24-2012
Quote:
Originally Posted by hoo
Hello
Thanks again.
They are sample url.
Real are urls:

Lok Geet 2010 - 2011 - Hatma Rato Jhola
Dashain Shubhakamana 2078
Jhumpa Chuppa (?????? ?????? ??????) by narad khatioda

I have a url.txt. All url are in the text file. I want downlad all files in urls.

Thank you very much
just let try like that
Code:
#!/bin/bash
DESTFOLD=flvvideos 
mkdir $DESTFOLD # change your it with your dest folder
cd $DESTFOLD ; while read -r URL ; do
getlnk=$(curl -s "$URL"|sed -n '/.flv/s/<[^>]*>//gp')
wget $getlnk ; done<url.txt

Last edited by ygemici; 03-24-2012 at 05:34 PM..
# 7  
Old 03-24-2012
.........
Last edited by hoo; 04-04-2012 at 01:54 AM.. Reason: ..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Batch or not if/then

I am having trouble modifying a .sh that allows the user to run different command based of an input. So based on the user input of Y or N a different command is run. Thank you :). #!/bin/bash while true do printf "Is this a batch : " ; read id && break If "$id" = Y, Then... (14 Replies)
Discussion started by: cmccabe
14 Replies

2. Shell Programming and Scripting

Batch code

Hi Friends, I have a script like this cat script #!/bin/bash #Name: name #Task: name #$ -e /path/to/error/logfile/err.log #$ -o /path/to/output/logfile/out.log I have a list of commands like this cat commands cat 1.txt > 2.txt cat 23.bed > 789.alm zcat 1.gz > 1.txt (3 Replies)
Discussion started by: jacobs.smith
3 Replies

3. Shell Programming and Scripting

Executing a batch of files within a shell script with option to refire the individual files in batch

Hello everyone. I am new to shell scripting and i am required to create a shell script, the purpose of which i will explain below. I am on a solaris server btw. Before delving into the requirements, i will give youse an overview of what is currently in place and its purpose. ... (2 Replies)
Discussion started by: goddevil
2 Replies

4. Windows & DOS: Issues & Discussions

help with batch script

I have a file named xyz.txt with the contents eg: abc/pluto/tag/ver_1.0(b0123) abc/pippo/tag/ver_1.0(b0124) . and so on I need a script which read one by one the enteries from the file xyz.txt create folders pluto/ver_1.0(b0123) and pippo/ver_1.0(b0124) ans so on and run a command svn... (1 Reply)
Discussion started by: nerd1976
1 Replies

5. UNIX for Advanced & Expert Users

batch file

Hi all I am using tru64 Unix and I want a ready batch file which makes me to change all user passwords at the same time ,instead of changing everyone separately. Please could anyone help me to do that. bye. (1 Reply)
Discussion started by: ahmedbashir
1 Replies

6. Shell Programming and Scripting

batch renaming ...

hi all, given a path, for example : /<pwd>/artist/album/ what i would like to do is to rename the album directory like that : /<pwd>/artist/artist | album/ and i would like to do the latter for all the "artist" directories and for all the "album" directories that belong to an artist ... (4 Replies)
Discussion started by: OneDreamCloser
4 Replies

7. Programming

batch file

what is a command to call a batch file from a c++ program when called with the argument which is a text file, then how to print that text file on a printer. please help me with code if possible (3 Replies)
Discussion started by: ramneek
3 Replies

8. IP Networking

batch file

my requirment is i have to call a batch file from a c++ program that batch file is called with the argument as print.txt print.txt is a text file which should get printed on printer (any printer) when a batch file call is made 1) how to call a batch file in c++ 2) how to print the text... (1 Reply)
Discussion started by: ramneek
1 Replies

9. Shell Programming and Scripting

rename in batch

example test1 will have m1234567.12a I would like to rename in batch but I don't Please help me on this. cd /a1/a2/a3 test1=$(basename /a1/a2/a3/*.*) >> /tmp/t echo $test1 echo "Extracting 8 th position" >> /tmp/t2 awk '{print substr($1,8,1); }' $test1 >> /tmp/t3 echo "extraction ... (3 Replies)
Discussion started by: kathy18
3 Replies

10. UNIX for Dummies Questions & Answers

batch render

I'm interested in getting unix in my pc, can someone tell me where and how can I get it. I'm a complete virgin about unix, I work in 3d animation and i need unix to make batch rendering work in Maya. Another question is: how do I know what hardware is compatible with unix and do I need any drivers... (1 Reply)
Discussion started by: Vitor
1 Replies
Login or Register to Ask a Question