Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

curl

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting curl
# 1  
Old 07-27-2005
curl
Aren't there any way to download files as below?
For example, I want to download all .html files under the root directory of unix.com/
Code:
curl -O https://www.unix.com/*.html

This won't work, but please tell me the way to do this.

Well, the best way is to get the file list of the directory, but i don't think this is possible!
# 2  
Old 07-27-2005
All url's in the unix.com forum follow the pattern,

https://www.unix.com/shell-programming-and-scripting/20444-curl-post79349.html and similiar.

Why not keep incrementing the count which comes after p= and retrieve the file.

vino
Last edited by vino; 07-27-2005 at 08:23 AM..
# 3  
Old 07-27-2005
Thank you vino!
wget is perfect, i think.

Ah... in fact, I don't want to download this forums' files.
Last edited by Euler04; 07-27-2005 at 08:41 AM..
# 4  
Old 07-27-2005
As far as I know, wget can't do that, can it? (Warning: wildcards not supported in HTTP.),, wget 1.8.2
# 5  
Old 07-27-2005
Well, I have some info about the file name, so it's not the point for me.
Also, wget can get the directory, so we can use wildcards after the download, i think.

Thank You.
# 6  
Old 07-27-2005
yes, it accepts wildcards when you download from a 'FTP' site, but i'm not sure about HTTP
# 7  
Old 07-27-2005
though wildcards are not supported for HTTP, you can still use -r and -p.
and btw, if this forum works similar to database-driven phpbb, there's no page such as https://www.unix.com/shell-programming-and-scripting/20444-curl-post79349.html. there's showthread.php, and p seems to be the thread index variable, whose contents will be fetched from database when showthread.php is executed.
Last edited by fdarkangel; 07-27-2005 at 04:22 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

CURL syntax

Topic : cmd to check status of url using Curl I have below 2 lines which r working fine /usr/bin/curl -u user:pasword http://hostname /usr/bin/curl -connect-timeout=10 http://hostname Now I want to use user:pasword and connect-timeout parameter in one line /usr/bin/curl -u user:pasword... (1 Reply)
Discussion started by: sam@sam
1 Replies

2. Shell Programming and Scripting

Using CURL in a script

Hi all so I'm new to scripting but I am making a script that is a url shortener. It will take a url off the command line and spit back the shortened version using bit.ly's api this is what I have so far if then echo "You must supply a URL." exit 1 fi read url... (3 Replies)
Discussion started by: subway69
3 Replies

3. Shell Programming and Scripting

Using CURL for FTP

Hello, I am using curl command to interact with the FTP server. I have gathered some information around downloading / uploading of files using curl command. However, I couldn't find any information around 1) Listing all the files on FTP server in any given folder having a specific extn. (... (3 Replies)
Discussion started by: amitshete
3 Replies

4. Shell Programming and Scripting

Help with cURL

Hi all; first of all i need to clarify that i am new to apache2 server configuration and for some needs i want to transfer some files using curl to web directory,so please bear with me: following is the command i m running to transfer file to my web directory: curl -T "q"... (4 Replies)
Discussion started by: arien001
4 Replies

5. Shell Programming and Scripting

Using curl in commandline

Hi, I am using curl to hit a url using http in solaris 10 using commandline, I want to transfer an attachment(using multipart curl -F) also as a part of the request. If anyone has used kindly help me with the syntax. I am using below command: /usr/local/bin/curl -v... (1 Reply)
Discussion started by: manishmaha
1 Replies

6. Shell Programming and Scripting

using curl in a script

Hello everyone I'm currently using a script to upload files (different file names, but same date) to an ftp server (see below) #!/bin/sh # Set the variables HOST=<host> USER=<user> PASSWD=<password> ftp -i -n $HOST <<END_SCRIPT user ${USER} ${PASSWD} mput... (0 Replies)
Discussion started by: soliberus
0 Replies

7. Solaris

Curl Installation

Hi, Has anyone installed curl on solaris? I tried installing curl-7.19.4 without any effect. Here's what i have done so far: Copied the package curl-7.19.4-sol8-sparc-local under a certain dir. Tried to add the path in PATH variable. But when I type curl it says bash: curl: command not found.... (2 Replies)
Discussion started by: King Nothing
2 Replies

8. Shell Programming and Scripting

Curl command

Hello, I try to take out of the command curl the info of the time... time curl --write \"Downloaded %{time total}\" -o ...... but having some problem. (1 Reply)
Discussion started by: protocomm
1 Replies

9. Shell Programming and Scripting

use of curl

I have to transfer a file from my aix box to another server using ftps protocol, how can i achieve this using curl preferably or any other utility. Regards Sandeep (0 Replies)
Discussion started by: jayawantsandeep
0 Replies

10. AIX

use of curl

Hi guys , need some help I have to transfer a file from my aix box to another server using ftps protocol, how can i achieve this using curl preferably or any other utility. Thanks Sandeep (0 Replies)
Discussion started by: jayawantsandeep
0 Replies
Login or Register to Ask a Question