How to download a large zip file from a website?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to download a large zip file from a website?
# 1  
Old 03-21-2014
How to download a large zip file from a website?

Hi,

I am trying to write a shell script which will download a file from a website say <http://xyz.com/file1.zip>.
The file is in .zip format and its size is huge, normally more than 20MB.
I searched and found that simplae way to do it is using

Code:
 
wget -O /home/pat <website address>

But there are 2 possible problems here:
1) As the file is very large, the session might get timed out.
2) I'll have to give id and password in order to connect to the website.

Can anyone give me some suggestion to overcome above 2 problems.
And also will this be possible using shell scripting or will I have to use perl for this? (as the file is very big)

Thanks.

Last edited by pat_pramod; 03-21-2014 at 03:51 AM..
# 2  
Old 03-21-2014
You have the answer, right there. You just need to know which wget options to use. You have invented two "problems" that don't necessarily exist.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (1 Reply)
Discussion started by: b.saipriyanka
1 Replies

2. UNIX for Beginners Questions & Answers

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (2 Replies)
Discussion started by: b.saipriyanka
2 Replies

3. Solaris

Solaris download website?

Hi I used to download all my Sun Solaris from sunfreeware.com website. But looks like things have changed. Now they want me to pay for it by going to different site. Any one know any website I can download few Solaris packages? I need make and SCCS. ... (3 Replies)
Discussion started by: samnyc
3 Replies

4. Shell Programming and Scripting

Curl download zip extract large xml file

Hi i have a php script that works 100% however i don't want this to run on php because of server limits etc. Ideally if i could convert this simple php script to a shell script i can set it up to run on a cron. My mac server has curl on it. So i am assuming i should be using this to download the... (3 Replies)
Discussion started by: timgolding
3 Replies

5. Shell Programming and Scripting

Zip Multiple files to One .zip file in AIX system

Hi I have a requirement in unix shell where I need to zip multiple files on server to one single .zip file. I dont see zip command in AIX and gzip command not doing completely what I want. One I do .zip file, I should be able to unzip in my local Computer. Here is example what I want... (9 Replies)
Discussion started by: RAMA PULI
9 Replies

6. Windows & DOS: Issues & Discussions

Auto download - filename UCC-YYYYMMDD.zip format.

Hi, On a daily basis I have download .zip file from FTP site. Naming convention of .zip is UCC-20100816.zip I want to create windows batch file which will automatically download latest .zip file based on system date. .zip file is gets uploaded on a daily basis on FTP site in... (4 Replies)
Discussion started by: rahulbahulekar
4 Replies

7. UNIX for Dummies Questions & Answers

Zip a file with .zip extension.

Hi, I need to zip a .dat file with .zip extension. I tried using the "zip" command. But shell says. "ksh: zip: not found" Currently I am using gunzip to zip and changing the extension ".gz" to ".zip" as follows. mv $file `echo $file | sed 's/\(.*\.\)gz/\1zip/'` But when I tried... (1 Reply)
Discussion started by: aeroticman
1 Replies

8. UNIX and Linux Applications

Zip command for large folder

I am trying to zip a folder, its size is more than 3 GB. I used below command zip -r foo middleware -x "*path*" This command fails every time with message "Filesize exceeded limit" Can some one help me how to over come this problem and zip the entire folder without splitting it. ... (2 Replies)
Discussion started by: ariram
2 Replies

9. AIX

ZIP multiple files and also specify size of zip file

I have to zip many pdf files and the size of zip file must not exceed 200 MB. When size is more than 200 MB then multiple zip files needs to be created. How we can achieve this in UNIX? I have tried ZIP utility but it takes a lot of time when we add individual pdfs by looping through a... (1 Reply)
Discussion started by: tom007
1 Replies

10. UNIX for Dummies Questions & Answers

unzip .zip file and list the files included in the .zip archive

Hello, I am trying to return the name of the resulting file from a .zip archive file using unix unzip command. unzip c07212007.cef7081.zip Archive: c07212007.cef7081.zip SecureZIP for z/OS by PKWARE inflating: CEP/CEM7080/PPVBILL/PASS/G0063V00 I used the following command to unzip in... (5 Replies)
Discussion started by: oracledev
5 Replies
Login or Register to Ask a Question