Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to download a large zip file from a website?
Top Forums Shell Programming and Scripting How to download a large zip file from a website? Post 302893760 by pat_pramod on Friday 21st of March 2014 01:43:01 AM
Old 03-21-2014
How to download a large zip file from a website?
Hi,

I am trying to write a shell script which will download a file from a website say <http://xyz.com/file1.zip>.
The file is in .zip format and its size is huge, normally more than 20MB.
I searched and found that simplae way to do it is using

Code:
 
wget -O /home/pat <website address>

But there are 2 possible problems here:
1) As the file is very large, the session might get timed out.
2) I'll have to give id and password in order to connect to the website.

Can anyone give me some suggestion to overcome above 2 problems.
And also will this be possible using shell scripting or will I have to use perl for this? (as the file is very big)

Thanks.
Last edited by pat_pramod; 03-21-2014 at 03:51 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

unzip .zip file and list the files included in the .zip archive

Hello, I am trying to return the name of the resulting file from a .zip archive file using unix unzip command. unzip c07212007.cef7081.zip Archive: c07212007.cef7081.zip SecureZIP for z/OS by PKWARE inflating: CEP/CEM7080/PPVBILL/PASS/G0063V00 I used the following command to unzip in... (5 Replies)
Discussion started by: oracledev
5 Replies

2. AIX

ZIP multiple files and also specify size of zip file

I have to zip many pdf files and the size of zip file must not exceed 200 MB. When size is more than 200 MB then multiple zip files needs to be created. How we can achieve this in UNIX? I have tried ZIP utility but it takes a lot of time when we add individual pdfs by looping through a... (1 Reply)
Discussion started by: tom007
1 Replies

3. UNIX and Linux Applications

Zip command for large folder

I am trying to zip a folder, its size is more than 3 GB. I used below command zip -r foo middleware -x "*path*" This command fails every time with message "Filesize exceeded limit" Can some one help me how to over come this problem and zip the entire folder without splitting it. ... (2 Replies)
Discussion started by: ariram
2 Replies

4. UNIX for Dummies Questions & Answers

Zip a file with .zip extension.

Hi, I need to zip a .dat file with .zip extension. I tried using the "zip" command. But shell says. "ksh: zip: not found" Currently I am using gunzip to zip and changing the extension ".gz" to ".zip" as follows. mv $file `echo $file | sed 's/\(.*\.\)gz/\1zip/'` But when I tried... (1 Reply)
Discussion started by: aeroticman
1 Replies

5. Windows & DOS: Issues & Discussions

Auto download - filename UCC-YYYYMMDD.zip format.

Hi, On a daily basis I have download .zip file from FTP site. Naming convention of .zip is UCC-20100816.zip I want to create windows batch file which will automatically download latest .zip file based on system date. .zip file is gets uploaded on a daily basis on FTP site in... (4 Replies)
Discussion started by: rahulbahulekar
4 Replies

6. Shell Programming and Scripting

Zip Multiple files to One .zip file in AIX system

Hi I have a requirement in unix shell where I need to zip multiple files on server to one single .zip file. I dont see zip command in AIX and gzip command not doing completely what I want. One I do .zip file, I should be able to unzip in my local Computer. Here is example what I want... (9 Replies)
Discussion started by: RAMA PULI
9 Replies

7. Shell Programming and Scripting

Curl download zip extract large xml file

Hi i have a php script that works 100% however i don't want this to run on php because of server limits etc. Ideally if i could convert this simple php script to a shell script i can set it up to run on a cron. My mac server has curl on it. So i am assuming i should be using this to download the... (3 Replies)
Discussion started by: timgolding
3 Replies

8. Solaris

Solaris download website?

Hi I used to download all my Sun Solaris from sunfreeware.com website. But looks like things have changed. Now they want me to pay for it by going to different site. Any one know any website I can download few Solaris packages? I need make and SCCS. ... (3 Replies)
Discussion started by: samnyc
3 Replies

9. UNIX for Beginners Questions & Answers

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (2 Replies)
Discussion started by: b.saipriyanka
2 Replies

10. Shell Programming and Scripting

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (1 Reply)
Discussion started by: b.saipriyanka
1 Replies

LEARN ABOUT OSX

zipsplit

zipnote(1)						      General Commands Manual							zipnote(1)

NAME

       zipsplit - split a zipfile into smaller zipfiles

SYNOPSIS

       zipsplit [-t] [-i] [-p] [-s] [-n size] [-r room] [-b path] [-h] [-v] [-L] zipfile

ARGUMENTS

       zipfile	Zipfile to split.

OPTIONS

       -t     Report how many files it will take, but don't make them.

       -i     Make index (zipsplit.idx) and count its size against first zip file.

       -n size
	      Make zip files no larger than "size" (default = 36000).

       -r room
	      Leave room for "room" bytes on the first disk (default = 0).

       -b path
	      Use path for the output zip files.

       -p     Pause between output zip files.

       -s     Do a sequential split even if it takes more zip files.

       -h     Show a short help.

       -v     Show version information.

       -L     Show software license.

DESCRIPTION

       zipsplit reads a zipfile and splits it into smaller zipfiles.

EXAMPLES

       To be filled in.

BUGS

       Does not yet support large (> 2 GB) or split archives.

SEE ALSO

       zip(1), unzip(1)

AUTHOR

       Info-ZIP

								v3.0 of 8 May 2008							zipnote(1)
All times are GMT -4. The time now is 04:28 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy