Sponsored Content
Top Forums Shell Programming and Scripting How to download a large zip file from a website? Post 302893760 by pat_pramod on Friday 21st of March 2014 01:43:01 AM
Old 03-21-2014
How to download a large zip file from a website?

Hi,

I am trying to write a shell script which will download a file from a website say <http://xyz.com/file1.zip>.
The file is in .zip format and its size is huge, normally more than 20MB.
I searched and found that simplae way to do it is using

Code:
 
wget -O /home/pat <website address>

But there are 2 possible problems here:
1) As the file is very large, the session might get timed out.
2) I'll have to give id and password in order to connect to the website.

Can anyone give me some suggestion to overcome above 2 problems.
And also will this be possible using shell scripting or will I have to use perl for this? (as the file is very big)

Thanks.

Last edited by pat_pramod; 03-21-2014 at 03:51 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

unzip .zip file and list the files included in the .zip archive

Hello, I am trying to return the name of the resulting file from a .zip archive file using unix unzip command. unzip c07212007.cef7081.zip Archive: c07212007.cef7081.zip SecureZIP for z/OS by PKWARE inflating: CEP/CEM7080/PPVBILL/PASS/G0063V00 I used the following command to unzip in... (5 Replies)
Discussion started by: oracledev
5 Replies

2. AIX

ZIP multiple files and also specify size of zip file

I have to zip many pdf files and the size of zip file must not exceed 200 MB. When size is more than 200 MB then multiple zip files needs to be created. How we can achieve this in UNIX? I have tried ZIP utility but it takes a lot of time when we add individual pdfs by looping through a... (1 Reply)
Discussion started by: tom007
1 Replies

3. UNIX and Linux Applications

Zip command for large folder

I am trying to zip a folder, its size is more than 3 GB. I used below command zip -r foo middleware -x "*path*" This command fails every time with message "Filesize exceeded limit" Can some one help me how to over come this problem and zip the entire folder without splitting it. ... (2 Replies)
Discussion started by: ariram
2 Replies

4. UNIX for Dummies Questions & Answers

Zip a file with .zip extension.

Hi, I need to zip a .dat file with .zip extension. I tried using the "zip" command. But shell says. "ksh: zip: not found" Currently I am using gunzip to zip and changing the extension ".gz" to ".zip" as follows. mv $file `echo $file | sed 's/\(.*\.\)gz/\1zip/'` But when I tried... (1 Reply)
Discussion started by: aeroticman
1 Replies

5. Windows & DOS: Issues & Discussions

Auto download - filename UCC-YYYYMMDD.zip format.

Hi, On a daily basis I have download .zip file from FTP site. Naming convention of .zip is UCC-20100816.zip I want to create windows batch file which will automatically download latest .zip file based on system date. .zip file is gets uploaded on a daily basis on FTP site in... (4 Replies)
Discussion started by: rahulbahulekar
4 Replies

6. Shell Programming and Scripting

Zip Multiple files to One .zip file in AIX system

Hi I have a requirement in unix shell where I need to zip multiple files on server to one single .zip file. I dont see zip command in AIX and gzip command not doing completely what I want. One I do .zip file, I should be able to unzip in my local Computer. Here is example what I want... (9 Replies)
Discussion started by: RAMA PULI
9 Replies

7. Shell Programming and Scripting

Curl download zip extract large xml file

Hi i have a php script that works 100% however i don't want this to run on php because of server limits etc. Ideally if i could convert this simple php script to a shell script i can set it up to run on a cron. My mac server has curl on it. So i am assuming i should be using this to download the... (3 Replies)
Discussion started by: timgolding
3 Replies

8. Solaris

Solaris download website?

Hi I used to download all my Sun Solaris from sunfreeware.com website. But looks like things have changed. Now they want me to pay for it by going to different site. Any one know any website I can download few Solaris packages? I need make and SCCS. ... (3 Replies)
Discussion started by: samnyc
3 Replies

9. UNIX for Beginners Questions & Answers

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (2 Replies)
Discussion started by: b.saipriyanka
2 Replies

10. Shell Programming and Scripting

How can we Zip multiple files created on the same date into one single zip file.?

Hi all i am very new to shell scripting and need some help from you to learn 1)i have some log files that gets generated on daily basis example: i have abc_2017_01_30_1.log ,2017_01_30_2.log like wise so i want to zip this 4 logs which are created on same date into one zip folder. 2)Post zipping... (1 Reply)
Discussion started by: b.saipriyanka
1 Replies
Finance::Quote::IndiaMutual(3pm)			User Contributed Perl Documentation			  Finance::Quote::IndiaMutual(3pm)

NAME
Finance::Quote::IndiaMutual - Obtain Indian mutual fund prices from amfiindia.com SYNOPSIS
use Finance::Quote; $q = Finance::Quote->new; %stockinfo = $q->fetch("indiamutual", "amfiindia-code"); # Can failover to other methods %stockinfo = $q->fetch("amfiindia", "amfiindia-code"); # Use this module only. # NOTE: currently no failover methods exist for indiamutual DESCRIPTION
This module obtains information about Indian Mutual Fund prices from the Association of Mutual Funds India website amfiindia.com. The information source "indiamutual" can be used if the source of prices is irrelevant, and "amfiindia" if you specifically want to use information downloaded from amfiindia.com. AMFIINDIA-CODE In India a mutual fund does not have a unique global symbol identifier. This module uses an id that represents the mutual fund on an id used by amfiindia.com. You can the fund is from the AMFI web site http://amfiindia.com/downloadnavopen.asp. LABELS RETURNED
Information available from amfiindia may include the following labels: method link source name currency nav rprice sprice. The link label will be a url location for the NAV list table for all funds. NOTES
amfiindia.com provides a link to download a text file containing all the NAVs. This file is mirrored in a local file /tmp/amfinavlist.txt. The local mirror serves only as a cache and can be safely removed. Currently NAVs of Open-Ended funds are supported. SEE ALSO
AMFI india website - http://amfiindia.com/ Finance::Quote perl v5.14.2 2012-05-06 Finance::Quote::IndiaMutual(3pm)
All times are GMT -4. The time now is 04:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy