Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extracting data from https server with the help of unix shell script
Top Forums Shell Programming and Scripting Extracting data from https server with the help of unix shell script Post 302383886 by m1xram on Friday 1st of January 2010 03:05:11 PM
Old 01-01-2010
wget
Code:
wget --user=user --password=password "URL/EXCEL_FILE"

That will work with basic HTTP folder authentication but not with a form login. Post the URL and I can be more specific.

If there are a bunch of files and you know their names make a loop...
Code:
#!/bin/bash
url="SOME_URL"
user="username"
pass="getinthere"
for xlsfile in "file1.xls" "file2.xls" ; do
  echo "Retrieving $xlsfile"
  wget --user=$user --password=$pass "$url/$xlsfile"
done

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to extract data using UNIX shell script?

Hello All, I am starting with UNIX. Any help is highly appreciated. How to extract data using UNIX shell script? And how do you export data using UNIX shell scripts into Microsoft Excel format? Thank you. (3 Replies)
Discussion started by: desiondarun
3 Replies

2. Shell Programming and Scripting

urgent-extracting block data from flat file using shell script

Hi, I want to extract block of data from flat file. the data will be like this start of log One two three end of log i want all data between start of log to end of log i.e One two three to be copied to another file. This particular block may appear multiple times in same file. I... (4 Replies)
Discussion started by: shirish_cd
4 Replies

3. Shell Programming and Scripting

Extracting data from a shell output?

Hi all, I use a sh script to run few commands on CentOS 5.2. My goal is to search into test output for specific content and save it into a database table. So far everything is simple, except that I do not know how to grab the specific values: #!/bin/sh # Source function library. .... (13 Replies)
Discussion started by: TECK
13 Replies

4. Shell Programming and Scripting

Connecting to multiple unix server from unix server using shell script

Hi Gurus, I'm a unix newbie and I would like to connect to multiple unix servers from unix server using shell script i.e from server a to server b,c,d etc. I want to copy the files from unix server a to server b, c, d. I can access staright using ssh without the need to have password and user... (5 Replies)
Discussion started by: sexyTrojan
5 Replies

5. Shell Programming and Scripting

Extracting LONG Data Type from DB via UNIX Script

Hi, I want to extract a XML file which is stored in the database having a data Type as "LONG" via UNIX Scripting. But when i am triggering the SQL via UNIX it is fetching only the first Line and not the complete XML. Can you please suggest if the parameters that i have used needs any... (0 Replies)
Discussion started by: dear_abhi2007
0 Replies

6. Shell Programming and Scripting

curl script to download files from Secured HTTPS server?

curl -# -v -d "sendusername=myname&password=mypassword&wheretogo=download.php" -L -o test.zip http://www.ims-dm.com/cgi/securedownload.php?p=HIREFTPM\&prodtype=hire/test.zip * About to connect() to www.ims-dm.com port 80 * Trying 209.61.193.139... connected * Connected to www.ims-dm.com... (1 Reply)
Discussion started by: laknar
1 Replies

7. Shell Programming and Scripting

FTP from windows to unix server using unix shell script

Hi, Is it possible to ftp a huge zip file from windows to unix server using unix shell scripting? If so what command i need to use. thanks in advance. (1 Reply)
Discussion started by: Shri123
1 Replies

8. UNIX for Dummies Questions & Answers

TWO QUESTIONS...How to create your own command in UNIX server,How to enter data in a file by script

I am a quite newbie on UNIX SCRIPTING...Please help me solving this two questions... 1st Question; I want to create one command that will run a script when anyone use that command on that server... I mean, in the prompt if I put my name 'Rony' it will execute a script called 'rony.sh'. How can... (1 Reply)
Discussion started by: Rony-123
1 Replies

9. Shell Programming and Scripting

How can i run sql queries from UNIX shell script and retrieve data into text docs of UNIX?

Please share the doc asap as very urgently required. (1 Reply)
Discussion started by: 24ajay
1 Replies

10. Shell Programming and Scripting

Extracting LONG Data Type from DB via UNIX Script

Hi, I want to extract a XML file which is stored in the database having a data Type as "LONG" via UNIX Scripting. But when i am triggering the SQL via UNIX it is fetching only the first Line and not the complete XML. Can you please suggest if the parameters that i have used needs any... (2 Replies)
Discussion started by: Barbara1234
2 Replies

LEARN ABOUT MOJAVE

httppower

httppower(8)							     powerman							      httppower(8)

NAME

       httppower - communicate with HTTP based power distribution units

SYNOPSIS

       httppower [--url URL]

DESCRIPTION

       httppower  is  a  helper program for powerman which enables it to communicate with HTTP based power distribution units.	It is run interac-
       tively by the powerman daemon.

OPTIONS

       -u, --url URL
	      Set the base URL.

INTERACTIVE COMMANDS

       The following commands are accepted at the httppower> prompt:

       auth user:pass
	      Authenticate to the base URL with specified user and password, using ``basic'' HTTP authentication which sends the user and password
	      over the network in plain text.

       seturl URL
	      Set the base URL.  Overrides the command line option.

       get [URL-suffix]
	      Send an HTTP GET to the base URL with the optional URL-suffix appended.

       post [URL-suffix] key=val[&key=val]...
	      Send an HTTP POST to the base URL with the optional URL-suffix appended, and key-value pairs as argument.

FILES

       /usr/sbin/httppower
       /etc/powerman/powerman.conf

ORIGIN

       PowerMan was originally developed by Andrew Uselton on LLNL's Linux clusters.  This software is open source and distributed under the terms
       of the GNU GPL.

SEE ALSO

       powerman(1), powermand(8), httppower(8), plmpower(8), vpcd(8), powerman.conf(5), powerman.dev(5), powerman-devices(7).

       http://sourceforge.net/projects/powerman

powerman-2.3.5							    2009-02-09							      httppower(8)
All times are GMT -4. The time now is 01:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy