Sponsored Content
Top Forums Shell Programming and Scripting Bash script idea using cUrl -- possible? Post 302399222 by SilversleevesX on Friday 26th of February 2010 06:09:58 PM
Old 02-26-2010
Bash script idea using cUrl -- possible?

I have an alias already in my .bash_profile to download files using cUrl's -o (output to file, user provides the file name) option. I find I'm using it quite a bit, so I wanted to write a script to run "curl -o", taking the necessary inputs - file name and URL from which to download - and then returning to a "parked" state like some python scripts I've seen do, ready to take in another filename and URL. The script should also, on reading a 'buzzword' (not "quit" -- that's too literal and it might be confused by the shell), put up one last echo and exit as normal.

Then my imagination kicked in and I started to wonder, also, if it wouldn't be possible to have the script log its own activity to an external file as soon as a download is complete, naming the file with the date and time created along with its own name or some generic 'tag' such as "curldl-activity-021810-223516H.txt", and keep logging to the same file until the exit word or phrase was entered.

I have a pretty firm idea of how to write the part of the script that takes in the name and URL and invokes cUrl to do the downloading. That would probably best be handled in a function, I'm thinking. I'm a bit sketchy on setting the conditional for an exit buzzword, and while I've written scripts and executed commands to send data to outside files, where to put such a command in this script is something I'm sure I've learned somewhere but can't recall, at any rate.

So again, here's me picking the brains of the gurus and asking for advice.

BZT
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Limitations of awk? Good idea? Bad idea?

Keeping in mind that I'm relatively comfortable with programming in general but very new to unix and korn/bourne shell scripts.. I'm using awk on a CSV file, and then performing calculations and operations on specific fields within specific records. The CSV file I'm working with has about 600... (2 Replies)
Discussion started by: yongho
2 Replies

2. Shell Programming and Scripting

Idea for an "informative" bash alias or script

I had the idea come into my head that it would be good to have a single command that gave file type, file size, last modification date, and owner/group information, like what one would see in a GUI "Properties" dialog, but all in a terminal window. In my opinion, these statistics about a file... (5 Replies)
Discussion started by: SilversleevesX
5 Replies

3. Shell Programming and Scripting

bash curl escape & in url

I'm running a curl command in bash, but the & in the middle causes the second half of the line to run in the background, here's what I'm trying to do: lat="37.451" lon="-122.18" url="http://ws.geonames.org/findNearestAddress?lat=$lat&lng=$lon" curl -s "$url" I tried escaping the & with \&,... (4 Replies)
Discussion started by: unclecameron
4 Replies

4. Shell Programming and Scripting

Sending awk variables into curl in a bash script

Hello experts! I have a file1 with the following format (yr,day, month, hour,minute): 201201132435 201202141210 201304132030 201410100110 ... What i want to do is to assign variables and then use them in the curl command to download the text of each event from a web page. What I have... (6 Replies)
Discussion started by: phaethon
6 Replies

5. Shell Programming and Scripting

Curl won't complete in a script but does from prompt. Idea?

On RHEL5 from within both a shell (sh->bash) and a csh script curl fails with a "curl: (6) Couldn't resolve host 'application'" error. This is the result whether run as a command at the shell and/or c-shell prompt and curl also fails with the same error when the scripts are "source'd" at the... (5 Replies)
Discussion started by: GSalisbury
5 Replies

6. Shell Programming and Scripting

Curl/http 503 error with bash script

I am trying to use REST API and curl in a bash script to generate a http report. The curl command at the end of the script should generate a html file but instead I get an error "HTTP/1.1 503 Service Unavailable". This is the script #!/bin/bash export... (7 Replies)
Discussion started by: kieranfoley
7 Replies

7. Shell Programming and Scripting

Using curl in bash script

Hello. I have pick up a script from internet to track errors from curl command. #!/bin/bash # URL_TO_TEST="http://www.xxxxxx.yyy" MY_VAR=curl_init("$URL_TO_TEST") ; curl_setopt($MY_VAR, CURLOPT_HEADER, 1); curl_setopt($MY_VAR, CURLOPT_RETURNTRANSFER, 1); curl_setopt($MY_VAR,... (2 Replies)
Discussion started by: jcdole
2 Replies

8. Shell Programming and Scripting

Access a complete flow with CURL + bash shell

Hello Experts , I have an use case which needed your help . I have been using google for 2 days buy couldn`t succed , i believe i can get the help here. Here is my use case to run on bash shell 1. Access an URL -- in script , it will be mentioned as inputURL 2. Once i accessed the URL... (1 Reply)
Discussion started by: radha254
1 Replies

9. Shell Programming and Scripting

Curl , download file with user:pass in bash script

Hello, My question is about curl command. (ubuntu14.04) In terminal, I am able to download my mainfile with: curl -u user1:pass1 http://11.22.33.44/******* When I convert it into bash script like this: #!/bin/bash cd /root/scripts computer_ip=11.22.33.44 curl -u $1:$2... (8 Replies)
Discussion started by: baris35
8 Replies
DIFFINDEX-DOWNLOAD(1)													     DIFFINDEX-DOWNLOAD(1)

NAME
diffindex-download - Download utility for Debian Contents files SYNOPSIS
diffindex-download [ options ] URL filename DESCRIPTION
diffindex-download is a command line tool for downloading Contents files. It uses APT's diff/Index format patches when available to avoid downloading the full file. diffindex-download is used by apt-file. OPTIONS
-n number If more than number patches would be necessary, download the whole file. Specifying 0 to always download the whole file is possible. -k Don't verify the peer certificate when using https. -c cacert If cacert is a directory: Use cacert as CA certificate path. Otherwise use cacert as CA certificate bundle. See the --capath and --cacert options in the curl(1) man page. -i Don't exit with errror if the URL does not exist. This is useful as some archives don't provide Contents files. -q Be quiet (opposite of -v). The default if stdout is not a terminal. -v Be verbose (opposite of -q). The default if stdout is a terminal. -d Print additional debug info. -h Display a short help screen. SEE ALSO
apt-file(1), diffindex-rred(1), curl(1) AUTHOR
diffindex-download was written by Stefan Fritsch <sf@debian.org>. January 2009 DIFFINDEX-DOWNLOAD(1)
All times are GMT -4. The time now is 10:21 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy