pass curls progress/status data to a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting pass curls progress/status data to a file
# 1  
Old 05-31-2008
pass curls progress/status data to a file

hello hackers again. please help me out once again.

i have a script which executes CURL to fetch a file from the web and instantly outputs the files content to STDOUT.

now my question -

can i somehow write the progress-status to a file?

so that curl acts silently (-s) and only puts fetched files content on STDOUT and the progress-data is put into a file which i can then parse with a seperate script?

i only found the --trace and --trace-ascii options which produce very big output, that is too much too handle.

maybe one of the pro´s here has a solution.

thanks in advance.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Pass some data from csv to xml file using shell/python

Hello gurus, I have a csv file with bunch of datas in each column. (see attached) Now I have an .xml file in the structure of below: ?xml version="1.0" ?> <component id="root" name="root"> <component id="system" name="system"> <param name="number_of_A" value="8"/> ... (5 Replies)
Discussion started by: Zam_1234
5 Replies

2. Shell Programming and Scripting

How i can obtain differents data on a single pass?

#!/bin/bash for i in `ls -c1 /usr/share/applications` do #name=`cat /usr/share/applications/$i | grep ^Name= | cut -d = -f2` #categories=`cat /usr/share/applications/$i | grep ^Categories= | sed 's/;/=/g' | cut -d = -f2` name=$(grep ^Name= /usr/share/applications/$i | cut -d = -f2)... (12 Replies)
Discussion started by: alexscript
12 Replies

3. Shell Programming and Scripting

Show status of progress?

So, What is the best method, if even possible, to display a percentage or a status or progress of a certain command? For example I am forcing a block copy of a an OS image from one machine to another via a shell script and would like for it to display a progress or status so I know if it is... (3 Replies)
Discussion started by: tlarkin
3 Replies

4. Shell Programming and Scripting

Progress bar while coping a file needed.

Hi guys I want to create a script which will show the amount of data that is been copied from one location to another location. For example: Say i have a file called abc.img which is approximately 4 gb of size therfore everytime i copy the file from one location to another i want a progress bar... (3 Replies)
Discussion started by: pinga123
3 Replies

5. Web Development

how to pass data in webrick sevelts? please help

Hi all, I am a newbie to servlet programming using webrick... Was wondering how to accept data from a form and do necessary processing.. To start with i wrote a sample servlet that accepts a name and prints "welcome <name>" But I do not know how to take this value from the form into the... (0 Replies)
Discussion started by: wrapster
0 Replies

6. Programming

Libcurl - Progress Data

Hi, I codding a download manager,use libcurl library.i can download any file easily.But i want to show file detail in console.Some of them, File Size Percent Left Time Libcurl has some functions to use,but there isnt good documentation to understand them. i cant find any example to... (2 Replies)
Discussion started by: canerbulut
2 Replies

7. UNIX for Dummies Questions & Answers

Help analysing progress of a log file

Is it possible to track the progress of a job (informatica) by analysing the progress of it's log file ? I have a long running job, and no way of tracking how far allong it is. Thanks. (4 Replies)
Discussion started by: cosmos328is
4 Replies

8. UNIX for Advanced & Expert Users

knowing progress while reading a file

Hi, I am parsing a very big file say 10 MB. It 'll take more than an hour ..I want to know the progress say in % .Is there any way to do that??? or (Is there any way to know which line of the file I am in ) (2 Replies)
Discussion started by: sakthi.abdullah
2 Replies

9. Shell Programming and Scripting

Display Progress Status

Hi , I want to automate the Disk-Mirroring on Solaris. After the sync is started, I can watch the progress with sunos # metastat | grep done | cut -d ":" -f 2 | cut -d "%" -f 1 which results in a % value How can I display some like Synchronisation in progress :... (2 Replies)
Discussion started by: networkfre@k
2 Replies

10. UNIX for Dummies Questions & Answers

Couldn't open status file /var/samba/STATUS.LCK

I believe i have most of samba configured right but i get this error each time time try to run it. I was given suggestion that i touch the file, i did, but i still cannot rid myself of this error. Any suggestions (2 Replies)
Discussion started by: macdonto
2 Replies
Login or Register to Ask a Question
CURLOPT_IGNORE_CONTENT_LENGTH(3)			     curl_easy_setopt options				  CURLOPT_IGNORE_CONTENT_LENGTH(3)

NAME
CURLOPT_IGNORE_CONTENT_LENGTH - ignore content length SYNOPSIS
#include <curl/curl.h> CURLcode curl_easy_setopt(CURL *handle, CURLOPT_IGNORE_CONTENT_LENGTH, long ignore); DESCRIPTION
If ignore is set to 1L, ignore the Content-Length header in the HTTP response and ignore asking for or relying on it for FTP transfers. This is useful for HTTP with Apache 1.x (and similar servers) which will report incorrect content length for files over 2 gigabytes. If this option is used, curl will not be able to accurately report progress, and will simply stop the download when the server ends the con- nection. It is also useful with FTP when for example the file is growing while the transfer is in progress which otherwise will unconditionally cause libcurl to report error. Only use this option if strictly necessary. DEFAULT
0 PROTOCOLS
HTTP EXAMPLE
CURL *curl = curl_easy_init(); if(curl) { curl_easy_setopt(curl, CURLOPT_URL, "http://example.com"); /* we know the server is silly, ignore content-length */ curl_easy_setopt(curl, CURLOPT_IGNORE_CONTENT_LENGTH, 1L); curl_easy_perform(curl); } AVAILABILITY
Added in 7.14.1. Support for FTP added in 7.46.0. RETURN VALUE
Returns CURLE_OK if the option is supported, and CURLE_UNKNOWN_OPTION if not. SEE ALSO
CURLOPT_HTTP_VERSION(3), CURLOPT_MAXFILESIZE_LARGE(3), libcurl 7.54.0 February 03, 2016 CURLOPT_IGNORE_CONTENT_LENGTH(3)