Csv download in a bash script Post: 302975743

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Automatic download of csv file using a shell script

I want to automatically download a CSV file daily which can be found here: http://www.londonstockexchange.com/en-gb/pricesnews/prices/coveredwarrants/search.htm and the link is named "Click to download covered warrants (100Kb)" onthe right hand side. What commands can I use to invoke clicking...

2. Shell Programming and Scripting

Need to modify csv-file with bash script

Hi Guys, I need to write a script, that exports the "moz_places" table of the "places.sqlite"-file (firefox browser history) into a csv-file. That part works. After the export, my csv looks like this: ... 4429;http://www.sqlite.org/sqlite.html;"Command Line Shell For...

3. UNIX for Advanced & Expert Users

Unix Bash: substitute columns in .csv using other .csv columns

Hi All, I have two .csv's input.csv having values as (7 columns) ABC,A19907103,ABC DEV YUNG,2.17,1000,2157,07/07/2006 XYZ,H00213850,MM TRUP HILL,38.38,580,23308,31/08/2010 output.csv having (25 columns) A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y...

4. Shell Programming and Scripting

Bash script to reorder csv

hi guys, im fairly new to unix and bash scripts and therefore your help would really be appreciated. i need to write a bash script that will take a csv file, and reorder the data and output to another csv file. The source csv file will look something like this: HEAD,671061,Add,SS...

5. Shell Programming and Scripting

BASH script to parse XML and generate CSV

Hi All, Hope all you are doing good! Need your help. I have an XML file which needs to be converted CSV file. I am not an expert of awk/sed so your help is highly appreciated!! XML file looks like this: <l:event dateTime="2013-03-13 07:15:54.713" layerName="OSB" processName="ABC"...

6. Shell Programming and Scripting

Bash script help - removing certain rows from .csv file

Hello Everyone, I am trying to find a way to take a .csv file with 7 columns and a ton of rows (over 600,000) and remove the entire row if the cell in forth column is blank. Just to give you a little background on why I am doing this (just in case there is an easier way), I am pulling...

7. Shell Programming and Scripting

Bash to download specific files and save in two folders

I am trying to download all files from a user authentication, password protected https site, with a particular extension (.bam). The files are ~20GB each and I am not sure if the below is the best way to do it. I am also not sure how to direct the downloaded files to a folder as well as external...

8. Ubuntu

Bash script for FTP download -Mysql

Hi guys, I recently managed to write up my working script, but now I have a problem. If the file isn't there in the remote server, my actual script jumps it and all ok, but I need something like this: Search file -> if there, then download -> if not, download next file in the list. Any...

9. Shell Programming and Scripting

Bash to tell download where specific files are stored

The bash below will download all the files in download to /home/Desktop/folder. That works great, but within /home/Desktop/folder there are several folders bam, other, and vcf, is there a way to specify by extention in the download file where to download it to? For example, all .pdf and .zip...

10. Shell Programming and Scripting

Curl , download file with user:pass in bash script

Hello, My question is about curl command. (ubuntu14.04) In terminal, I am able to download my mainfile with: curl -u user1:pass1 http://11.22.33.44/******* When I convert it into bash script like this: #!/bin/bash cd /root/scripts computer_ip=11.22.33.44 curl -u $1:$2...

LEARN ABOUT CENTOS

uri::url

URI::URL(3)						User Contributed Perl Documentation					       URI::URL(3)

NAME

       URI::URL - Uniform Resource Locators

SYNOPSIS

	$u1 = URI::URL->new($str, $base);
	$u2 = $u1->abs;

DESCRIPTION

       This module is provided for backwards compatibility with modules that depend on the interface provided by the "URI::URL" class that used to
       be distributed with the libwww-perl library.

       The following differences exist compared to the "URI" class interface:

       o  The URI::URL module exports the url() function as an alternate constructor interface.

       o  The constructor takes an optional $base argument.  The "URI::URL" class is a subclass of "URI::WithBase".

       o  The URI::URL->newlocal class method is the same as URI::file->new_abs.

       o  URI::URL::strict(1)

       o  $url->print_on method

       o  $url->crack method

       o  $url->full_path: same as ($uri->abs_path || "/")

       o  $url->netloc: same as $uri->authority

       o  $url->epath, $url->equery: same as $uri->path, $uri->query

       o  $url->path and $url->query pass unescaped strings.

       o  $url->path_components: same as $uri->path_segments (if you don't consider path segment parameters)

       o  $url->params and $url->eparams methods

       o  $url->base method.  See URI::WithBase.

       o  $url->abs and $url->rel have an optional $base argument.  See URI::WithBase.

       o  $url->frag: same as $uri->fragment

       o  $url->keywords: same as $uri->query_keywords

       o  $url->localpath and friends map to $uri->file.

       o  $url->address and $url->encoded822addr: same as $uri->to for mailto URI

       o  $url->groupart method for news URI

       o  $url->article: same as $uri->message

SEE ALSO

       URI, URI::WithBase

COPYRIGHT

       Copyright 1998-2000 Gisle Aas.

perl v5.16.3							    2012-02-11							       URI::URL(3)