Bash to download specific files and save in two folders

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Find files in specific folders

Hi Team, I am new to the linux commands and I really need help . I would be really thankful if I can get some inputs. I have below folders in the path "/home/temp" 20170428 20170427 20170429 changes tempI need to get the files generated in the last 15 mins in all the above folders...

2. Shell Programming and Scripting

Bash directory loop, but only choose those folders with specific word in it

Hello, how in bash i can get directory loop, but only choose those folders with specific word in it, so it will only echo those with specific word #!/bin/bash for filename in /home/test/* do if ; then echo $filename; fithx!

3. Shell Programming and Scripting

Bash to list all folders in a specific directory

The below bash is trying to list the folders in a specific directory. It seems close but adds the path to the filename, which basename could strip off I think, but not sure why it writes the text file created? This list of folders in the directory will be used later, but needs to only be the...

4. Shell Programming and Scripting

Bash to move specific files from folders in find file

I have a directory /home/cmccabe/nfs/exportedReports that contains multiple folders in it. The find writes the name of each folder to out.txt. A new directory is then created in a new location /home/cmccabe/Desktop/NGS/API, named with the date. What I am trying to do, unsuccessfully at the moment,...

5. Shell Programming and Scripting

Bash to tell download where specific files are stored

The bash below will download all the files in download to /home/Desktop/folder. That works great, but within /home/Desktop/folder there are several folders bam, other, and vcf, is there a way to specify by extention in the download file where to download it to? For example, all .pdf and .zip...

6. Shell Programming and Scripting

How to delete all the files and folders inside all the directories except some specific directory?

hi, i have a requirement to delete all the files from all the directories except some specific directories like archive and log. for example: there are following directories such as A B C D Archive E Log F which contains some sub directories and files. The requirement is to delete all the...

7. Shell Programming and Scripting

FAQ how to download multiple specific files via command line

Hi, This evening i would like to download multiple pcap captures files in the wireshark wiki sites. My aim is to download the capture files .pcap .cap and etc on the wireshark site SampleCaptures - The Wireshark Wiki. i already used wget, lynx, htget but still their problem downloading..it seems...

8. UNIX for Dummies Questions & Answers

Monitoring specific files and folders

I want a mechanism to monitor a folder full of files that are sensitive. I want to log all accesses,modifications and changes to any file within the folder in a log file which should give me access/modify/change times,the user id of the process which tried and the pid. Even some idea of what to...

9. Shell Programming and Scripting

Copying specific files from remote m/c to specific folders

Hi All, I am trying to rsync some of the latest files from remote m/c to my local linux box. Folder structure in my remote m/c looks like this /pub/Nightly/Package/ROLL/WIN /pub/Nightly/Package/SOLL/sol /pub/Nightly/Package/SOLL/linux Each of the folder contains gzip files which on daily...

10. Shell Programming and Scripting

decompressed files to specific folders

Hi all, I have a script below which meant to decompress *.tr.gz to allocated folder. e.g. hello.tar.gz should be decompress to a subdirectory called hello and all the files should be in hello subdirectory. How do i do it? Am i missing anything? Condition: there are existing tar.gz in teh...

LEARN ABOUT OSX

lwp-download5.16

LWP-DOWNLOAD(1) 					User Contributed Perl Documentation					   LWP-DOWNLOAD(1)

NAME

       lwp-download - Fetch large files from the web

SYNOPSIS

       lwp-download [-a] [-s] <url> [<local path>]

DESCRIPTION

       The lwp-download program will save the file at url to a local file.

       If local path is not specified, then the current directory is assumed.

       If local path is a directory, then the last segment of the path of the url is appended to form a local filename.  If the url path ends with
       slash the name "index" is used.	With the -s option pick up the last segment of the filename from server provided sources like the Content-
       Disposition header or any redirect URLs.  A file extension to match the server reported Content-Type might also be appended.  If a file
       with the produced filename already exists, then lwp-download will prompt before it overwrites and will fail if its standard input is not a
       terminal.  This form of invocation will also fail is no acceptable filename can be derived from the sources mentioned above.

       If local path is not a directory, then it is simply used as the path to save into.  If the file already exists it's overwritten.

       The lwp-download program is implemented using the libwww-perl library.  It is better suited to down load big files than the lwp-request
       program because it does not store the file in memory.  Another benefit is that it will keep you updated about its progress and that you
       don't have much options to worry about.

       Use the "-a" option to save the file in text (ascii) mode.  Might make a difference on dosish systems.

EXAMPLE

       Fetch the newest and greatest perl version:

	$ lwp-download http://www.perl.com/CPAN/src/latest.tar.gz
	Saving to 'latest.tar.gz'...
	11.4 MB received in 8 seconds (1.43 MB/sec)

AUTHOR

       Gisle Aas <gisle@aas.no>

perl v5.16.2							    2012-01-13							   LWP-DOWNLOAD(1)

Shell Programming and Scripting