Bash to download specific files and save in two folders
I am trying to download all files from a user authentication, password protected https site, with a particular extension (.bam). The files are ~20GB each and I am not sure if the below is the best way to do it. I am also not sure how to direct the downloaded files to a folder as well as external drive. Thank you .
Code:
while true
do
printf "Files down loading please wait "
wget --http-user cmccabe --http -passwd xxxx*** -r -A "*.bam" -q --show-progress --directory-prefix=C:\Users\cmccabe\Desktop\Example --directory-prefix=E:\WD\files https://test.xxxx.com/xxxxx.aspx
printf "Files downloaded "
done
Last edited by cmccabe; 05-30-2015 at 12:10 PM..
Reason: added line of code
Hi all,
I have a script below which meant to decompress *.tr.gz to allocated folder.
e.g. hello.tar.gz should be decompress to a subdirectory called hello and all the files should be in hello subdirectory.
How do i do it? Am i missing anything?
Condition: there are existing tar.gz in teh... (3 Replies)
Hi All,
I am trying to rsync some of the latest files from remote m/c to my local linux box.
Folder structure in my remote m/c looks like this
/pub/Nightly/Package/ROLL/WIN
/pub/Nightly/Package/SOLL/sol
/pub/Nightly/Package/SOLL/linux
Each of the folder contains gzip files which on daily... (0 Replies)
I want a mechanism to monitor a folder full of files that are sensitive. I want to log all accesses,modifications and changes to any file within the folder in a log file which should give me access/modify/change times,the user id of the process which tried and the pid.
Even some idea of what to... (1 Reply)
Hi,
This evening i would like to download multiple pcap captures files in the wireshark wiki sites. My aim is to download the capture files .pcap .cap and etc on the wireshark site SampleCaptures - The Wireshark Wiki. i already used wget, lynx, htget but still their problem downloading..it seems... (1 Reply)
hi,
i have a requirement to delete all the files from all the directories except some specific directories like archive and log.
for example:
there are following directories such as
A B C D Archive E Log F
which contains some sub directories and files. The requirement is to delete all the... (7 Replies)
The bash below will download all the files in download to /home/Desktop/folder. That works great, but within /home/Desktop/folder there are several folders bam, other, and vcf, is there a way to specify by extention in the download file where to download it to?
For example, all .pdf and .zip... (2 Replies)
I have a directory /home/cmccabe/nfs/exportedReports that contains multiple folders in it. The find writes the name of each folder to out.txt. A new directory is then created in a new location /home/cmccabe/Desktop/NGS/API, named with the date. What I am trying to do, unsuccessfully at the moment,... (7 Replies)
The below bash is trying to list the folders in a specific directory. It seems close but adds the path to the filename, which basename could strip off I think, but not sure why it writes the text file created? This list of folders in the directory will be used later, but needs to only be the... (5 Replies)
Hello, how in bash i can get directory loop, but only choose those folders with specific word in it, so it will only echo those with specific word
#!/bin/bash
for filename in /home/test/*
do
if ; then
echo $filename;
fithx! (4 Replies)
Hi Team,
I am new to the linux commands and I really need help . I would be really thankful if I can get some inputs.
I have below folders in the path "/home/temp"
20170428
20170427
20170429
changes
tempI need to get the files generated in the last 15 mins in all the above folders... (4 Replies)
Discussion started by: JackJinu
4 Replies
LEARN ABOUT DEBIAN
gnunet-directory
gnunet-directory(1) General Commands Manual gnunet-directory(1)NAME
gnunet-directory - display directories
SYNOPSIS
gnunet-directory [OPTIONS] (FILENAME)*
DESCRIPTION
gnunet-directory lists the contents of one or more GNUnet directories. A GNUnet directory is a binary file that contains a list of GNUnet
file-sharing URIs and meta data. The names of the directory files must be passed as command-line arguments to gnunet-directory.
-c FILENAME, --config=FILENAME
configuration file to use (useless option since gnunet-directory does not really depend on any configuration options)
-h, --help
print help page
-L LOGLEVEL, --loglevel=LOGLEVEL
Change the loglevel. Possible values for LOGLEVEL are ERROR, WARNING, INFO and DEBUG.
-v, --version
print the version number
NOTES
A GNUnet directory is a file containing a list of GNUnet URIs and meta data. The keys can point to files, other directories or files in
namespaces. In other words, a GNUnet directory is similar to UNIX directories. The difference to tar and zip is that GNUnet directory
does not contain the actual files (except if they are really small, in which case they may be inlined), just symbolic (links), similar to
directories with symbolic links in UNIX filesystems. The benefit is that the individual files can be retrieved separately (if desired) and
if some of the files are inserted to another node in GNUnet, this just increases their availability but does not produce useless duplicates
(for example, it is a better idea to publish a collection of pictures or compressed sound files using a GNUnet directory instead of pro-
cessing them with archivers such as tar or zip first). Directories can contain arbitrary meta data for each file.
If a directory has missing blocks (for example, some blocks failed to download), GNUnet is typically able to retrieve information about
other files in the directory. Files in a GNUnet directory have no particular order; the GNUnet code that generates a directory can reorder
the entries in order to better fit the information about files into blocks of 32k. Respecting 32k boundaries where possible makes it eas-
ier for gnunet-directory (and other tools) to recover information from partially downloaded directory files.
At the moment, directories can be created by gnunet-fs-gtk and gnunet-publish. Just like ordinary files, a directory can be published in a
namespace.
GNUnet directories use the (unregistered) mimetype application/gnunet-directory. They can show up among normal search results. The direc-
tory file can be downloaded to disk by gnunet-download(1) for later processing or be handled more directly by gnunet-fs-gtk(1).
REPORTING BUGS
Report bugs by using mantis <https://gnunet.org/bugs/> or by sending electronic mail to <gnunet-developers@gnu.org>
SEE ALSO gnunet-fs-gtk(1), gnunet-publish(1), gnunet-search(1), gnunet-download(1)GNUnet 25 Feb 2012 gnunet-directory(1)
05-30-2015
.