Bash to download specific files and save in two folders
I am trying to download all files from a user authentication, password protected https site, with a particular extension (.bam). The files are ~20GB each and I am not sure if the below is the best way to do it. I am also not sure how to direct the downloaded files to a folder as well as external drive. Thank you .
Last edited by cmccabe; 05-30-2015 at 12:10 PM..
Reason: added line of code
Hi all,
I have a script below which meant to decompress *.tr.gz to allocated folder.
e.g. hello.tar.gz should be decompress to a subdirectory called hello and all the files should be in hello subdirectory.
How do i do it? Am i missing anything?
Condition: there are existing tar.gz in teh... (3 Replies)
Hi All,
I am trying to rsync some of the latest files from remote m/c to my local linux box.
Folder structure in my remote m/c looks like this
/pub/Nightly/Package/ROLL/WIN
/pub/Nightly/Package/SOLL/sol
/pub/Nightly/Package/SOLL/linux
Each of the folder contains gzip files which on daily... (0 Replies)
I want a mechanism to monitor a folder full of files that are sensitive. I want to log all accesses,modifications and changes to any file within the folder in a log file which should give me access/modify/change times,the user id of the process which tried and the pid.
Even some idea of what to... (1 Reply)
Hi,
This evening i would like to download multiple pcap captures files in the wireshark wiki sites. My aim is to download the capture files .pcap .cap and etc on the wireshark site SampleCaptures - The Wireshark Wiki. i already used wget, lynx, htget but still their problem downloading..it seems... (1 Reply)
hi,
i have a requirement to delete all the files from all the directories except some specific directories like archive and log.
for example:
there are following directories such as
A B C D Archive E Log F
which contains some sub directories and files. The requirement is to delete all the... (7 Replies)
The bash below will download all the files in download to /home/Desktop/folder. That works great, but within /home/Desktop/folder there are several folders bam, other, and vcf, is there a way to specify by extention in the download file where to download it to?
For example, all .pdf and .zip... (2 Replies)
I have a directory /home/cmccabe/nfs/exportedReports that contains multiple folders in it. The find writes the name of each folder to out.txt. A new directory is then created in a new location /home/cmccabe/Desktop/NGS/API, named with the date. What I am trying to do, unsuccessfully at the moment,... (7 Replies)
The below bash is trying to list the folders in a specific directory. It seems close but adds the path to the filename, which basename could strip off I think, but not sure why it writes the text file created? This list of folders in the directory will be used later, but needs to only be the... (5 Replies)
Hello, how in bash i can get directory loop, but only choose those folders with specific word in it, so it will only echo those with specific word
#!/bin/bash
for filename in /home/test/*
do
if ; then
echo $filename;
fithx! (4 Replies)
Hi Team,
I am new to the linux commands and I really need help . I would be really thankful if I can get some inputs.
I have below folders in the path "/home/temp"
20170428
20170427
20170429
changes
tempI need to get the files generated in the last 15 mins in all the above folders... (4 Replies)
Discussion started by: JackJinu
4 Replies
LEARN ABOUT CENTOS
spectool
SPECTOOL(1) User Commands SPECTOOL(1)NAME
spectool - manual page for spectool v1.0.10rpmdev1
SYNOPSIS
spectool [<options>] <specfile>
DESCRIPTION
Spectool is a tool to expand and download sources and patches from specfiles.
If you experience problems with specific specfiles, try to run
rpmbuild --nobuild --nodeps <specfile>
on the file which might give a clue why spectool fails on a file (ignore anything about missing sources or patches). The plan is to catch
errors like this in spectool itself and warn the user about it in the future.
OPTIONS
Operating mode:
-l, --lf, --list-files
lists the expanded sources/patches (default)
-g, --gf, --get-files
gets the sources/patches that are listed with a URL
-h, --help
display this help screen
Files on which to operate:
-A, --all
all files, sources and patches (default)
-S, --sources
all sources
-P, --patches
all patches
-s, --source x[,y[,...]]
specified sources
-p, --patch a[,b[,...]]
specified patches
Miscellaneous:
-d, --define 'macro value'
defines RPM macro 'macro' to be 'value'
-C, --directory dir
download into specified directory (default '.')
-R, --sourcedir
download into rpm's %{_sourcedir}
-n, --dryrun, --dry-run
don't download anything, just show what would be done
-f, --force
try to unlink and download if target files exist
-D, --debug
output debug info, don't clean up when done
FILES
/etc/rpmdevtools/curlrc
optional curl(1) configuration
spectool v1.0.10rpmdev1 June 2014 SPECTOOL(1)