Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Move groups of files
Top Forums Shell Programming and Scripting Move groups of files Post 302717229 by Dan_S on Wednesday 17th of October 2012 06:02:27 PM
Old 10-17-2012
Brilliant! That works, thanks heaps.

I only had to change a couple of things (because I wasn't specific enough in my question!), there were actually files other than the images in the RawData folder, I only wanted the images though, and also I didn't need to keep the folder structure intact, I just wanted to dump all images in to a single folder (as the processing software we use is retarded, it can only process 1 folder at a time). Also I forgot I had directories in the experiment folder that had RawData subfolders and images in them that I didn't want to copy, but luckily the folders are arranged by date, so I just modified it to this and it works perfectly...

Code:
#!/bin/bash
start=14
end=27
sz=30
cd <experiment folder>
mkdir sorted_files
for dir in $(find 10162012_3d* -type d -name RawData)
do
        b=0
        for file in $(find $dir/*.LA.TIF -type f -print)
        do
           let b=b+1
           if [ $b -ge $start -a $b -le $end ]
           then
               mv $file sorted_files
           fi
           [ $b -ge $sz ] && b=0
        done
done

Thanks for that, I would have struggled for many hours with the syntax since I'm only just learning bash scripting.

That script took 5 minutes per experiment to move all the files (running in cygwin) compared to the MATLAB script which took over an hour per experiment.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to check files and move the results to differents files?

Hi, I am a newbie to shell scripting. here is my objective: 1)The shell program should take 2 parameters - ie-> DestinationFolder, WebFolder 2)Destination folder contains few files that has to has be verified and deleted. 3)WebFolder is a folder containing a list of master files 4)It... (1 Reply)
Discussion started by: sandhyagupta
1 Replies

2. Shell Programming and Scripting

To write a shell script which groups files with certain pattern, create a tar and zip

Hi Guru's, I have to write a shell script which groups file names based upon the certain matching string pattern, then creates the Tar file for that particular group of files and then zips the Tar file created for the respective group of files. For example, In the given directory these files... (3 Replies)
Discussion started by: rahu_sg
3 Replies

3. Shell Programming and Scripting

to find the last updated file from different groups of files.

Hi i have many sets of files as shown below(here i have shown 2 sets) basel_aa_20091030.txt basel_aa_20091130.txt basel_aa_20091230.txt basel_bb_20091030.txt basel_bb_20091130.txt basel_bb_20091230.txt from each set of files i need to select the latest updated file(there are... (3 Replies)
Discussion started by: jagadeeshn04
3 Replies

4. Shell Programming and Scripting

multiple groups of files processing

I have five directories, dir1 to dir5 for each directory, I have all same number-named folders. There are four types of folders, {1..10}, {20..30}, { 40..50}, {60..70} Now for each types of folder, I will do the same thing, here is the code for i in {1..5} do cd dir$i mkdir temp1 for... (5 Replies)
Discussion started by: ksgreen
5 Replies

5. UNIX for Dummies Questions & Answers

Move same files and issue ls -al command on remaining files

I know I can use an ls -l junk1 command to get a listing of all files in the directory junk1, but I was wondering how I'd go about going through the files in junk1 in a for-in loop and issuing the ls -l command on them one by one. This is what I have so far: for file in $(ls -a $1) do ls... (1 Reply)
Discussion started by: Trinimini
1 Replies

6. UNIX for Dummies Questions & Answers

Merge files into groups of 10000

Hi Guys, First post! I've seen a few options but dont know the most efficient: I have a directory with a 150,000+ text files in it I want to merge them into files contain 10,000 files with a carriage return in between. Thanks P The following is an example but doesnt limit the... (2 Replies)
Discussion started by: peh
2 Replies

7. Shell Programming and Scripting

Urgent...Need a shell script to list files which belong to particular groups

Hi, I am just new to scripting but got to write a complex scipt please help. i need a shell script which can check the list of data listed in a txt doc and see if they belong to any of the groups that are listed in other list file.... (5 Replies)
Discussion started by: draghun9
5 Replies

8. Shell Programming and Scripting

Move all files except sys date (today) files in Solaris 10

I want to move all files from one directory to another directory excluding today (sysdate files) on daily basis. file name is in pattern file_2013031801, file_2013031802 etc (2 Replies)
Discussion started by: khattak
2 Replies

9. Shell Programming and Scripting

SBATCH trinity for multiple files and rename/move the output files

Hey guys, I have wrote the following script to apply a module named "trinity" on my files. (it takes two input files and spit a trinity.fasta as output) #!/bin/bash -l #SBATCH -p node #SBATCH -A <projectID> #SBATCH -n 16 #SBATCH -t 7-00:00:00 #SBATCH --mem=128GB #SBATCH --mail-type=ALL... (1 Reply)
Discussion started by: @man
1 Replies

10. Shell Programming and Scripting

Rearrange groups of lines from several files

I have three files as an input and I need to rearrange this input to match the rules by which the processing program consumes the data. My files are: /tmp$ cat F # file -1- FS00|0|zero-zero| FSTA|0|10| FSTA|0|12| FSTA|0|15| FSTA|0|17| FS00|3|negative| FSTA|3|-1| FS00|5|regular|... (2 Replies)
Discussion started by: migurus
2 Replies

LEARN ABOUT V7

gcore

gcore(1)                                                           User Commands                                                          gcore(1)

NAME

       gcore - get core images of running processes

SYNOPSIS

       gcore [-pgF] [-o filename] [-c content] process-id...

DESCRIPTION

       The gcore utility creates a core image of each specified process. By default, the name of the core image file for the process whose process
       ID is process-id will be core.process-id.

OPTIONS

       The following options are supported:

       -c content      Produces core image files with the specified content. The content description uses the same tokens as in  coreadm(1M).  The
                       -c option does not apply to cores produced due to the -p or -g flags.

       -F              Force. Grabs the target process even if  another  process has control.

       -g              Produces core image files in the global core file repository with the global content as configured by coreadm(1M). The com-
                       mand will fail if the user does not have permissions to the global core file repository.

       -o filename     Substitutes filename in place of core as the first part of the name of the core image files. filename can contain the  same
                       tokens to be expanded as the paths in coreadm(1M).

       -p              Produces  a  core image file in the process-specific location with the process-specific content for each process as config-
                       ured by coreadm(1M). The command will fail if the user does not have permissions to the per-process core file repository.

OPERANDS

       The following operand is supported:

       process-id      process ID

EXIT STATUS

       The following exit values are returned:

       0               On success.

       non-zero        On failure, such as non-existent process ID.

FILES

       core.process-id         core images

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE         |      ATTRIBUTE VALUE        |
       +-----------------------------+-----------------------------+
       |Availability                 |SUNWtoo                      |
       +-----------------------------+-----------------------------+
       |Interface Stability          |See below.                   |
       +-----------------------------+-----------------------------+

       Command Syntax is Evolving. Output Format(s) are Unstable.

SEE ALSO

       kill(1), coreadm(1M), setrlimit(2), core(4), proc(4), attributes(5)

NOTES

       gcore is unaffected by the setrlimit(2) system call using the RLIMIT_CORE value.

SunOS 5.10                                                          11 Feb 2004                                                           gcore(1)
All times are GMT -4. The time now is 09:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy