How to copy particular files from a multiple directories and paste in a new directory?


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers How to copy particular files from a multiple directories and paste in a new directory?
# 1  
Old 12-27-2019
How to copy particular files from a multiple directories and paste in a new directory?

Dear all
I have a multiple directories, say for example org1, org2, org3 ..... org100 and each directory having a file namely dnaG.fasta. I need to copy all the dnaG.fasta file from each directory and paste in another directory fastconcatg. Therefore, my script has to copy dnaG.fasta file from each directory, add prefix to the file name like 1_dnaG.fasta, 2_dnaG.fasta ..... 100_dnaG.fasta and paste into the fastconcatg.
I have tried the following script but the script is not serving my purpose, It copy and paste only one file and rest is not copied and renamed finally end up with error. Kindly help me to do the same.
Code:
a=1
for i in **/dnaG.fasta
do
cp "$i" "$a"_"$i" fastcancatg
a=`expr $a + 1`
done

Thank you in advance.

Last edited by dineshkumarsrk; 12-27-2019 at 09:23 AM..
# 2  
Old 12-27-2019
Hello dineshkumarsrk,

A few general comments first:-
  • Your for loop has an extra * which might be confusing when you read this later on.
  • It would be better to use longer variable names to make it clear and to reduce the risk of other things that might call this getting confused.
  • The use of backticks ` is deprecated and the way you do it is wasteful too. You add extra processes where the shell can do integer calculations for you.
  • It would be nice to indent your code for clarity
I have made a few tweaks based on these and your code looks like this:-
Code:
count=1
for source_file in */dnaG.fasta
do
   cp "${source_file}" "${count}"_"${source_file}" fastcancatg
   ((count=$count+1))
done

The cp command you have is saying "Copy the source file and the source file again, but with a prefix of the counter and an underscore writing both files to the target directory fastcancatg" which doesn't make sense. The source file with the prefix does not exist. Can I presume that you want to copy the source file to the target directory with a prefix? Perhaps try this instead:-
Code:
count=1
for source_file in */dnaG.fasta
do
   cp "${source_file}" "fastcancatg/${count}"_"${source_file}"
   ((count=$count+1))
done

Is that nearer to what you are after?


Kind regards,
Robin
# 3  
Old 12-27-2019
Thank you Robin for your detailed explanation. Here, I would like to repeat my question in clear manner.
I have a multiple directories, say for example org1, org2, org3 ..... org100 and each directory having a file namely dnaG.fasta. I need to copy all the dnaG.fasta file from each directory and paste in another directory fastconcatg. Therefore, my script has to copy dnaG.fasta file from each directory, add prefix to the file name like 1_dnaG.fasta, 2_dnaG.fasta ..... 100_dnaG.fasta and paste into the fastconcatg folder.

Last edited by dineshkumarsrk; 12-27-2019 at 09:25 AM..
# 4  
Old 12-27-2019
Okay, I'm sure we can help with that. A few questions for clarity though:-
  • Must the filename in the fastconcatg directory be the prefix of the directory that the source was found in?
  • What do we do for a directory that doesn't have a file of that name in it? We could leave an empty marker file, miss it completely or perhaps something else.

If your source files would be found be the command ls -l org*/dnaG.fasta then that's good. The problem about so many files is that you might exceed the command line length, but we can work on that if it become a problem.

For every directory/file found, the logic could be something like:-
  • Get the directory part
  • Get the number from the directory part
  • Copy the file to the target directory with the source directory number as a prefix

Does that match your need or have I missed the point?

Do you have any further attempts yourself that we can work through?



Kind regards,
Robin
This User Gave Thanks to rbatte1 For This Post:
# 5  
Old 12-27-2019
Your problem is the wrong destination in the cp command; it must be dir/file.
Together with a few improvements:
Code:
a=1
for i in */dnaG.fasta
do
  cp "$i" fastcancatg/"$a"_"$i" 
  a=$(( a + 1 ))
done

Previous suggestion should work as well. But a Posix count=$((count+1)) is better portable.

Last edited by MadeInGermany; 12-27-2019 at 02:44 PM..
This User Gave Thanks to MadeInGermany For This Post:
# 6  
Old 12-27-2019
Wouldn't it make more sense to use the directories' suffixes for the target files' prefixes?
Code:
for FP in org*/dnaG.fasta; do TMP=${FP#org}; echo cp $FP fastconcatg/${TMP%%/*}_${FP##*/}; done
cp org100/dnaG.fasta fastconcatg/100_dnaG.fasta
cp org1/dnaG.fasta fastconcatg/1_dnaG.fasta
cp org2/dnaG.fasta fastconcatg/2_dnaG.fasta
cp org3/dnaG.fasta fastconcatg/3_dnaG.fasta
cp org4/dnaG.fasta fastconcatg/4_dnaG.fasta

Remove the echo if happy with what it presents.

Last edited by RudiC; 12-27-2019 at 05:13 PM..
This User Gave Thanks to RudiC For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare directories and copy differences (files) in a another directory

Hey im working on script that can compare 2 directory and check difference, then copy difference files in third diretory. here is the story: in folder one we have 12 subfolder and in each of them near 500 images hosted. 01 02 03 04 05 06 07 08 09 10 11 12 in folder 2 we have same subfolder... (2 Replies)
Discussion started by: nimafire
2 Replies

2. UNIX for Beginners Questions & Answers

How to copy a column of multiple files and paste into new excel file (next to column)?

I have data of an excel files as given below, file1 org1_1 1 1 2.5 100 org1_2 1 2 5.5 98 org1_3 1 3 7.2 88 file2 org2_1 1 1 2.5 100 org2_2 1 2 5.5 56 org2_3 1 3 7.2 70 I have multiple excel files as above shown. I have to copy column 1, column 4 and paste into a new excel file as... (26 Replies)
Discussion started by: dineshkumarsrk
26 Replies

3. Shell Programming and Scripting

Rename files from multiple directories along with directory indicator

Hi, Friends, i have a requirement where i need to rename my files residing in multiple sub directories and move them to one different directory along with some kind of directory indicator. For eg: test--is my parent directory and it has many files such as a1.txt a2.txt a3.txt ... (5 Replies)
Discussion started by: gnnsprapa
5 Replies

4. Shell Programming and Scripting

Copy files/directories excluding multiple paterns

my directory structure is like below: basedir\ p.txt q.htm r.java b\ abc.htm xyz.java c\ p.htm q.java rst.txt my requirement is i want to copy all the files and directories... (0 Replies)
Discussion started by: ajayyadavmca
0 Replies

5. UNIX for Advanced & Expert Users

FTP failed to copy mulitple files from multiple directory

I am using below scripts to copy all the files from multiple folders. By executing individually command i am able to copy all the files but using scripts only getting first file. System is ignoring the second CD and mget command. HOST=server.com USER=loginid PASSWD="abc" echo "open $HOST... (6 Replies)
Discussion started by: meetvipin
6 Replies

6. Shell Programming and Scripting

Copy files from multiple directories into one directory without overwriting them

I have several directories and all those directories have .dat files in them. I want to copy all those .dat files to one directory say "collected_directory" The problem is I don't want to overwrite files. So, if two file names match, I don't want the old file to be overwritten with a new one. ... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies

7. Shell Programming and Scripting

Copy one folder to multiple directories

Hello, I have a small question and i hope someone can help me, if i have 200 domains directories in my server under this directory something like now how i can copy one folder i have to this directories? Thank You (5 Replies)
Discussion started by: GamGom
5 Replies

8. UNIX for Dummies Questions & Answers

Copy/Paste data in files

Hi, I want to put the following values into Variables R2=0.999863 , V2=118.870318 , D2=-178.887511 and so on. There are six values for each variable R2-R8, V2-V8 and D2-D8, total of 18 values for all the variables. Can any one help me to copy and paste all the values in their respective... (2 Replies)
Discussion started by: sullah
2 Replies

9. UNIX for Dummies Questions & Answers

Renaming files after their directory name in multiple sub directories

So I am not sure if this should go in the shell forum or in the beginners. It is my first time posting on these forums. I have a directory, main_dir lets say, with multiple sub directories (one_dir through onehundred_dir for example) and in each sub directory there is a test.txt. How would one... (2 Replies)
Discussion started by: robotsbite
2 Replies

10. UNIX for Dummies Questions & Answers

copy multiple files in different directories

I have a report file that is generated every day by a scheduled process. Each day the file is written to a directory named .../blah_blah/Y07/MM-DD-YY/reportmmddyy.tab I want to copy all of this reports to a separate directory without having to do it one by one. However, if I try cp... (3 Replies)
Discussion started by: ken2834
3 Replies
Login or Register to Ask a Question