Unix/Linux Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Move Large files

UNIX for Dummies Questions & Answers


Closed Linux or Unix Question    
 
Thread Tools Search this Thread Display Modes
    #1  
Old Unix and Linux 12-14-2006
tony_soprano tony_soprano is offline
Registered User
 
Join Date: Dec 2006
Last Activity: 15 December 2006, 7:16 AM EST
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Move Large files

Hi,

Im running (on AIX 5.2) a script which moves 16 large files (up to 1 Go each).
It uses the 'mv' command and runs during 30 minutes. I would like to improve this by using something else faster. Any ideas ?
Thx in advance !

T
Sponsored Links
    #2  
Old Unix and Linux 12-14-2006
Glenn Arndt's Unix or Linux Image
Glenn Arndt Glenn Arndt is offline Forum Advisor  
Anomalous Lurker
 
Join Date: Feb 2006
Last Activity: 2 February 2012, 9:30 AM EST
Location: Indianapolis, IN
Posts: 255
Thanks: 0
Thanked 2 Times in 2 Posts
If there was a faster way to move files, wouldn't mv do it the faster way? Maybe I'm missing something...
Sponsored Links
    #3  
Old Unix and Linux 12-14-2006
jim mcnamara jim mcnamara is offline Forum Staff  
...@...
 
Join Date: Feb 2004
Last Activity: 22 May 2015, 9:03 PM EDT
Location: NM
Posts: 10,452
Thanks: 336
Thanked 860 Times in 799 Posts

Code:
for i in f1 f2 f3 f4 f5 f6 f7 f8 f9 f10 f11 f12 f13 f14 f15 f16
do
   mv $i /destination/"$i"  &
done
wait

    #4  
Old Unix and Linux 12-14-2006
tony_soprano tony_soprano is offline
Registered User
 
Join Date: Dec 2006
Last Activity: 15 December 2006, 7:16 AM EST
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Thx for your replies. Actually, I am looking for sthing faster than mv command... I heard of mv large file aware.
Sponsored Links
    #5  
Old Unix and Linux 12-15-2006
cero cero is offline
Registered User
 
Join Date: Aug 2006
Last Activity: 22 May 2015, 9:01 AM EDT
Posts: 404
Thanks: 4
Thanked 80 Times in 72 Posts
gzip the files before moving ?
Sponsored Links
    #6  
Old Unix and Linux 12-15-2006
arunkumar_mca arunkumar_mca is offline
Registered User
 
Join Date: Oct 2004
Last Activity: 22 April 2015, 8:16 AM EDT
Posts: 305
Thanks: 3
Thanked 1 Time in 1 Post
Computer

I agreed you can Gzip and move will improve performance and again you can gunzip or gzip -d option will do to uncrompress
Sponsored Links
    #7  
Old Unix and Linux 12-15-2006
blowtorch's Unix or Linux Image
blowtorch blowtorch is offline Forum Advisor  
AFK
 
Join Date: Dec 2004
Last Activity: 16 April 2015, 11:34 AM EDT
Location: UK
Posts: 2,351
Thanks: 0
Thanked 6 Times in 6 Posts
Er, won't the gzip/compress take time to zip the file in the first place? And largefile aware mv only means that it can handle files larger than 2GB in size. I doubt if it means that it speeds up the actual move step of files.
Sponsored Links
Closed Linux or Unix Question

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Linux More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Large Data move from Win to AIX stewartna77 AIX 2 12-08-2010 04:13 PM
How to safely copy full filesystems with large files (10Gb files) dragonov7 Solaris 14 09-27-2010 06:20 PM
Divide large data files into smaller files ad23 Shell Programming and Scripting 7 07-21-2010 08:30 AM
Large file move from one server to another tfort73 AIX 14 03-09-2010 07:16 AM



All times are GMT -4. The time now is 01:06 AM.