Move Large files | Unix Linux Forums | UNIX for Dummies Questions & Answers

  Go Back    


UNIX for Dummies Questions & Answers If you're not sure where to post a UNIX or Linux question, post it here. All UNIX and Linux newbies welcome !!

Move Large files

UNIX for Dummies Questions & Answers


Closed Thread    
 
Thread Tools Search this Thread Display Modes
    #1  
Old 12-14-2006
tony_soprano tony_soprano is offline
Registered User
 
Join Date: Dec 2006
Last Activity: 15 December 2006, 7:16 AM EST
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Move Large files

Hi,

Im running (on AIX 5.2) a script which moves 16 large files (up to 1 Go each).
It uses the 'mv' command and runs during 30 minutes. I would like to improve this by using something else faster. Any ideas ?
Thx in advance !

T
Sponsored Links
    #2  
Old 12-14-2006
Glenn Arndt's Avatar
Glenn Arndt Glenn Arndt is offline Forum Advisor  
Anomalous Lurker
 
Join Date: Feb 2006
Last Activity: 2 February 2012, 9:30 AM EST
Location: Indianapolis, IN
Posts: 255
Thanks: 0
Thanked 2 Times in 2 Posts
If there was a faster way to move files, wouldn't mv do it the faster way? Maybe I'm missing something...
Sponsored Links
    #3  
Old 12-14-2006
jim mcnamara jim mcnamara is online now Forum Staff  
...@...
 
Join Date: Feb 2004
Last Activity: 22 July 2014, 5:08 PM EDT
Location: NM
Posts: 10,152
Thanks: 267
Thanked 780 Times in 730 Posts

Code:
for i in f1 f2 f3 f4 f5 f6 f7 f8 f9 f10 f11 f12 f13 f14 f15 f16
do
   mv $i /destination/"$i"  &
done
wait

    #4  
Old 12-14-2006
tony_soprano tony_soprano is offline
Registered User
 
Join Date: Dec 2006
Last Activity: 15 December 2006, 7:16 AM EST
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Thx for your replies. Actually, I am looking for sthing faster than mv command... I heard of mv large file aware.
Sponsored Links
    #5  
Old 12-15-2006
cero cero is offline
Registered User
 
Join Date: Aug 2006
Last Activity: 22 July 2014, 11:11 AM EDT
Posts: 360
Thanks: 3
Thanked 64 Times in 59 Posts
gzip the files before moving ?
Sponsored Links
    #6  
Old 12-15-2006
arunkumar_mca arunkumar_mca is offline
Registered User
 
Join Date: Oct 2004
Last Activity: 21 November 2013, 6:30 AM EST
Posts: 279
Thanks: 1
Thanked 0 Times in 0 Posts
Computer

I agreed you can Gzip and move will improve performance and again you can gunzip or gzip -d option will do to uncrompress
Sponsored Links
    #7  
Old 12-15-2006
blowtorch's Avatar
blowtorch blowtorch is offline Forum Advisor  
AFK
 
Join Date: Dec 2004
Last Activity: 10 October 2013, 8:46 AM EDT
Location: UK
Posts: 2,351
Thanks: 0
Thanked 6 Times in 6 Posts
Er, won't the gzip/compress take time to zip the file in the first place? And largefile aware mv only means that it can handle files larger than 2GB in size. I doubt if it means that it speeds up the actual move step of files.
Sponsored Links
Closed Thread

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
Large Data move from Win to AIX stewartna77 AIX 2 12-08-2010 04:13 PM
How to safely copy full filesystems with large files (10Gb files) dragonov7 Solaris 14 09-27-2010 06:20 PM
Divide large data files into smaller files ad23 Shell Programming and Scripting 7 07-21-2010 08:30 AM
Large file move from one server to another tfort73 AIX 14 03-09-2010 07:16 AM



All times are GMT -4. The time now is 05:23 PM.