Sponsored Content
Full Discussion: Copying of large files fail
Top Forums Shell Programming and Scripting Copying of large files fail Post 302417931 by GoldenEye4ever on Saturday 1st of May 2010 12:52:44 PM
Old 05-01-2010
Copying of large files fail

Hi,
I have a process which duplicates files for different environments. As the files arrive, my script (korn shell) makes copies of them (giving a unique name) and then renames the original file so that my process won't get triggered again.

I don't like it either, but it's what we were told to do Smilie

The problem is, some of these files are basically DB refresh files. Some of these refresh files have gotten very large (over 4GB) and are now failing to be duplicated.

My script simply uses the UNIX cp command to make duplicate copies of the files. The files in question are sitting on a NAS (network attached storage device) while my script resides on our DB UNIX server.

The NAS is fully capable of handling files that exceed 4GB, but for some reason the cp command is failing.
I have no control over the NAS, but I can communicate with the team who manages it.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

copying a large filesystem

Hi there In my organisation we have a solaris network with /home being automounted from /export/home on a central file server (usual stuff) however, the guy who originally set this up only allocated 3gb to /export/home and now we are really struggling for space. I have a new 18gb disk installed... (3 Replies)
Discussion started by: hcclnoodles
3 Replies

2. Filesystems, Disks and Memory

Strange difference in file size when copying LARGE file..

Hi, Im trying to take a database backup. one of the files is 26 GB. I am using cp -pr to create a backup copy of the database. after the copying is complete, if i do du -hrs on the folders i saw a difference of 2GB. The weird fact is that the BACKUP folder was 2 GB more than the original one! ... (1 Reply)
Discussion started by: 0ktalmagik
1 Replies

3. UNIX for Dummies Questions & Answers

Copying large file problem on SVR4 Unix

We have 3 Unix servers all running SVR4 Unix 1.4. I have no problems copying files to and from 2 of the servers using either the rcp command or ftp but when i come to transfer large files to the third server the copy gives up part way through and crashes this server. Copying smaller files using RCP... (7 Replies)
Discussion started by: coatesd
7 Replies

4. UNIX for Advanced & Expert Users

copying of files by userB, dir & files owned by userA

I am userB and have a dir /temp1 This dir is owned by me. How do I recursively copy files from another users's dir userA? I need to preserve the original user who created files, original group information, original create date, mod date etc. I tried cp -pr /home/userA/* . ... (2 Replies)
Discussion started by: Hangman2
2 Replies

5. UNIX for Dummies Questions & Answers

Copying a Large File

I have a large file that I append entries to the end of every few seconds. Its grown to >150MB. Its basically a log file but a perl script is writing to it. I need to make a copy of it to a new directory. I realize the latest entries occuring while the copy is taking place will not be recorded... (1 Reply)
Discussion started by: lforum
1 Replies

6. Solaris

How to safely copy full filesystems with large files (10Gb files)

Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS. I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies

7. Shell Programming and Scripting

Start copying large file while its still being restored from tape

Hello, I need to copy a 700GB tape-image file over a network. I want to start the copy process before the tape-image has finished being restored from the tape. The tape restore speed is about 78 Mbps and the file transfer speed over the network is about 45 Mbps I don't want to use a pipe, since... (7 Replies)
Discussion started by: swamik
7 Replies

8. SCO

Need advice: Copying large CSV report files off SCO system

I have a SCO Unix server from 1999 running SCO 5.0.5 and some ancient accounting software called Real World A report writer program on the system is used to generate CSV files from accounting that we write with DOSCOPY commands to 3.5" floppies In the next 60 days we will be decommissioning... (11 Replies)
Discussion started by: magnetman
11 Replies

9. Shell Programming and Scripting

Copying number by looking a large file

Hi All, I have a big file which looks like this: abc 34.32 cdf 343.45 computer 1.34 ladder 2.3422 I have some 100000 .TXT files which look like this: computer cdf align I have to open each of the text files and read the words from the text files. Then I have to look into that... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies

10. Shell Programming and Scripting

Copying large files in a bash script stops execution

Hello, I'm new to this forum and like to first of all say hello to everyone. I've got a really annoying problem at the moment. I'm trying to rsync some files (about 200MB with one file of 120MB) from a Raspberry PI with raspbian to a debian server via rsync. This procedure is stored in a... (3 Replies)
Discussion started by: wex_storm
3 Replies
scnasdir(1M)						  System Administration Commands					      scnasdir(1M)

NAME
scnasdir - manage the exported directories on a network-attached storage (NAS) device in a Sun Cluster configuration. SYNOPSIS
scnasdir [-H] scnasdir [-a] [-H] [-n] -h device-name [-d directory [-d directory...]] [-f input-file] scnasdir -p [-H] [-h device-name] [-t device-type] scnasdir -r [-H ] [-n ] -h device-name [-d all | -d directory [-d directory...]] [-f input-file] DESCRIPTION
Note - Beginning with the Sun Cluster 3.2 release, Sun Cluster software includes an object-oriented command set. Although Sun Cluster software still supports the original command set, Sun Cluster procedural documentation uses only the object-oriented command set. For more infor- mation about the object-oriented command set, see the Intro(1CL) man page. The scnasdir command manages the exported directories on NAS devices in a Sun Cluster configuration. The device must already have been con- figured in the cluster by using the scnas command. The scnasdir command can be used to add directories to a device's cluster configuration, to remove directories from a device's cluster con- figuration, and to print the directories of a particular device or particular device types. The options in this command are processed in the order in which they are typed on the command line. The scnasdir command can only be run from an active cluster node. The results of running the command are always the same, regardless of the node that is used. All forms of the scnasdir command accept the -H option. Specifying -H displays help information, and all other options are ignored and not executed. Help information is also printed when scnasdir is run without options. You can use this command only in the global zone. OPTIONS
Basic Options The following options are common to all forms of the scnasdir command: -H If this option is specified on the command line at any position, the command prints help information. All other options are ignored and are not executed. Help information is also printed if scnasdir is run with no options. You can use this option only in the global zone. -n If this option is specified on the command line at any position, the scnasdir command only checks the usage and does not write the con- figuration data. If the -n option is specified with the -f option, the scnasdir command displays the data that will be processed for the user to review. The following options modify the basic form and function of the scnasdir command. None of these options can be combined on the same command line. -a Specifies the add form of the scnasdir command. The -a option can be used to add directories into the device's Sun Cluster configura- tion. You can use this option only in the global zone. -p Specifies the print form of the scnasdir command. When no other option is given, this -p option prints a listing of all the directories of all the NAS devices configured in Sun Cluster. This option can be used with additional options to query a particular device or par- ticular types of NAS devices. You can use this option only in the global zone. -r Specifies the remove form of the scnasdir command. The -r option is used to remove all the directories, or the specified directories of a NAS device from its Sun Cluster configuration. You can use this option only in the global zone. Additional Options The following additional options can be combined with one or more of the previously described basic options to manage the directories of a device. The additional options are as follows: -h device-name Use this option to specify the name of the NAS device in the Sun Cluster configuration. The -h option identifies the device and can be used to remotely access the device by using rhs or telnet. This device name must be specified for the add, change, and remove forms of the scnasdir command. -d all | directory Use this option to list the directories (or volumes) exported on the NAS device to be configured into the Sun Cluster. These directo- ries must be created and exported on the device before using the scnasdir command. See the documentation for the NAS device type for procedures for exporting directories. The -d all option can only be accepted by the remove option, -r. The directories must be specified by using either the -d option, or the -f option, for the add and remove forms of the scnasdir com- mand. -f input-file Directories can be placed into a plain text file, one directory per line, and used with the -f option. Leading white spaces and tabs are ignored. Comments begin with an unquoted pound (#) sign, and continue to the next new line. The parser ignores all comments. EXAMPLES
Example 1 Adding Two NAS Storage Device Directories to a Cluster The following scnasdir command adds two directories of a NAS device to the Sun Cluster configuration. # scnasdir -a -h sunnas1 -d /vol/DB1 -d /vol/DB2 Example 2 Removing All of a NAS Storage Device's Directories From a Cluster The following scnasdir command removes all the directories that are configured for a NAS device. # scnasdir -r -h sunnas1 -d all EXIT STATUS
The following exit values are returned: 0 The command executed successfully. nonzero An error has occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWsczu | +-----------------------------+-----------------------------+ |Interface Stability |Evolving | +-----------------------------+-----------------------------+ SEE ALSO
Intro(1CL), clnasdevice(1CL), clquorum(1CL), cluster(1CL), scconf(1M), scnas(1M) Sun Cluster 3.2 10 Sep 2007 scnasdir(1M)
All times are GMT -4. The time now is 12:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy