05-01-2010
Copying of large files fail
Hi,
I have a process which duplicates files for different environments. As the files arrive, my script (korn shell) makes copies of them (giving a unique name) and then renames the original file so that my process won't get triggered again.
I don't like it either, but it's what we were told to do
The problem is, some of these files are basically DB refresh files. Some of these refresh files have gotten very large (over 4GB) and are now failing to be duplicated.
My script simply uses the UNIX
cp command to make duplicate copies of the files. The files in question are sitting on a NAS (network attached storage device) while my script resides on our DB UNIX server.
The NAS is fully capable of handling files that exceed 4GB, but for some reason the
cp command is failing.
I have no control over the NAS, but I can communicate with the team who manages it.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi there
In my organisation we have a solaris network with /home being automounted from /export/home on a central file server (usual stuff) however, the guy who originally set this up only allocated 3gb to /export/home and now we are really struggling for space. I have a new 18gb disk installed... (3 Replies)
Discussion started by: hcclnoodles
3 Replies
2. Filesystems, Disks and Memory
Hi, Im trying to take a database backup. one of the files is 26 GB. I am using cp -pr to create a backup copy of the database. after the copying is complete, if i do du -hrs on the folders i saw a difference of 2GB.
The weird fact is that the BACKUP folder was 2 GB more than the original one!
... (1 Reply)
Discussion started by: 0ktalmagik
1 Replies
3. UNIX for Dummies Questions & Answers
We have 3 Unix servers all running SVR4 Unix 1.4. I have no problems copying files to and from 2 of the servers using either the rcp command or ftp but when i come to transfer large files to the third server the copy gives up part way through and crashes this server. Copying smaller files using RCP... (7 Replies)
Discussion started by: coatesd
7 Replies
4. UNIX for Advanced & Expert Users
I am userB and have a dir
/temp1
This dir is owned by me.
How do I recursively copy files from another users's dir userA?
I need to preserve the original user who created files, original group information, original create date, mod date etc.
I tried
cp -pr /home/userA/* .
... (2 Replies)
Discussion started by: Hangman2
2 Replies
5. UNIX for Dummies Questions & Answers
I have a large file that I append entries to the end of every few seconds. Its grown to >150MB. Its basically a log file but a perl script is writing to it. I need to make a copy of it to a new directory. I realize the latest entries occuring while the copy is taking place will not be recorded... (1 Reply)
Discussion started by: lforum
1 Replies
6. Solaris
Hello everyone. Need some help copying a filesystem. The situation is this: I have an oracle DB mounted on /u01 and need to copy it to /u02. /u01 is 500 Gb and /u02 is 300 Gb. The size used on /u01 is 187 Gb. This is running on solaris 9 and both filesystems are UFS.
I have tried to do it using:... (14 Replies)
Discussion started by: dragonov7
14 Replies
7. Shell Programming and Scripting
Hello, I need to copy a 700GB tape-image file over a network. I want to start the copy process before the tape-image has finished being restored from the tape. The tape restore speed is about 78 Mbps and the file transfer speed over the network is about 45 Mbps I don't want to use a pipe, since... (7 Replies)
Discussion started by: swamik
7 Replies
8. SCO
I have a SCO Unix server from 1999 running SCO 5.0.5 and some ancient accounting software called Real World
A report writer program on the system is used to generate CSV files from accounting that we write with DOSCOPY commands to 3.5" floppies
In the next 60 days we will be decommissioning... (11 Replies)
Discussion started by: magnetman
11 Replies
9. Shell Programming and Scripting
Hi All,
I have a big file which looks like this:
abc 34.32
cdf 343.45
computer 1.34
ladder 2.3422
I have some 100000 .TXT files which look like this:
computer
cdf
align
I have to open each of the text files and read the words from the text files. Then I have to look into that... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies
10. Shell Programming and Scripting
Hello,
I'm new to this forum and like to first of all say hello to everyone.
I've got a really annoying problem at the moment.
I'm trying to rsync some files (about 200MB with one file of 120MB) from a Raspberry PI with raspbian to a debian server via rsync.
This procedure is stored in a... (3 Replies)
Discussion started by: wex_storm
3 Replies
LEARN ABOUT OPENSOLARIS
scconf_quorum_dev_netapp_nas
scconf_quorum_dev_netapp_nas(1M) System Administration Commands scconf_quorum_dev_netapp_nas(1M)
NAME
scconf_quorum_dev_netapp_nas - add and remove shared Network Appliance network-attached storage (NAS) quorum devices and change various NAS
cluster quorum configuration properties or states.
SYNOPSIS
scconf {-a|-c|-r} -q name=devicename otheroptions
DESCRIPTION
Note -
Beginning with the Sun Cluster 3.2 release, Sun Cluster software includes an object-oriented command set. Although Sun Cluster software
still supports the original command set, Sun Cluster procedural documentation uses only the object-oriented command set. For more infor-
mation about the object-oriented command set, see the Intro(1CL) man page.
A Network Appliance NAS device can be configured as a quorum device for Sun Cluster. The NAS configuration information consists of:
o a device name, which must be unique across quorum devices
o
a filer name, which defaults to the device name if not specified
o a LUN ID, which defaults to 0 if not specified
To provide support for NAS devices as quorum devices, the administrator must install the quorum device support module provided by Network
Appliance. If this module is not available, scconfprevents the addition of the quorum device. See Sun Cluster With Network-Attached Storage
Devices Manual for Solaris OS for instructions about obtaining the support module.
Additionally, the iSCSI license must be valid for the Network Appliance device.
OPTIONS
The following options can be used for NAS quorum devices. See scconf(1M) for the list of supported generic options. See scconf_quo-
rum_dev_netapp_nas(1M) for options that are specific to shared disk quorum devices.
The add and remove forms of the command are used to add and remove NAS quorum devices to or from the configuration. The change form of the
command is used for changing various properties of cluster quorum configuration.
Before you add a quorum device, you must set up and configure the device and the logical unit number (LUN) on the device to be configured
as a quorum device. For detailed procedures, see your Network Appliance documentation. For Sun Cluster requirements of device setup, see
Sun Cluster With Network-Attached Storage Devices Manual for Solaris OS. After the quorum device is added, you cannot change the type.
Add a NAS quorum device:
-q -a name=devicename,type=netapp_nas[,filer=filer-name][,lun_id=0]
Change a NAS quorum device's configuration:
-q -c name=devicename,{maintstate | reset}
Remove a NAS quorum device:
-q -r name=devicename
The -q option supports the following Network Appliance NAS-specific suboptions:
filer=filer-name
Specifies the name of the device on the network that you can use to access the NAS device when you are using rsh or telnet.
lun_id=0
Specifies the LUN ID on the NAS device that will be a NAS quorum device. The LUN ID defaults to 0.
When scconf is interrupted or fails while performing quorum-related operations, quorum configuration information can become inconsistent in
the cluster configuration database. If an inconsistency occurs, either run the same scconf command again or run it with the reset option to
reset the quorum information.
EXAMPLES
Example 1 Adding Network Appliance NAS Quorum Devices
The following scconf command adds the Network Appliance NAS quorum device qd1.
-a -q name=qd1,type=netapp_nas,filer=nas1.sun.com,lun_id=0
Example 2 Removing Network Appliance NAS Quorum Devices
The following scconf command removes the Network Appliance NAS quorum device qd1.
-r -q name=qd1
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWsczu |
+-----------------------------+-----------------------------+
|Interface Stability |Evolving |
+-----------------------------+-----------------------------+
SEE ALSO
Intro(1CL), clquorum(1CL), cluster(1CL), scconf(1M), scconf-quorum-dev-scsi(1M)
Sun Cluster 3.2 10 Apr 2006 scconf_quorum_dev_netapp_nas(1M)