Oracle Db Dump compression issue Post: 302901720

Sponsored Content

Operating Systems AIX Oracle Db Dump compression issue Post 302901720 by rbatte1 on Thursday 15th of May 2014 07:54:20 AM

05-15-2014

Moderator

Quote:

Originally Posted by thameerakn

Thanks for the reply. Since the setup is very old I don't want to change much as not sure what are AIX configurations and what patches they applied (Work Around scripts). That's why i don't want to use pipe file system. It would be great if i can use GZIP or ZIP instead.

I'm not sure why patch levels would affect this. We've been running it on AIX 4.3.3 ( Smilie

oh the shame) for ages and have migrated databases across the network from AIX 5.1 to RHEL 6.5 (export to pipe, dd across the network to a pipe, import from a pipe) It's just standard stuff.

The process also removes the need to store a huge intermediate file and then have space to compress it to along with the time saving of doing it all in one. On the migration to RHEL, we saved 23 hours over a process that was taking about 40.

If you really want to stick with a similar process to what you have and can't even upgrade gzip, perhaps you could split the file into smaller chunks, compress each, then concatenate them on the other side, so on the source server:-

Code:

split -a 5 -b 500m exp.dat exp.dat.split
for splitfile in exp.dat.split*
do
   gzip $splitfile        # Add whatever normal options you use
done

Then transfer all the exp.dat.split*zip files to the target server and:-

Code:

for splitfile in exp.dat.split*
do
   gunzip $splitfile        # Add whatever normal options you use
done

cat exp.dat.split* > exp.dat

..... and load your data in the normal way.

You may need to experiment with the values of -a & -b for the split so you get a managable number of files and of a suitable size to still allow gzip to work. Have a read of the split manual pages for more information.

Robin

rbatte1

View Public Profile for rbatte1

Visit rbatte1's homepage!

Find all posts by rbatte1

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help, what is the difference between core dump and panic dump?

2. UNIX for Dummies Questions & Answers

Exact issue in Core dump

Hi, I have a core dump problem in HP-UX. I have searched in this forum, but could not get any answer related to my issue. I debugged the core file by 'gdb' and by using 'bt' cmd I got the function and line no, but I am not sure that the problem lies on the same function . I want to know...

3. Linux

Clearning space - File compression issue

Hi, We have access to 2 filesystems: Filesystem Size Used Avail Use% Mounted on /dev/mapper/system-oraoid 30G 30G 119M 100% /app /dev/mapper/system-tmp 2.0G 442M 1.6G 22% /tmp As you can observe the file system on /app is full. In order to recover...

4. Emergency UNIX and Linux Support

Core Dump Issue

Hi In SunOS the gdb command outputs the following info. ---Type <return> to continue, or q <return> to quit--- Reading symbols from /opt/dcs_5.1/lib/libssl.so...done. Loaded symbols for /opt/dcs_5.1/lib/libssl.so Reading symbols from /opt/dcs_5.1/lib/libcrypto.so...done. Loaded symbols for...

5. Shell Programming and Scripting

"links -dump" output format issue

Hi All, I tried searching a lot about this but to no avail. I have a HTML file. I used links -dump file_page.html > text_html.txt What the above command gave me was a filtered text from the HTML file with tags removed. Now, the the output from the above command looked something like this:...

6. Shell Programming and Scripting

Connection to Oracle data and dump text file

Hi for all! I need for my job one shell script very concrete about connection to oracle databases and writing to text file. Well I tell you: 1.- I must read a file as parameter from linux interface: > example.sh fileToRead 2.-I must read line to line in "fileToRead" and take a...

7. UNIX for Dummies Questions & Answers

How can I import a particular schema from full dump in Oracle?

Hi All, I have a full oracle dump file that I have exported from a production server. I want to import a specific schema out of the full dump. Is that possible in oracle. What will be the command for that?

8. UNIX and Linux Applications

How to import and dump file to remote Oracle server?

Hi All, I have a linux centos instance which has a dump file. I need to import the dump file to the oracle server which is located at some remote location. I have installed the oracle client on my machine and I am able to connect to the remote oracle server. Now how to import the dump to the...

9. AIX

Issue while importing Oracle Dump File on AIX 5.3

Hi All, I am facing one problem related to importing Oracle Dump file. We have two different version of AIX boxes with oracle (version 10.2.0.4.0) installed. On one AIX box (version 6.1) we are creating oracle dump file (*.dmp) using oracle exp utility and importing it onto another AIX box...

10. Homework & Coursework Questions

Oracle dump file (del format) import into db2

1. The problem statement, all variables and given/known data: are the oracle dump files compatible to direct import into db2? I already tried many times but it always truncated results. anyone can help/ advice or suggest? 2. Relevant commands, code, scripts, algorithms: exp...

LEARN ABOUT DEBIAN

rdiff-backup-fs

RDIFF-BACKUP-FS(1)					      General Commands Manual						RDIFF-BACKUP-FS(1)

NAME

       rdiff-backup-fs - Filesystem for accessing rdiff-backup archives.

SYNOPSIS

       rdiff-backup-fs <mount_point> <repository> [repositories ...] [-option ...]

DESCRIPTION

       rdiff-backup-fs is a filesystem in userspace that reads rdiff-backup archives and provides convenient access.

OPTIONS

       --debug <0-4>
	      Run rdiff-backup-fs in foreground with given verbosity of debug messages.

       -f, --full
	      Store information about all revisions in memory. CAUTION: this may take a lot of memory if your archive contains many revisions.

       -l, --last
	      Displays	files from the most recent increment as directories, each holding every version of the file. CAUTION: this stores informa-
	      tion about all revisions in memory and therefore may take a lot of memory if archive contains many revisions.

       -c <n>, --caching <n>
	      How many files retrieved from the rdiff-backup archive may be cached by filesystem. By default rdiff-backup-fs will cache up  to	10
	      files. If this switch is set to 0, no caching will be done.

       -r <n>, --revisions <n>
	      How many revisions should be stored in memory for on demand revision retrieval. By default rdiff-backup-fs will store up to 10 revi-
	      sions in memory.

       -d, --directory <path>
	      Set directory for directory with temporary files. By default rdiff-backup-fs uses /tmp.

       -v, --version
	      Print version of rdiff-backup-fs and exit.

SEE ALSO

       rdiff-backup(1)

COPYRIGHT

       rdiff-backup-fs is Copyright (c) 2007-2011 Filip Gruszczyski.

       rdiff-backup-fs is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License  as  published
       by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

       This  program  is  distributed  in  the	hope  that  it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
       CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with this program.  If not, see <http://www.gnu.org/licenses/>.

AUTHORS

       Filip Gruszczyski <gruszczy@gmail.com>

																RDIFF-BACKUP-FS(1)