Sponsored Content
Operating Systems AIX Oracle Db Dump compression issue Post 302901720 by rbatte1 on Thursday 15th of May 2014 07:54:20 AM
Old 05-15-2014
Quote:
Originally Posted by thameerakn
Thanks for the reply. Since the setup is very old I don't want to change much as not sure what are AIX configurations and what patches they applied (Work Around scripts). That's why i don't want to use pipe file system. It would be great if i can use GZIP or ZIP instead.
I'm not sure why patch levels would affect this. We've been running it on AIX 4.3.3 (Smilie oh the shame) for ages and have migrated databases across the network from AIX 5.1 to RHEL 6.5 (export to pipe, dd across the network to a pipe, import from a pipe) It's just standard stuff.

The process also removes the need to store a huge intermediate file and then have space to compress it to along with the time saving of doing it all in one. On the migration to RHEL, we saved 23 hours over a process that was taking about 40.



If you really want to stick with a similar process to what you have and can't even upgrade gzip, perhaps you could split the file into smaller chunks, compress each, then concatenate them on the other side, so on the source server:-
Code:
split -a 5 -b 500m exp.dat exp.dat.split
for splitfile in exp.dat.split*
do
   gzip $splitfile        # Add whatever normal options you use
done

Then transfer all the exp.dat.split*zip files to the target server and:-
Code:
for splitfile in exp.dat.split*
do
   gunzip $splitfile        # Add whatever normal options you use
done

cat exp.dat.split* > exp.dat

..... and load your data in the normal way.

You may need to experiment with the values of -a & -b for the split so you get a managable number of files and of a suitable size to still allow gzip to work. Have a read of the split manual pages for more information.


Robin
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

help, what is the difference between core dump and panic dump?

help, what is the difference between core dump and panic dump? (1 Reply)
Discussion started by: aileen
1 Replies

2. UNIX for Dummies Questions & Answers

Exact issue in Core dump

Hi, I have a core dump problem in HP-UX. I have searched in this forum, but could not get any answer related to my issue. I debugged the core file by 'gdb' and by using 'bt' cmd I got the function and line no, but I am not sure that the problem lies on the same function . I want to know... (0 Replies)
Discussion started by: ronix007
0 Replies

3. Linux

Clearning space - File compression issue

Hi, We have access to 2 filesystems: Filesystem Size Used Avail Use% Mounted on /dev/mapper/system-oraoid 30G 30G 119M 100% /app /dev/mapper/system-tmp 2.0G 442M 1.6G 22% /tmp As you can observe the file system on /app is full. In order to recover... (2 Replies)
Discussion started by: animesh303
2 Replies

4. Emergency UNIX and Linux Support

Core Dump Issue

Hi In SunOS the gdb command outputs the following info. ---Type <return> to continue, or q <return> to quit--- Reading symbols from /opt/dcs_5.1/lib/libssl.so...done. Loaded symbols for /opt/dcs_5.1/lib/libssl.so Reading symbols from /opt/dcs_5.1/lib/libcrypto.so...done. Loaded symbols for... (1 Reply)
Discussion started by: kumaran_5555
1 Replies

5. Shell Programming and Scripting

"links -dump" output format issue

Hi All, I tried searching a lot about this but to no avail. I have a HTML file. I used links -dump file_page.html > text_html.txt What the above command gave me was a filtered text from the HTML file with tags removed. Now, the the output from the above command looked something like this:... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies

6. Shell Programming and Scripting

Connection to Oracle data and dump text file

Hi for all! I need for my job one shell script very concrete about connection to oracle databases and writing to text file. Well I tell you: 1.- I must read a file as parameter from linux interface: > example.sh fileToRead 2.-I must read line to line in "fileToRead" and take a... (9 Replies)
Discussion started by: wien996
9 Replies

7. UNIX for Dummies Questions & Answers

How can I import a particular schema from full dump in Oracle?

Hi All, I have a full oracle dump file that I have exported from a production server. I want to import a specific schema out of the full dump. Is that possible in oracle. What will be the command for that? (6 Replies)
Discussion started by: Palak Sharma
6 Replies

8. UNIX and Linux Applications

How to import and dump file to remote Oracle server?

Hi All, I have a linux centos instance which has a dump file. I need to import the dump file to the oracle server which is located at some remote location. I have installed the oracle client on my machine and I am able to connect to the remote oracle server. Now how to import the dump to the... (3 Replies)
Discussion started by: Palak Sharma
3 Replies

9. AIX

Issue while importing Oracle Dump File on AIX 5.3

Hi All, I am facing one problem related to importing Oracle Dump file. We have two different version of AIX boxes with oracle (version 10.2.0.4.0) installed. On one AIX box (version 6.1) we are creating oracle dump file (*.dmp) using oracle exp utility and importing it onto another AIX box... (1 Reply)
Discussion started by: gunjan_thakur
1 Replies

10. Homework & Coursework Questions

Oracle dump file (del format) import into db2

1. The problem statement, all variables and given/known data: are the oracle dump files compatible to direct import into db2? I already tried many times but it always truncated results. anyone can help/ advice or suggest? 2. Relevant commands, code, scripts, algorithms: exp... (3 Replies)
Discussion started by: Sonny_103024
3 Replies
AIDA2FLAT(1)							   User Commands						      AIDA2FLAT(1)

NAME
aida2flat - Convert AIDA data files to a flat format SYNOPSIS
aida2flat [options] aidafile [aidafile2 ...] DESCRIPTION
Convert AIDA data files to a flat format which is more human-readable then the XML (and by default also plottable directly using make-plots). The output is by default written out to standard output unless the --split, --smart-output, --gnuplot, or --output options are specified. When specifying either input or output filenames, a '-' is used to refer to stdin or stdout as appropriate. Histograms can also be filtered by AIDA path, using the -m or -M options for a positive or negative regex pattern patch respectively. OPTIONS
-h, --help show this help message and exit -o OUTPUT, --output=OUTPUT Write all histos to a single output file, rather than the default writing to stdout. stdout can be explicitly specified by setting '-' as the output filename. This option will be disregarded if --split, --smart-output, or --gnuplot is specified. -s, --split Write each histo to a separate output file, with names based on the histo path -S, --smart-output Write to output files with names based on the corresponding input filename. This option will be disregarded if --split is specified. -g, --gnuplot Provide output suitable for Gnuplot's 'plot "foo.dat" with xye'. This option implies --split and will override --output or --smart-output --plotinfodir=PLOTINFODIR directory which may contain plot header information -m PATHPATTERNS, --match=PATHPATTERNS Only write out histograms whose $path/$name string matches these regexes -M PATHUNPATTERNS, --unmatch=PATHUNPATTERNS Exclude histograms whose $path/$name string matches these regexes AUTHOR
This manual page was written by Lifeng Sun <lifongsun@gmail.com> for the Debian system (but may be used by others). Rivet June 2012 AIDA2FLAT(1)
All times are GMT -4. The time now is 09:03 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy