02-21-2012
MVS compression that unix can uncompress
Dear all,
I have been given the opportunity at the last minute to help on a project. There is a need to move some very large files from an MVS machine to an AIX one. The servers are remote with (I think) a 2Meg network pipe between them. The people on the project have been moving small amounts of data and proving that their export/FTP/import works, but they never considered elapse time for the full sized data transfer.
Consequently our window of a weekend to move the data is nowhere near long enough because of the network bottleneck. Would anyone know of a compression tool that runs on MVS that produces files that could be read back by normal unix tools i.e.
uncompress or
gunzip
I love it when it's suddenly my fault when the FTP is too slow.
Someone looking after the MVS end is considering PKZip but there is then product to install & licence on AIX too. As the MVS support is outsourced, I'm having trouble finding out who is looking at that, but presumably it's from PKWare.com
I considered PGP as part of the encryption process compresses the data, but I'm struggling to find a source for the MVS tool.
Any suggestions?
Many thanks, in advance,
Robin
Liverpool/Blackburn
UK
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Is it possible to compress a large Unix file (16GB), then FTP it to a Wintel machine running XP then uncompress?
I have already attempted to FTP the 16GB file but it stops at 4GB because XP FAT32 formtted drives will only allow 4GB file sizes.
The 16GB file in Unix(Solaris) compresses to... (3 Replies)
Discussion started by: rampart1
3 Replies
2. UNIX for Dummies Questions & Answers
Hi all,
I have compressed a file in windows platform using 7zip into tar.z format. I try to uncompress in Unix using uncompress command. It doesn't work. Can anyone tell me wether there is any tools I can use in windows to generate a Tar.Z file which can be uncompress in unix.
From
Icestone (1 Reply)
Discussion started by: icestone
1 Replies
3. Shell Programming and Scripting
Hi All,
I have written a script that transfers(FTP) files from Unix system to MVS system.
Below is the code for it.
ftp -inv $HOST<<ftp_test
quote site LRECL=200
quote site BLKSIZE=28000
mput SOURCE DEST
ftp_test
Here I need the help, if the above code can get... (3 Replies)
Discussion started by: rinku11
3 Replies
4. UNIX for Advanced & Expert Users
We are transferring file from mainframes to unix, & in FTP process itself we would like to set access rights for
unix machine.
Has anyone used chmod command in association with site command in ftp? How it should be used?
Thanks in advance. (1 Reply)
Discussion started by: videsh77
1 Replies
5. UNIX for Advanced & Expert Users
Hi everyone,
Just interested to know everyones opinions on the fastest unix compression utility with okejish compression (doesnt have to have awsome compression). I know of gzip bzip2 (sucks lol) and a couple of others but what is a great one for compression large amounts of data that wont eat... (8 Replies)
Discussion started by: aleks001
8 Replies
6. Shell Programming and Scripting
Hi all,
I need a shell script that will compress all the files in the UNIX box say /output/foldre/OUT/*.out.
1. I need to compress all the .out files present in this path.
2. The compressed files shuld be FTPed to Windows server say C:\Myfiles
3. Then the FTPed files should be... (3 Replies)
Discussion started by: Codesearcher
3 Replies
7. Programming
Hi,
I need to uncompress a gzip and bzip file using java on unix solaris environment. I also need to retreive the header information of the file inorder to differentiate between gzip and bzip file. Please help
Pooja (0 Replies)
Discussion started by: wadhwa.pooja
0 Replies
8. AIX
Hi,
I want to try to connect to a DB2 (MVS) database from an AIX, through my c++ custom program. Is anybody who knows how can I do this? Which libraries should I use? Should I have a DB2 connect installed on my AIX?
Thank you in advance. (3 Replies)
Discussion started by: develo
3 Replies
9. Shell Programming and Scripting
Hi,
I am trying to send a txt file via FTP to the Mainframe or MVS. the file gets sent to the MVS but the user name gets appended to the file name.
For eg if i am sending test.txt, in the mainframe it lands as username.test.txt.
I tried putting the filename inside single quotes but I get an... (3 Replies)
Discussion started by: naveensraj
3 Replies
10. Shell Programming and Scripting
Hi,
I have one job that runs daily and creates daily files. At the end I compare the today's file with previous day's file. And if today's file size is greater or equal to previous day's file, then it is ok, else I need to through error.
I have following piece of code:
typeset -i... (2 Replies)
Discussion started by: ppatra
2 Replies
LEARN ABOUT BSD
uncompress
COMPRESS(1) General Commands Manual COMPRESS(1)
NAME
compress, uncompress, zcat - compress and expand data
SYNOPSIS
compress [ -f ] [ -v ] [ -c ] [ -b bits ] [ name ... ]
uncompress [ -f ] [ -v ] [ -c ] [ name ... ]
zcat [ name ... ]
DESCRIPTION
Compress reduces the size of the named files using adaptive Lempel-Ziv coding. Whenever possible, each file is replaced by one with the
extension .Z, while keeping the same ownership modes, access and modification times. If no files are specified, the standard input is com-
pressed to the standard output. Compressed files can be restored to their original form using uncompress or zcat.
The -f option will force compression of name, even if it does not actually shrink or the corresponding name.Z file already exists. Except
when run in the background under /bin/sh, if -f is not given the user is prompted as to whether an existing name.Z file should be overwrit-
ten.
The -c (``cat'') option makes compress/uncompress write to the standard output; no files are changed. The nondestructive behavior of zcat
is identical to that of uncompress -c.
Compress uses the modified Lempel-Ziv algorithm popularized in "A Technique for High Performance Data Compression", Terry A. Welch, IEEE
Computer, vol. 17, no. 6 (June 1984), pp. 8-19. Common substrings in the file are first replaced by 9-bit codes 257 and up. When code 512
is reached, the algorithm switches to 10-bit codes and continues to use more bits until the limit specified by the -b flag is reached
(default 16). Bits must be between 9 and 16. The default can be changed in the source to allow compress to be run on a smaller machine.
After the bits limit is attained, compress periodically checks the compression ratio. If it is increasing, compress continues to use the
existing code dictionary. However, if the compression ratio decreases, compress discards the table of substrings and rebuilds it from
scratch. This allows the algorithm to adapt to the next "block" of the file.
Note that the -b flag is omitted for uncompress, since the bits parameter specified during compression is encoded within the output, along
with a magic number to ensure that neither decompression of random data nor recompression of compressed data is attempted.
The amount of compression obtained depends on the size of the input, the number of bits per code, and the distribution of common sub-
strings. Typically, text such as source code or English is reduced by 50-60%. Compression is generally much better than that achieved by
Huffman coding (as used in pack), or adaptive Huffman coding (compact), and takes less time to compute.
The -v option causes the printing of the percentage reduction of each file.
If an error occurs, exit status is 1, else if the last file was not compressed because it became larger, the status is 2; else the status
is 0.
DIAGNOSTICS
Usage: compress [-fvc] [-b maxbits] [file ...]
Invalid options were specified on the command line.
Missing maxbits
Maxbits must follow -b.
file: not in compressed format
The file specified to uncompress has not been compressed.
file: compressed with xx bits, can only handle yy bits
File was compressed by a program that could deal with more bits than the compress code on this machine. Recompress the file with
smaller bits.
file: already has .Z suffix -- no change
The file is assumed to be already compressed. Rename the file and try again.
file: filename too long to tack on .Z
The file cannot be compressed because its name is longer than 12 characters. Rename and try again. This message does not occur on
BSD systems.
file already exists; do you wish to overwrite (y or n)?
Respond "y" if you want the output file to be replaced; "n" if not.
uncompress: corrupt input
A SIGSEGV violation was detected which usually means that the input file is corrupted.
Compression: xx.xx%
Percentage of the input saved by compression. (Relevant only for -v.)
-- not a regular file: unchanged
When the input file is not a regular file, (e.g. a directory), it is left unaltered.
-- has xx other links: unchanged
The input file has links; it is left unchanged. See ln(1) for more information.
-- file unchanged
No savings is achieved by compression. The input remains virgin.
BUGS
Although compressed files are compatible between machines with large memory, -b12 should be used for file transfer to architectures with a
small process data space (64KB or less, as exhibited by the DEC PDP series, the Intel 80286, etc.)
compress should be more flexible about the existence of the `.Z' suffix.
4.3 Berkeley Distribution May 11, 1986 COMPRESS(1)