Matching 10 Million file records with 10 Million in other file Post: 302655111

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract data from large file 80+ million records

Hello, I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file. What will be the besat and fastest way to extract the ne file. sample file format :--...

2. Shell Programming and Scripting

sort a file which has 3.7 million records

hi, I'm trying to sort a file which has 3.7 million records an gettign the following error...any help is appreciated... sort: Write error while merging. Thanks

3. What is on Your Mind?

Pick a Number Between 0 and 20 for 1 Million Bits

Here is an easy game! I wrote a number between 0 and 20 (that can include 0 and 20) on a piece of paper. I am staring at it now, imagining the number so you can read my mind ;) Reply once, and only once, with a number from 0 to 20 and the first person to guess it wins 1,000,000 Bits. ...

4. Shell Programming and Scripting

Tail 86000 lines from 1.2 million line file?

I have a log file that is about 1.2 million lines long and about 300MB. we need a way to clean up this file and only keep the last few thousand lines. if i use tail command we run our of memory as the file is too big. I do have a key word to match on. example, we want to keep every line...

5. UNIX for Dummies Questions & Answers

Pls. help with script to remove million files

Hi, one of the server, log directory was never cleaned up. We have so many files. I want to remove all the files that starts with dfr* but I get error message when I use the *. rm qfr* bash: /usr/bin/rm: Arg list too long I am trying to write this script but not working. ...

6. UNIX for Dummies Questions & Answers

Deleting a million of files ..

Hi, Which way is faster rm -rf /path/ or find / -name -exec rm {} \; and why?

7. UNIX for Dummies Questions & Answers

Add 1 million columns

Hi, here is my problem: I've got a file with 6 columns (file1): a b c d e f a b c d e f a b c d e f a b c d e f I need to add 1 million columns to this file, each column needs to be a zero. Here is how the result file (file2) should look like (for the sake of the example, I've only...

LEARN ABOUT DEBIAN

cabextract

CABEXTRACT(1)						      General Commands Manual						     CABEXTRACT(1)

NAME

       cabextract - program to extract files from Microsoft cabinet (.cab) archives

SYNOPSIS

       cabextract [-ddir] [-f] [-Fpattern] [-h] [-l] [-L] [-p] [-q] [-s] [-t] [-v]  cabinet files ...

DESCRIPTION

       cabextract  is  a  program that un-archives files in the Microsoft cabinet file format (.cab) or any binary file which contains an embedded
       cabinet file (frequently found in .exe files).

       cabextract will extract all files from all cabinet files specified on the command line.

       To extract a multi-part cabinet consisting of several files, only the first cabinet file needs to be given as an argument to cabextract	as
       it  will  automatically	look  for the remaining files. To prevent cabextract from extracting cabinet files you did not specify, use the -s
       option.

OPTIONS

       A summary of options is included below.

       -d dir Extracts all files into the directory dir.

       -f     When testing or extracting cabinet files, corrupted MSZIP blocks will be ignored. A warning will be printed  if  a  corrupted  MSZIP
	      block is encountered.

       -F pattern
	      Only  files with names that match the shell pattern pattern shall be listed, tested or extracted. On non-GNU systems, this match may
	      be case-sensitive.

       -h     Prints a page of help and exits.

       -l     Lists the contents of the given cabinet files, rather than extracting them.

       -L     When extracting cabinet files, makes each extracted file's name lowercase.

       -p     Files shall be extracted to standard output.

       -q     When extracting cabinet files, suppresses all messages except errors and warnings.

       -s     When testing, listing or extracting cabinets which span multiple files, only cabinet files given on the command line shall be used.

       -t     Tests the integrity of the cabinet. Files are decompressed, but not written to disk or standard output.  If  the	file  successfully
	      decompresses, the MD5 checksum of the file is printed.

       -v     If given alone on the command line, prints the version of cabextract and exits. Given with a list of cabinet files, it will list the
	      contents of the cabinet files.

AUTHOR

       This manual page was written by Stuart Caie <kyzer@4u.net>, based on the one written by Eric Sharkey <sharkey@debian.org>, for  the  Debian
       GNU/Linux system.

SEE ALSO

       lcab(1)

								 October 30, 2005						     CABEXTRACT(1)