Find common numbers from two very large files using awk or the like Post: 302799569

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Get un common numbers from two files

Hi, I have two files: abc : 50040 123123 31703 cde: 104 97 50040 123123 31703 36609 50534

2. Shell Programming and Scripting

To find all common lines from 'n' no. of files

Hi, I have one situation. I have some 6-7 no. of files in one directory & I have to extract all the lines which exist in all these files. means I need to extract all common lines from all these files & put them in a separate file. Please help. I know it could be done with the help of...

3. UNIX for Dummies Questions & Answers

Grep alternative to handle large numbers of files

I am looking for a file with 'MCR0000000716214' in it. I tried the following command: grep MCR0000000716214 * The problem is that the folder I am searching in has over 87000 files and I am getting the following: bash: /bin/grep: Arg list too long Is there any command I can use that can...

4. Shell Programming and Scripting

Drop common lines at head/tail of a large set of files

Hi! I have a large set of pairs of text files (each pair in their own subdirectory) and each pair shares head/tail (a couple of first and last lines) but differs in the middle part. I need to delete the heads/tails and keep only the middle portions in which they differ. The lengths of heads/tails...

5. UNIX for Advanced & Expert Users

Find common Strings in two large files

Hi , I have a text file in the format DB2: DB2: WB: WB: WB: WB: and a second text file of the format Time=00:00:00.473 Time=00:00:00.436 Time=00:00:00.016 Time=00:00:00.027 Time=00:00:00.471 Time=00:00:00.436 the last string in both the text files is of the...

6. Shell Programming and Scripting

finding common numbers (contents) across 2 or 3 files

I have 3 files which are tab delimited and have numbers in it. file 1 1 2 3 4 5 6 7 File 2 3 5 7 8 File 3 1

7. Shell Programming and Scripting

Find common numbers and print yes or no

Hi I have 2 files with following data First file, sp|Q676U5|A16L1_HUMAN, Autophagy-related protein 16-1 OS=Homo sapiens GN=ATG16L1 PE=1 SV=2, Maximum coiled-coil residue probability: 0.657 in position 163. Maximum dimeric residue probability: 0.288 in position 163. ...

8. Shell Programming and Scripting

Find Common Values Across Two Files

9. Shell Programming and Scripting

Find common files between two directories

I have two directories Dir 1 /home/sid/release1 Dir 2 /home/sid/release2 I want to find the common files between the two directories Dir 1 files /home/sid/release1>ls -lrt total 16 -rw-r--r-- 1 sid cool 0 Jun 19 12:53 File123 -rw-r--r-- 1 sid cool 0 Jun 19 12:53...

LEARN ABOUT MINIX

paste

PASTE(1)						      General Commands Manual							  PASTE(1)

NAME

       paste - paste multiple files together

SYNOPSIS

       paste [-s] [-d list] file...

OPTIONS

       -d     Set delimiter used to separate columns to list.

       -s     Print files sequentially, file k on line k.

EXAMPLES

       paste file1 file2   # Print file1 in col 1, file2 in col 2

       paste -s f1 f2	   # Print f1 on line 1 and f2 on line 2

       paste -d : file1 file2
			   # Print the lines separated by a colon

DESCRIPTION

       Paste  concatenates  corresponding  lines of the given input files and writes them to standard output. The lines of the different files are
       separated by the delimiters given with the option -s. If no list is given, a tab is substituted for every linefeed, except  the	last  one.
       If  end-of-file	is hit on an input file, subsequent lines are empty.  Suppose a set of k files each has one word per line.  Then the paste
       output will have k columns, with the contents of file j in column j.  If the -s flag is given, then the first file is on line 1, the second
       file on line 2, etc.  In effect, -s turns the output sideways.

       If  a list of delimiters is given, they are used in turn.  The C escape sequences 
, 	, \, and  are used for linefeed, tab, backslash,
       and the null string, respectively.

																	  PASTE(1)