What RavinderSingh13 suggested might work for you, but it is comparing lines instead of records. With his suggestion it is theoretically possible to match (and copy) parts of records without matching entire records. How likely false matches are depends on the sources of the data in your two input files.
The standards say that only the first character of RS matters and that if more than one character is contained in RS, the results are unspecified.
If the awk on your system specifies that it handles multi-character RS values, I think the following trivial change will work for you, but I don't have a awk I can use to test the results:
Code:
awk 'BEGIN { FS=" "; ORS=RS="@M" } FNR==NR {a[$1]; next} $1 in a' File_1.txt File_2.txt
In addition, the sample data you have provided includes a <space> character at the start of each line in all three of your files. If there really are <space>s there on your real files, that may skew the results you get from this code.
Don
Of course! That took care of it! However, I just came to realize that the RS is being printed at the very end of the output file. I can get rid of it with a simple sed script but I was wondering if the awk script can be modified in such way that will prevent it the last "@M" from being printed out
Thank you very much
X
PS. RavinderSingh13, thank you for replying to my post but your script is not what I was looking for. Don's suggestion worked like a charm
Last edited by Xterra; 12-05-2017 at 02:39 PM..
Reason: Testing with real data
I have two file as given below which shows the ACL permissions of each file. I need to compare the source file with target file and list down the difference as specified below in required output. Can someone help me on this ?
Source File
*************
# file: /local/test_1
# owner: own
#... (4 Replies)
Hello all,
Please help me for a script that compares two files and reads only those records that are to be inserted and updated.
File1:
c_id name place contact_no
1 abc xyz 34567
10 efg uvw 82725
6 hjk wth 01823
2 iuy ... (4 Replies)
Hello.
I have to compare two different fastq.gz files that I concatenated, and then zipped into a new merge fastq.gz file.
The files that need to be merged are:
Sample-136-P_S7_L001_R1_001.fastq.gz and Sample -136-P_S7_L002_R1_001.fastq.gz
They were meged to a new file called:... (1 Reply)
Good morning all,
I have a problem that is one step beyond a standard awk compare.
I would like to compare three files which have several thousand records against a fourth file. All of them have a value in each row that is identical, and one value in each of those rows which may be duplicated... (1 Reply)
Hello,
I am working with next-gen short-read sequence data, which we receive in 3 fastq files. These are arranged in 4-line groups for each read:
line1: read identifier, beginning, e.g., "@HWI-ST1342..."
line2: DNA sequence, for files 1 and 2, 101 characters, for file 3, 7 chars.
line3: "+"... (2 Replies)
Hi, I have the following files,
A M 2 3
B E 4 5
C I 5 6
D O 4 5
A M 3 4
B E 5 2
F U 7 9
J K 2 3
OUTPUT
A M 2 3 3 4
B E 4 5 5 2
thanks in advance, (7 Replies)
Hi All,
I want to remove the rows from File1.csv by comparing a column/field in the File2.csv. If both columns matches then I want that row to be deleted from File1 using shell script(awk). Here is an example on what I need.
File1.csv:
RAJAK,ACTIVE,1
VIJAY,ACTIVE,2
TAHA,ACTIVE,3... (6 Replies)
Hi,
I have two text files.The first and the 2nd file have data in the same format
For e.g. The first file has
BOOKS COUNT: 40
BOOKS AUTHOR1 SUM:1018 MAX:47 MIN:1 AVG:25.45
BOOKS AUTHOR3 SUM:181 MAX:48 MIN:3 AVG:18.1
Note:Read it as Table columnname sum(column) max(column) min(column)... (1 Reply)
Hi,
I need to compare todays file to yesterdays file to find deletes.
I cannot use comm -23 file.old file.new.
Because each record may have a small change in it but is not really a delete.
I have two delimited files. the first field in each file is static. All other fields may change. I... (2 Replies)
