09-23-2018
Apologies to bump this thread but I have problems with large size of input files(~15MB size and 400K lines). The solution offered by vgersh99 did work for the sample provided and also for few small-sized input files. But it outputs entire input for large files. I'm not sure what's wrong with it.
Please advise, thanks!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Friends,
I have a file as below :
machine1:
abc
xyz
qwerty
machine2:
jkl
mno
machine3:
hhh
kkk
qwerty
Now ...i need to find all the stanza names that have the pattern "qwerty'"
in it...( i need to get the output as machine1 and machine3 since... (4 Replies)
Discussion started by: vijaya2006
4 Replies
2. Shell Programming and Scripting
Hi Friends,
I have a stanza file as below :
CuDv:
name = "hdisk34"
status = 0
chgstatus = 3
ddins = "scsidisk"
location = "06-08-02"
parent = "fscsi0"
connwhere = "W_0"
PdDvLn = "disk/fcp/mpioosdisk"
CuDv:
... (1 Reply)
Discussion started by: vijaya2006
1 Replies
3. Shell Programming and Scripting
Hi,
I have a file with the following structure.
XXXXX...........
YYYYY...........
.................
..................
ZZZZZZ......
qwerty_start..............
..................
.................
..................
querty_end................
.............................. (1 Reply)
Discussion started by: abinash
1 Replies
4. Shell Programming and Scripting
Dear all,
I have been trying to print an entire field, if the first line of the field is matching.
For example, my input looks something like this.
aaa ddd zzz
123 987 126
24 0.650 985
354 9864 0.32
0.333 4324 000
I am looking for a pattern,... (5 Replies)
Discussion started by: Chulamakuri
5 Replies
5. Shell Programming and Scripting
I have an input that looks like this:
chr1 mm9_knownGene utr3 3204563 3206102 0 - . gene_id "Xkr4"; transcript_id "uc007aeu.1";
chr1 mm9_knownGene utr3 4280927 4283061 0 - . gene_id "Rp1"; transcript_id "uc007aew.1";
chr1 mm9_knownGene ... (5 Replies)
Discussion started by: pbluescript
5 Replies
6. UNIX for Dummies Questions & Answers
I would like to confirm my file.tar is been tar-ed correctly before I remove them. But I have very limited disc space to untar it.
Can I just do the listing instead of actual extract it? Can I say confirm folder integrity if the listing is sucessful without problem?
tar tvf file1.tar
... (1 Reply)
Discussion started by: vivien_chu
1 Replies
7. Shell Programming and Scripting
Hi I am trying to carry out a sum on a file (totals.txt).
The file looks like:
So far i have this command
this returns 20610
I however want it to return 000000206100
Any help would be great
thanks! (6 Replies)
Discussion started by: nwalsh88
6 Replies
8. UNIX for Dummies Questions & Answers
Hi folks,
I am very new to awk. I have what is probably a very simple question. I'm trying to get the max value of column 1, but also print column 2. My data looks like this:
0.044|2000-02-03 14:00:00
5.23|2000-02-03 05:45:00
5.26|2000-02-03 11:15:00
0|2000-02-01 18:30:00
So in this case... (2 Replies)
Discussion started by: amandarobe
2 Replies
9. AIX
The default: stanza in /etc/security/limits is still set to 2097151 on fsize (max file size). I know tar had issues with large files but is there any other reasons for it? I'm thinking yes since it's still set to that by IBM.
Cheers,
DH (4 Replies)
Discussion started by: Devyn
4 Replies
10. Shell Programming and Scripting
Hello,
I have a file with multiple paragraphs/sections each starting with word "Handle" and if I grep for a pattern, I should get contents of entire section/para (not just line). Please advise, thanks!
#script.sh file.txt "System Information"
Handle 0x0001
DMI type 1, 27 bytes.
... (9 Replies)
Discussion started by: reddyr
9 Replies
bdiff(1) General Commands Manual bdiff(1)
NAME
bdiff - Finds differences in large files
SYNOPSIS
bdiff file1 file2 [number] [-s]
bdiff - file2 [number] [-s]
bdiff file1 - [number] [-s]
The bdiff command compares file1 and file2 and writes information about their differing lines to standard output. If either filename is -
(dash), bdiff reads standard input.
OPTIONS
Suppresses error messages. (May either precede or follow the number argument if it is specified.)
DESCRIPTION
The bdiff command uses diff to find lines that must be changed in two files to make them identical (see the diff command). Its primary
purpose is to permit processing of files that are too large for diff.
The bdiff command ignores lines common to the beginning of both files, splits the remainders into sections of number lines, and runs diff
on the sections. The output is then processed to make it look as if diff had processed the files whole.
If you do not specify number, a system default is used. In some cases, the number you specify or the default number may be too large for
diff. If bdiff fails, specify a smaller value for number and try again.
Note that because of file segmenting, bdiff does not necessarily find the smallest possible set of file differences. In general, although
the output is similar, using bdiff is not the equivalent of using diff.
NOTES
The diff command is executed by a child process, generated by forking, and communicates with bdiff through pipes.
It should not normally be necessary to use this command, since diff can handle most large files.
EXIT STATUS
No differences. Differences found. An error occurred.
SEE ALSO
Commands: diff(1), diff3(1)
bdiff(1)