03-31-2018
Quote:
Originally Posted by
Scrutinizer
An array is used to count the occurrence in the spend file and in a way "post processed" while reading the transfile...
You are right, but another warning is in order: because the processing is done in memory the script has - depending on the sizes of the files involved - the potential to exhaust the systems memory if the files are very big and/or the RAM is small.
I hope this helps.
bakunin
10 More Discussions You Might Find Interesting
1. Linux
I need to find the line count of multiple strings in a particular file. The strings are as follows:
bmgcc
bmgccftp
bsmsftp
bulkftp
cctuneftp
crbtftp
crmpos
cso
gujhr
I am doing manual grep for each of the string to find the line count. The command i am using right now is:
grep mark... (3 Replies)
Discussion started by: salaathi
3 Replies
2. Shell Programming and Scripting
Hello,
I'm looking for a wait to count the number of occurrences of a certain string of characters within a file. The file that I trying to parce has segments within the file that have a header and footer to each segment and I'm trying to do a count of the header string and compare it to a count... (9 Replies)
Discussion started by: bd_joy
9 Replies
3. Shell Programming and Scripting
Hi All,
I have a below file:
==================
02:53 pravin-root
02:53 pravin-root
03:05 pravin-root
02:55 pravin1-root
02:59 pravin1-root
==================
How do I find the first and last value of column 1. For example, how do I find 02:53 is the first time stamp and 03:05 is... (3 Replies)
Discussion started by: praving5
3 Replies
4. Shell Programming and Scripting
I am writing a package manager in BASH and I would like a small snippet of code that finds lines that match exact input and count them. For example, my file contains:
xyz
xyz-lib2.0+
xyz-lib2.0
xyz-lib1.5
and "grep -c xyz" returns 4.
The current function is:
# $1 is the package name.... (3 Replies)
Discussion started by: cooprocks123e
3 Replies
5. Shell Programming and Scripting
I have a file containing about 5 million rows, in the file there are some records which has extra delimiter at random position. (we dont know the positions), now we have to Count the delimeter from each row and if the count of delimeter is not matching then I want to delete those rows from the... (5 Replies)
Discussion started by: Akumar1
5 Replies
6. Shell Programming and Scripting
Hi Guys,
The script which I am using works really good for finding the file count for files that are not symlink. I know I can use find command like:
find . -type l | wc -l
This way I can get filecount of the symlink but is there a one liner to use -type l and -type f option ? That is... (4 Replies)
Discussion started by: dixits
4 Replies
7. Shell Programming and Scripting
Hi
I ahve a lookup file wiht seven words
CD
HT
CAD
HT
T1D
T2D
BDanother file contain data like this
CHRM1 P11229 Pirenzepine DAP000492 Peptic ulcer disease Approved T2D
CHRM1 P11229 Glycopyrrolate DAP001116 Anesthetic Approved T2D
CHRM1 P11229 ... (7 Replies)
Discussion started by: manigrover
7 Replies
8. UNIX for Dummies Questions & Answers
How to find count total number of pattern in a file …
File contains : a.txt
-------------
aaa bbb nnn
ccc aaa bbb
aaa ddd aaa
aaa aaa aaa
grep -c aaa a.txt
Op: 4 ( But my requirement is should count the total no of patterns as 7 ) (4 Replies)
Discussion started by: Jitten
4 Replies
9. UNIX for Beginners Questions & Answers
I'm trying to use awk to count the occurrences of two matching fields of a CSV file.
For instance, for data that looks like this...
Joe,Blue,Yes,No,High
Mike,Blue,Yes,Yes,Low
Joe,Red,No,No,Low
Joe,Red,Yes,Yes,Low
I've been trying to use code like this...
countvar=`awk ' $2~/$color/... (4 Replies)
Discussion started by: nmoore2843
4 Replies
10. UNIX for Beginners Questions & Answers
Hi,
I have a file with a list of bunch of IP addresses from different VLAN's . I am trying to find the list the number of each vlan occurence in the output
Here is how my file looks like
1.1.1.1
1.1.1.2
1.1.1.3
1.1.2.1
1.1.2.2
1.1.3.1
1.1.3.2
1.1.3.3
1.1.3.4
So what I am trying... (2 Replies)
Discussion started by: new2prog
2 Replies
XZDEC(1) XZ Utils XZDEC(1)
NAME
xzdec, lzmadec - Small .xz and .lzma decompressors
SYNOPSIS
xzdec [option]... [file]...
lzmadec [option]... [file]...
DESCRIPTION
xzdec is a liblzma-based decompression-only tool for .xz (and only .xz) files. xzdec is intended to work as a drop-in replacement for
xz(1) in the most common situations where a script has been written to use xz --decompress --stdout (and possibly a few other commonly used
options) to decompress .xz files. lzmadec is identical to xzdec except that lzmadec supports .lzma files instead of .xz files.
To reduce the size of the executable, xzdec doesn't support multithreading or localization, and doesn't read options from XZ_OPT environ-
ment variable. xzdec doesn't support displaying intermediate progress information: sending SIGINFO to xzdec does nothing, but sending
SIGUSR1 terminates the process instead of displaying progress information.
OPTIONS
-d, --decompress, --uncompress
Ignored for xz(1) compatibility. xzdec supports only decompression.
-k, --keep
Ignored for xz(1) compatibility. xzdec never creates or removes any files.
-c, --stdout, --to-stdout
Ignored for xz(1) compatibility. xzdec always writes the decompressed data to standard output.
-M limit, --memory=limit
Set the memory usage limit. If this option is specified multiple times, the last one takes effect. The limit can be specified in
multiple ways:
o The limit can be an absolute value in bytes. Using an integer suffix like MiB can be useful. Example: --memory=80MiB
o The limit can be specified as a percentage of physical RAM. Example: --memory=70%
o The limit can be reset back to its default value (currently 40 % of physical RAM) by setting it to 0.
o The memory usage limiting can be effectively disabled by setting limit to max. This isn't recommended. It's usually better to
use, for example, --memory=90%.
The current limit can be seen near the bottom of the output of the --help option.
-q, --quiet
Specifying this once does nothing since xzdec never displays any warnings or notices. Specify this twice to suppress errors.
-Q, --no-warn
Ignored for xz(1) compatibility. xzdec never uses the exit status 2.
-h, --help
Display a help message and exit successfully.
-V, --version
Display the version number of xzdec and liblzma.
EXIT STATUS
0 All was good.
1 An error occurred.
xzdec doesn't have any warning messages like xz(1) has, thus the exit status 2 is not used by xzdec.
NOTES
xzdec and lzmadec are not really that small. The size can be reduced further by dropping features from liblzma at compile time, but that
shouldn't usually be done for executables distributed in typical non-embedded operating system distributions. If you need a truly small .xz
decompressor, consider using XZ Embedded.
SEE ALSO
xz(1)
Tukaani 2009-06-04 XZDEC(1)