07-14-2010
Search and find total count from multiple files
Please advice how can we search for a string say (abc) in multiple files and to get total occurrence of that searched string. (Need number of records that exits in period of time).
File look like this (read as filename.yyyymmdd)
a.20100101
b.20100108
c.20100115
d.20100122
e.20100129
f.20100204
f.20100211
....
....
z.20100429
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Ok, another fun hiccup in my UNIX learning curve. I am trying to count the number of occurrences of an IP address across multiple files named example.hits. I can extract the number of occurrences from the files individually but when you use grep -c with multiple files you get the output similar to... (5 Replies)
Discussion started by: MrAd
5 Replies
2. Shell Programming and Scripting
how to count the total number of lines of all the files under a directory using perl script..
I mean if I have 10 files under a directory then I want to count the total number of lines of all the 10 files contain. Please help me in writing a perl script on this. (5 Replies)
Discussion started by: adityam
5 Replies
3. Shell Programming and Scripting
Hi Friends,
Need help regarding counting the word "friend" in files test1.txt and test2.txt. ( there is no gap/space between word )
cat test1.txt
himynameisrajandiamfriendofrajeshfriend
wouldyouliketobemyfriend.
cat test2.txt
himynameisdostandiamfriendofdostfriend... (2 Replies)
Discussion started by: forroughuse
2 Replies
4. Shell Programming and Scripting
Hi ,
Below is my sample data,I have this 8 column(A,B,C,D,E,F,G,H) in csv file.
A , B ,C ,D ,E ,F,G ,H
4141,127337,24,15,20,69,72.0,-3
4141,128864,24,15,20,65,66.0,-1
4141,910053,24,15,4,4,5.0,-1
4141,910383,24,15,22,3,4.0,-1
4141,496969,24,15,14,6,-24.0,-18... (7 Replies)
Discussion started by: vinothsekark
7 Replies
5. Shell Programming and Scripting
Hello :
I need some help in writing a ksh script which will find a particular directory in all the file systems in a server and finally report the total size of the direcotry in all the file systems.
Some thing like this..
find /u*/app/oracle -type d -name "product" -prune
and then... (1 Reply)
Discussion started by: Sam1974
1 Replies
6. Solaris
If I have a number of files in a directory, for example,
test.1
test.2
test.3
abc.1
abc.2
abc.3
and I need to find the total file size of all of the test.* files, I can use du -bc test.* in Linux.
However, in Solaris, du does not have the -c option. What can I do in Solaris to get... (11 Replies)
Discussion started by: learnix
11 Replies
7. UNIX for Dummies Questions & Answers
How to find count total number of pattern in a file …
File contains : a.txt
-------------
aaa bbb nnn
ccc aaa bbb
aaa ddd aaa
aaa aaa aaa
grep -c aaa a.txt
Op: 4 ( But my requirement is should count the total no of patterns as 7 ) (4 Replies)
Discussion started by: Jitten
4 Replies
8. Shell Programming and Scripting
Hi All,
I have a folder name lets say path/to/folder/CUSTOMER and under this i have several folders and each of these subfolder have serveral subfolders and so on and at some point i will have a folder name called "FTP_FILES" .
I need to search for these folders named "FTP_FILES and then... (10 Replies)
Discussion started by: Kevin Tivoli
10 Replies
9. Shell Programming and Scripting
Hi All ,
I have multiple pipe delimited csv files are present in a directory.I need to find out distinct count on a column on those files and need the total distinct
count on all files.
We can't merge all the files here as file size are huge in millions.I have tried in below way for each... (9 Replies)
Discussion started by: STCET22
9 Replies
LEARN ABOUT DEBIAN
flow-expire
flow-expire(1) General Commands Manual flow-expire(1)
NAME
flow-expire -- Manage storage of flow file archives by expiring old data.
SYNOPSIS
flow-expire [-h] [-d debug_level] [-e expire_count] [-E expire_size] -w workdir
DESCRIPTION
The flow-expire utility will remove the oldest flow files in a directory based on either a count of files or space utilization. The direc-
tory is recursively searched for flow files. Files that do not have a flow-tools signature will be ignored. The internal timestamp is
used so backups or copies of the flow files that do not retain the original timestamp will not impact the operation of flow-expire. flow-
expire is typically used to manage storage in a distributed environment where flows are collected on a different server than they are
archived.
OPTIONS
-d debug_level
Enable debugging.
-e expire_count
Retain the maximum number of files so that the total file count is less than expire_count.
-E expire_size
Retain the maximum number of files so that the total storage is less than expire_size. The letters b,K,M,G can be used as multi-
pliers, ie 16 Megabytes is 16M.
-h Display help.
-w workdir
Work in workdir.
EXAMPLES
Remove the oldest flow files in /flows/krc4 until the total storage is less then 2 Gigabytes.
flow-expire -E2Gig -w /flows/krc4
Remove the oldest flow files in /flows/krc4 until the total number of files is less then 100.
flow-expire -e100 -w /flows/krc4
BUGS
Empty directories are not removed.
AUTHOR
Mark Fullmer maf@splintered.net
SEE ALSO
flow-tools(1)
flow-expire(1)