Parse file from remote server to calculate count of string existence in that file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Parse file from remote server to calculate count of string existence in that file
Prev   Next
# 2  
Old 08-30-2010
You can do something like:

Create a file with a list of the hosts you want to query:
Code:
$> vi hostlist
host1
host2
host3
..

Then take some code:
Code:
PATTERN=mypattern
while read LINE; do
     ssh -n $LINE "grep -c $PATTERN /path/to/file"
done < hostlist |\
awk -v pattern="$PATTERN" '
     {sum+=$1}
     END{
          print "Pattern:",pattern
          print "Sum:",sum
     }
'

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Is it possible to create 10GB file in Linux and transferring the file to other remote server

Hi folks, Is it possible to create 10GB file in linux and transferring the file to other remote server? Regards, J (3 Replies)
Discussion started by: scriptscript
3 Replies

2. Shell Programming and Scripting

Check file for string existence before appending it with string

I want to append file with a string but before doing that i want to check if this string already exist in that file.I tried with grep on Solaris 10 but unsuccessful.Man pages from grep seems to suggest if the string is found command status will be 0 and if not 1.But i am not finding it.May be i... (2 Replies)
Discussion started by: sahil_shine
2 Replies

3. Shell Programming and Scripting

Parse large file on line count (random lines)

I have a file that needs to be parsed into multiple files every time there line contains a number 1. the problem i face is the lines are random and the file size is random. an example is that on line 4, 65, 187, 202 & 209 are number 1's so there has to be file breaks between all those to create 4... (6 Replies)
Discussion started by: darbs121
6 Replies

4. Shell Programming and Scripting

Polling for existence of file on remote host

I am polling a file on remote host. I have this code that works, but can't explain why it works. while user@remote.no-exist.com 'ls /user/app1/.done'` ] do echo Sleeping for 5 secs sleep 5; done This code works in the way that when the .done file exists on the remote host, the script... (1 Reply)
Discussion started by: starlatch
1 Replies

5. Shell Programming and Scripting

Existence of a string in a file

Hi, I want to know whether a string or variable is exists in a perticular file or not. I want to use IF command in cshell. I am not sure how to use it. can any one help me.. (2 Replies)
Discussion started by: arup1980
2 Replies

6. Shell Programming and Scripting

Mapping with series from master file and calculate count

Hi All, My shell script is calculating the count of each shortcode series wise whose sample output is as follows: -------------------------- 56882 9124 1 9172 1 9173 4 8923 6 9175 1 9058 2 7398 2 -------------------------- 58585 series count 9124 1 8858 17 9061 21 9125 21 (10 Replies)
Discussion started by: poweroflinux
10 Replies

7. Shell Programming and Scripting

Grep string from logs of last 1 hour on files of 2 different servers and calculate count

Hi, I am trying to grep a particular string from the files of 2 different servers without copying and calculate the total count of its occurence on both files. File structure is same on both servers and for reference as follows: 27-Aug-2010... (4 Replies)
Discussion started by: poweroflinux
4 Replies

8. Shell Programming and Scripting

check for file existence on remote machine using sftp

Hi all, I am a beginner to shell script.Can any one please help me on the below requirement I need to check whether the file (called 3Com_Files_Delivered.txt) exists on the remote mechaine or not? if so i need to copy all the files from there to my local mechaine.Especially i am... (7 Replies)
Discussion started by: narasimha123
7 Replies

9. Shell Programming and Scripting

Calculate the time difference between a local file and a remote file.

I m stuck with a issue. I need to calculate the time difference between two files.. one on the local machine and one on the remote machine using a script. Can any one suggest the way this can be achevied Thanks, manohar (1 Reply)
Discussion started by: meetmano143
1 Replies

10. Shell Programming and Scripting

Parse String in XML file

Hello All, I am new to this and I need to parse an XML file. Here's the XML Input File: <Report version="1.2"> <summary fatals="0" testcases="1" expected_fails="0" unexpected_passes="0" warnings="9" tests="21" errors="0" fails="1" passes="20" /> <testresult... (4 Replies)
Discussion started by: racbern
4 Replies
Login or Register to Ask a Question
FS_NEWCELL(1)						       AFS Command Reference						     FS_NEWCELL(1)

NAME
fs_newcell - Changes the kernel-resident list of a cell's database servers SYNOPSIS
fs newcell -name <cell name> -servers <primary servers>+ [-linkedcell <linked cell name>] [-help] fs n -n <cell name> -s <primary servers>+ [-l <linked cell name>] [-h] DESCRIPTION
The fs newcell command removes the Cache Manager's kernel-resident list of database server machines for the cell specified by the -name argument and replaces it with the database server machines named by the -servers argument. Each time the machine reboots, the Cache Manager constructs the kernel list of cells and database server machines by reading the local /etc/openafs/CellServDB file. This command does not change the CellServDB file, so any changes made with it persist only until the next reboot, unless the issuer also edits the file. The output of the fs listcells command reflects changes made with this command, because that command consults the kernel-resident list rather than the CellServDB file. This command can introduce a completely new cell into the kernel-resident list, but cannot make a cell inaccessible (it is not possible to remove a cell's entry from the kernel-resident list by providing no values for the -server argument). To make a cell inaccessible, remove its entry from the CellServDB file and reboot the machine. If the -name argument names a DCE cell, then the -servers argument names DFS Fileset Location (FL) Server machines. The -linkedcell argument specifies the name of the AFS cell to link to a DCE cell for the purpose of DFS fileset location. CAUTIONS
Some commands, such as the aklog or klog.krb5 commands, work correctly only when the information is accurate for a cell in both the CellServDB file and the kernel-resident list. OPTIONS
-name <cell name> Specifies the fully-qualified cell name of the AFS or DCE cell. -servers <primary servers>+ Specifies the fully-qualified hostnames of all AFS database server machines or DFS Fileset Location (FL) Server machines for the cell named by the -name argument. If FL Server machines are specified, the local machine must be running the AFS/DFS Migration Toolkit Protocol Translator. -linkedcell <linked cell name> Specifies the name of the AFS cell to link to a DCE cell for the purpose of DFS fileset location. -help Prints the online help for this command. All other valid options are ignored. EXAMPLES
The following example changes the machine's kernel-resident list of database server machines for the ABC Corporation cell to include the machines "db1.abc.com" and "db2.abc.com": % fs newcell -name abc.com -servers db1.abc.com db2.abc.com The following example links the DCE cell "dce.abc.com" to the AFS cell "abc.com". The AFS client contacts the Fileset Location (FL) servers "db1.dce.abc.com" and "db2.dce.abc.com" for fileset location information as it interprets a DFS pathname. % fs newcell -name dce.abc.com -servers db1.dce.abc.com db2.dce.abc.com -linkedcell abc.com PRIVILEGE REQUIRED
The issuer must be logged in as the local superuser root. SEE ALSO
CellServDB(5), fs_listcells(1) COPYRIGHT
IBM Corporation 2000. <http://www.ibm.com/> All Rights Reserved. This documentation is covered by the IBM Public License Version 1.0. It was converted from HTML to POD by software written by Chas Williams and Russ Allbery, based on work by Alf Wachsmann and Elizabeth Cassell. OpenAFS 2012-03-26 FS_NEWCELL(1)