File processing Post: 302891821

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Have a shell script check for a file to exist before processing another file

I have a shell script that runs all the time looking for a certain type of file and then it processes the file through a series of other scripts. The script is watching a directory that has files uploaded to it via SFTP. It already checks the size of the file to make sure that it is not still...

2. Shell Programming and Scripting

Checking for a control file before processing a data file

Hi All, I am very new to Shell scripting... I got a requirement. I will have few text files(data files) in a particular directory. they will be with .txt extension. With same name, but with a different extension control files also will be there. For example, Sample_20081001.txt is the data...

3. Shell Programming and Scripting

how to change the current file processing to some other random file in awk ?

Hello, say suppose i am processing an file emp.dat the field of which are deptno empno empname etc now say suppose i want to change the file to emp.lst then how can i do it? Here i what i attempted but in vain BEGIN{ system("sort emp.dat > emp.lst") FILENAME="emp.lst" } { print...

4. Shell Programming and Scripting

How to processing the log file within certain dates based on the file name

Hi I am working on the script parsing specific message "TEST" from multiple file. The log file name looks like: N3.2009-11-26-03-05-02.console.log.tar.gz N4.2009-11-29-00-25-03.console.log.tar.gz N6.2009-12-01-10-05-02.console.log.tar.gz I am using the following command: zgrep -a --text...

5. Shell Programming and Scripting

How to make parallel processing rather than serial processing ??

Hello everybody, I have a little problem with one of my program. I made a plugin for collectd (a stats collector for my servers) but I have a problem to make it run in parallel. My program gathers stats from logs, so it needs to run in background waiting for any new lines added in the log...

6. Shell Programming and Scripting

File Processing

i am having the input file as below 123456789: xxxxx12xxxxxxxxxxxxxxxxxx a_cnt 123456789: xxxxxxxxxxxxxxxxxxxxxxx a_cnt 123456789: a_cnt xxxxaq1wsxxxxxxxxxxxx12xxxxxxxxxx 123456789: xxxxxxxxxxxxasxxxx a_cnt i need the numbers in the backets of a_cnt O/p required as below 1 2 3 4...

7. Shell Programming and Scripting

Recursive file processing from a path and printing output in a file

Hi All, The script below read the path and searches for the directories/subdirectories and for the files. If files are found in the sub directories then read the content of the all files and put the content in csv(comma delimted) format and the call the write to xml function to write the std...

8. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M...

9. UNIX for Dummies Questions & Answers

awk - Rename output file, after processing, same as input file

I have one input file ABC.txt and one output DEF.txt. After the ABC is processed and created output, I want to rename ABC.txt to ABC.orig and DEF to ABC.txt. Currently when I am doing this, it does not process the input file as it cannot read and write to the same file. How can I achieve this? ...

LEARN ABOUT DEBIAN

crm_report

1.1.7(8)						  System Administration Utilities						  1.1.7(8)

NAME

       1.1.7 - Part of the Pacemaker cluster resource manager

SYNOPSIS

       crm_report -f "YYYY-M-D H:M:S" [-t "YYYY-M-D H:M:S"] [additional options] [dest]

DESCRIPTION

       crm_report - Create a tarball containing everything needed when reporting cluster problems

OPTIONS

       -V     increase verbosity

       -v,--version
	      software version

       --features
	      software features

       -f, --from time
	      time to start from: "YYYY-M-D H:M:S"  (do not forget the quotes)

       -t, --to time
	      time to finish at (default: now)

       -T, --cts test
	      CTS test or set of tests to extract

       --cts-log
	      CTS master logfile

       -n, --nodes nodes
	      node names for this cluster only needed if the cluster is not active on the current machine accepts both -n "a b" and -n a -n b

       -l, --logfile file
	      log file to collect, normally this will be determined automatically

       -p patt
	      additional regular expression to match variables to be removed (default: "passw.*")

       -L patt
	      additional regular expression to match in log files for analysis (default: CRIT: ERROR:)

       -M     collect only the logs specified by -l

       -S, --single-node
	      single node operation; don't try to start report collectors on other nodes

       -c, --cluster type
	      force the cluster type (corosync,openais,heartbeat,logmaster)

       -A, --openais
	      force the cluster type to be OpenAIS

       -C, --corosync
	      force the cluster type to be CoroSync

       -H, --heartbeat
	      force the cluster type to be Heartbeat

       -u, --user user
	      ssh username for cluster nodes (default: root)

       --dest a custom destination directory/file

       dest   a custom destination directory/file

EXAMPLES

	      crm_report  -f  "2011-12-14 13:05:00" unexplained-apache-failure crm_report -f 2011-12-14 -t 2011-12-15 something-that-took-multiple
	      days crm_report -f 13:05:00   -t 13:12:00   brief-outage

1.1.7 - ee0730e13d124c3d58f00016c3376a1de5323cff		    April 2012								  1.1.7(8)