Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Consolidating multiple outputs in one file
Top Forums Shell Programming and Scripting Consolidating multiple outputs in one file Post 303013561 by mirwasim on Friday 23rd of February 2018 08:06:39 AM
Old 02-23-2018
Quote:
Originally Posted by joeyg
OK, then you have 3 programs running that create output.
Would seem that you would want to create one watcher program, perhaps run at regular interval via a cron job.
The watcher program would look to see if the three output files have been created. It would then combine the three files into one.

Some things to consider - is this daily?
Because then you may want to also check to see if you have already created the combined file; thus perhaps checking for the "NOT" existence of the daily combined file.

Another consideration - the order or organization of the combined file. Should the files be combined in the order completed or another order.
i have worked it out by making a script and scheduling in cron
it keep on running and wait for the three file, once three files exist, it concatenate all the three in 1 and then send email

please close this thread
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Consolidating Pipes

This is something I've given a lot of thought to and come up with no answer. Say you have a data stream passing from a file, through process A, into process B. Process A only modifies a few bytes of the stream, then prints the rest of the stream unmodified. Is there any way to stream the file... (4 Replies)
Discussion started by: Corona688
4 Replies

2. Shell Programming and Scripting

problems with a script that outputs data to a file

First of all, im a total newbie to the point that i do not know what are the terms to search for my problem. I did however spend the rest of the day today trying to figure out what is wrong with my bash script. ive always thought that the best way to learn is to tackle a problem heads on. but at... (1 Reply)
Discussion started by: joeribut
1 Replies

3. Shell Programming and Scripting

How to store multiple outputs from an awk command?

x=`echo $line | awk -F "|" '{print $1;print NR}'` How will I get the 2 return values ($1 and NR) from awk to variables? (4 Replies)
Discussion started by: tene
4 Replies

4. UNIX for Dummies Questions & Answers

Multiple Substring Outputs

Hello, I am reading a file with millions of lines in it. Each line is big line containing several xml tags. I need to Output just the value of two tags in a seperate flat file. For eg- I need to output whats present in <ComponentName> something </ComponentName> and another tag is... (2 Replies)
Discussion started by: sunnybehl
2 Replies

5. Shell Programming and Scripting

create outputs from other command outputs

hi friends, The code: i=1 while do filename=`/usr/bin/ls -l| awk '{ print $9}'` echo $filename>>summary.csv #Gives the name of the file stored at column 9 count=`wc -l $filename | awk '{print $1}'` echo $count>>summary.csv #Gives just the count of lines of file "filename" i=`expr... (1 Reply)
Discussion started by: rajsharma
1 Replies

6. UNIX for Dummies Questions & Answers

multiple variables assignement (stdout/stderr outputs)

Hi all, I've been looking around for this for a while and can't seem to find a satifactory way to do what I want: I would like to assign the output of stdout to a variable and that of stderr to another one, and this without using temporary files/named pipes. In other words be able to assign... (4 Replies)
Discussion started by: anthalamus
4 Replies

7. Shell Programming and Scripting

simple join for multiple files and produce 3 outputs

sh script file1 filea fileb filec ................filez. >>output1 & output2 &output3 file1 z10 1873 1920 z_number1_E59 z10 2042 2090 z_number2_E59 Z22 2476 2560 z_number3_E59 Z22 2838 2915 z_number4_E59 z1 1873 1920 z_number1_E60 z1 ... (9 Replies)
Discussion started by: stateperl
9 Replies

8. Shell Programming and Scripting

Array in awk outputs multiple values

Disclaimer: OP is 100% Awk beginner. I use this code on ASCII files I need to report against. awk 'BEGIN { tokens = 0 tokens = 0 tokens = 0 } { for (token in tokens) { if ($1 == token){print $0; tokens++;}}} END {for (token in tokens){ if( tokens ==... (1 Reply)
Discussion started by: alan
1 Replies

9. UNIX for Dummies Questions & Answers

Writing multiple outputs in to separate cells of CSV file

Hi I am writing a script which has multiple awk statements and each statement gives me a numeric count as an output. I want those output to be stored in different cells of a csv file. say 12 awk statements give 12 output and i want them in diffrenet cells of csv file. Thank you guys..!! (4 Replies)
Discussion started by: prabhat.diwaker
4 Replies

10. Shell Programming and Scripting

Returning multiple outputs of a single line based on previous repeated lines

Hello, I am trying to return a time multiple times from a file that has varying output just before the time instance, i.e. cat jumped cat jumped cat jumped time = 1.1 cat jumped cat jumped time = 1.2 cat jumped cat jumped time = 1.3 In this case i would like to output a time.txt... (6 Replies)
Discussion started by: ryddner
6 Replies

LEARN ABOUT CENTOS

yum-cron

yum-cron(8)															       yum-cron(8)

NAME

       yum-cron - an interface to convieniently call yum from cron

SYNOPSIS

       yum-cron [config-file]

DESCRIPTION

       yum-cron  is  an  alternate  interface to yum that is optimised to be convenient to call from cron.  It provides methods to keep repository
       metadata up to date, and to check for, download, and apply updates.  Rather than accepting many different command line arguments, the  dif-
       ferent functions of yum-cron can be accessed through config files.

       config-file  is	used  to optionally specify the path to the configuration file to use.	If it is not given, the default configuration file
       will be used.  It is useful to be able to specify different configuration files for different use cases.  For  example,	one  configuration
       file  might  be set to update the repository metadata, and a line could be added to the crontab to run yum-cron frequently using this file.
       Then, another configuration file might be set to install updates, and yum-cron could be run from cron using this file just once each day.

FILES

       /etc/yum/yum-cron.conf
       /etc/yum/yum-cron-hourly.conf

SEE ALSO

       yum (8)

AUTHORS

       See the Authors file included with this program.

BUGS

       There of course aren't any bugs, but if you find any, you should email
	the mailing list, yum@lists.baseurl.org, or consult bugzilla.

Nick Jacek															       yum-cron(8)
All times are GMT -4. The time now is 10:50 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy