Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Consolidating multiple outputs in one file
Top Forums Shell Programming and Scripting Consolidating multiple outputs in one file Post 303013561 by mirwasim on Friday 23rd of February 2018 08:06:39 AM
Old 02-23-2018
Quote:
Originally Posted by joeyg
OK, then you have 3 programs running that create output.
Would seem that you would want to create one watcher program, perhaps run at regular interval via a cron job.
The watcher program would look to see if the three output files have been created. It would then combine the three files into one.

Some things to consider - is this daily?
Because then you may want to also check to see if you have already created the combined file; thus perhaps checking for the "NOT" existence of the daily combined file.

Another consideration - the order or organization of the combined file. Should the files be combined in the order completed or another order.
i have worked it out by making a script and scheduling in cron
it keep on running and wait for the three file, once three files exist, it concatenate all the three in 1 and then send email

please close this thread
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Consolidating Pipes

This is something I've given a lot of thought to and come up with no answer. Say you have a data stream passing from a file, through process A, into process B. Process A only modifies a few bytes of the stream, then prints the rest of the stream unmodified. Is there any way to stream the file... (4 Replies)
Discussion started by: Corona688
4 Replies

2. Shell Programming and Scripting

problems with a script that outputs data to a file

First of all, im a total newbie to the point that i do not know what are the terms to search for my problem. I did however spend the rest of the day today trying to figure out what is wrong with my bash script. ive always thought that the best way to learn is to tackle a problem heads on. but at... (1 Reply)
Discussion started by: joeribut
1 Replies

3. Shell Programming and Scripting

How to store multiple outputs from an awk command?

x=`echo $line | awk -F "|" '{print $1;print NR}'` How will I get the 2 return values ($1 and NR) from awk to variables? (4 Replies)
Discussion started by: tene
4 Replies

4. UNIX for Dummies Questions & Answers

Multiple Substring Outputs

Hello, I am reading a file with millions of lines in it. Each line is big line containing several xml tags. I need to Output just the value of two tags in a seperate flat file. For eg- I need to output whats present in <ComponentName> something </ComponentName> and another tag is... (2 Replies)
Discussion started by: sunnybehl
2 Replies

5. Shell Programming and Scripting

create outputs from other command outputs

hi friends, The code: i=1 while do filename=`/usr/bin/ls -l| awk '{ print $9}'` echo $filename>>summary.csv #Gives the name of the file stored at column 9 count=`wc -l $filename | awk '{print $1}'` echo $count>>summary.csv #Gives just the count of lines of file "filename" i=`expr... (1 Reply)
Discussion started by: rajsharma
1 Replies

6. UNIX for Dummies Questions & Answers

multiple variables assignement (stdout/stderr outputs)

Hi all, I've been looking around for this for a while and can't seem to find a satifactory way to do what I want: I would like to assign the output of stdout to a variable and that of stderr to another one, and this without using temporary files/named pipes. In other words be able to assign... (4 Replies)
Discussion started by: anthalamus
4 Replies

7. Shell Programming and Scripting

simple join for multiple files and produce 3 outputs

sh script file1 filea fileb filec ................filez. >>output1 & output2 &output3 file1 z10 1873 1920 z_number1_E59 z10 2042 2090 z_number2_E59 Z22 2476 2560 z_number3_E59 Z22 2838 2915 z_number4_E59 z1 1873 1920 z_number1_E60 z1 ... (9 Replies)
Discussion started by: stateperl
9 Replies

8. Shell Programming and Scripting

Array in awk outputs multiple values

Disclaimer: OP is 100% Awk beginner. I use this code on ASCII files I need to report against. awk 'BEGIN { tokens = 0 tokens = 0 tokens = 0 } { for (token in tokens) { if ($1 == token){print $0; tokens++;}}} END {for (token in tokens){ if( tokens ==... (1 Reply)
Discussion started by: alan
1 Replies

9. UNIX for Dummies Questions & Answers

Writing multiple outputs in to separate cells of CSV file

Hi I am writing a script which has multiple awk statements and each statement gives me a numeric count as an output. I want those output to be stored in different cells of a csv file. say 12 awk statements give 12 output and i want them in diffrenet cells of csv file. Thank you guys..!! (4 Replies)
Discussion started by: prabhat.diwaker
4 Replies

10. Shell Programming and Scripting

Returning multiple outputs of a single line based on previous repeated lines

Hello, I am trying to return a time multiple times from a file that has varying output just before the time instance, i.e. cat jumped cat jumped cat jumped time = 1.1 cat jumped cat jumped time = 1.2 cat jumped cat jumped time = 1.3 In this case i would like to output a time.txt... (6 Replies)
Discussion started by: ryddner
6 Replies

LEARN ABOUT OSF1

cron

cron(8) 						      System Manager's Manual							   cron(8)

NAME

       cron - The system clock daemon

SYNOPSIS

       /usr/sbin/cron

DESCRIPTION

       The cron daemon runs shell commands at specified dates and times.  Commands that are to run according to a regular or periodic schedule are
       found within the crontab files.	Commands that are to run once only are found within the at files.  You submit crontab and at file  entries
       by  using  the  crontab	and  at  commands.  Because the cron process exits only when killed or when the system stops, only one cron daemon
       should exist on the system at any given time.  Normally, you start the cron daemon from within a run command file.

       During process initialization and when cron detects a change, it examines the crontab and at files.  This strategy reduces the overhead	of
       checking  for  new  or  changed files at regularly scheduled intervals.	The cron command creates a log of its activities.  The cron daemon
       must be started from the system startup scripts because it must begin execution without a login user ID set.  The cron daemon  starts  each
       job  with the following process attributes stored with the job by the invoking process: Login user ID Effective and real user IDs Effective
       and real group IDs Supplementary groups

       It also establishes the following attributes from the authentication profile of the account associated with the login user ID of the invok-
       ing process: Audit control and disposition masks Kernel authorizations

DIAGNOSTICS

       The at and batch programs will refuse to accept jobs submitted from processes whose login user ID is different from the real user ID.

FILES

       Specifies the command path.  Main cron directory Directory containing the crontab files.  List of allowed users.  List of denied users His-
       tory information for cron Queue description file for at, batch, and cron

RELATED INFORMATION

       Commands:  at(1), crontab(1), rc0(8), rc2(8), rc3(8)

       Files: queuedefs(4) delim off

																	   cron(8)
All times are GMT -4. The time now is 02:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy