Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Consolidating multiple outputs in one file
Top Forums Shell Programming and Scripting Consolidating multiple outputs in one file Post 303013503 by joeyg on Thursday 22nd of February 2018 07:57:51 AM
Old 02-22-2018
Conceptual...
OK, then you have 3 programs running that create output.
Would seem that you would want to create one watcher program, perhaps run at regular interval via a cron job.
The watcher program would look to see if the three output files have been created. It would then combine the three files into one.

Some things to consider - is this daily?
Because then you may want to also check to see if you have already created the combined file; thus perhaps checking for the "NOT" existence of the daily combined file.

Another consideration - the order or organization of the combined file. Should the files be combined in the order completed or another order.
This User Gave Thanks to joeyg For This Post:
mirwasim
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Consolidating Pipes

This is something I've given a lot of thought to and come up with no answer. Say you have a data stream passing from a file, through process A, into process B. Process A only modifies a few bytes of the stream, then prints the rest of the stream unmodified. Is there any way to stream the file... (4 Replies)
Discussion started by: Corona688
4 Replies

2. Shell Programming and Scripting

problems with a script that outputs data to a file

First of all, im a total newbie to the point that i do not know what are the terms to search for my problem. I did however spend the rest of the day today trying to figure out what is wrong with my bash script. ive always thought that the best way to learn is to tackle a problem heads on. but at... (1 Reply)
Discussion started by: joeribut
1 Replies

3. Shell Programming and Scripting

How to store multiple outputs from an awk command?

x=`echo $line | awk -F "|" '{print $1;print NR}'` How will I get the 2 return values ($1 and NR) from awk to variables? (4 Replies)
Discussion started by: tene
4 Replies

4. UNIX for Dummies Questions & Answers

Multiple Substring Outputs

Hello, I am reading a file with millions of lines in it. Each line is big line containing several xml tags. I need to Output just the value of two tags in a seperate flat file. For eg- I need to output whats present in <ComponentName> something </ComponentName> and another tag is... (2 Replies)
Discussion started by: sunnybehl
2 Replies

5. Shell Programming and Scripting

create outputs from other command outputs

hi friends, The code: i=1 while do filename=`/usr/bin/ls -l| awk '{ print $9}'` echo $filename>>summary.csv #Gives the name of the file stored at column 9 count=`wc -l $filename | awk '{print $1}'` echo $count>>summary.csv #Gives just the count of lines of file "filename" i=`expr... (1 Reply)
Discussion started by: rajsharma
1 Replies

6. UNIX for Dummies Questions & Answers

multiple variables assignement (stdout/stderr outputs)

Hi all, I've been looking around for this for a while and can't seem to find a satifactory way to do what I want: I would like to assign the output of stdout to a variable and that of stderr to another one, and this without using temporary files/named pipes. In other words be able to assign... (4 Replies)
Discussion started by: anthalamus
4 Replies

7. Shell Programming and Scripting

simple join for multiple files and produce 3 outputs

sh script file1 filea fileb filec ................filez. >>output1 & output2 &output3 file1 z10 1873 1920 z_number1_E59 z10 2042 2090 z_number2_E59 Z22 2476 2560 z_number3_E59 Z22 2838 2915 z_number4_E59 z1 1873 1920 z_number1_E60 z1 ... (9 Replies)
Discussion started by: stateperl
9 Replies

8. Shell Programming and Scripting

Array in awk outputs multiple values

Disclaimer: OP is 100% Awk beginner. I use this code on ASCII files I need to report against. awk 'BEGIN { tokens = 0 tokens = 0 tokens = 0 } { for (token in tokens) { if ($1 == token){print $0; tokens++;}}} END {for (token in tokens){ if( tokens ==... (1 Reply)
Discussion started by: alan
1 Replies

9. UNIX for Dummies Questions & Answers

Writing multiple outputs in to separate cells of CSV file

Hi I am writing a script which has multiple awk statements and each statement gives me a numeric count as an output. I want those output to be stored in different cells of a csv file. say 12 awk statements give 12 output and i want them in diffrenet cells of csv file. Thank you guys..!! (4 Replies)
Discussion started by: prabhat.diwaker
4 Replies

10. Shell Programming and Scripting

Returning multiple outputs of a single line based on previous repeated lines

Hello, I am trying to return a time multiple times from a file that has varying output just before the time instance, i.e. cat jumped cat jumped cat jumped time = 1.1 cat jumped cat jumped time = 1.2 cat jumped cat jumped time = 1.3 In this case i would like to output a time.txt... (6 Replies)
Discussion started by: ryddner
6 Replies

LEARN ABOUT DEBIAN

cracklib-unpacker

cracklib-format(8)					      Debian GNU/Linux manual						cracklib-format(8)

NAME

       cracklib-format, cracklib-packer, cracklib-unpacker - cracklib dictionary utilities

SYNOPSIS

       cracklib-format file ...

       cracklib-packer cracklib_dictpath

       cracklib-unpacker cracklib_dictpath

DESCRIPTION

       cracklib-format	takes a list of text files each containing a list of words, one per line, It lowercases all words, removes control charac-
       ters, and sorts the lists.  It outputs the cleaned up list to standard output.  The text files may be optionally compressed with gzip(1).

       If you supply massive amounts of text to cracklib-format you must have enough free space available for use by the sort(1) command.  If  you
       do not have 20Mb free in /var/tmp (or whatever temporary area your sort(1) command uses), have a look at the /usr/sbin/cracklib-format pro-
       gram which is a sh(1) program.  You can usually tweak the sort(1) command to use any large area of disk	you  desire,  by  use  of  the	-T
       option.	cracklib-format has a hook for this.

       cracklib-packer	reads  from  standard input a list of sorted and cleaned words and creates a database in the directory and prefix given by
       the command line argument cracklib_dictpath.  Three files are created with the suffixes of .hwm, .pwd, and .pwi.  These three files are	in
       the  format  that  the  FascistCheck(3) subroutine, cracklib-unpacker(8), and cracklib-check(8), utilities understand.  The number of words
       read and written are printed on stdout(3).

       cracklib-unpacker reads from the database in the directory and prefix given by the command line argument cracklib_dictpath and  outputs	on
       standard output the list of words that make up the database.

       The  database  is in a binary format generated by the utilities cracklib-format(8) and cracklib-packer(8).  On a Debian system the database
       is located in the directory /var/cache/cracklib/cracklib_dict and is generated daily with the program /etc/cron.daily/cracklib.	The  loca-
       tion  is  also  defined	in  the  header  file  crack.h using the constant CRACKLIB_DICTPATH though none of the subroutines in the cracklib
       libraries have this location hardcoded into their implementations.

FILES

       /var/cache/cracklib/cracklib_dict.[hwm|pwd|pwi]
	      cracklib dictionary database files used by utilities.

       /etc/cron.daily/cracklib
	      cracklib daily cron program to rebuild the cracklib dictionary database.

       /etc/cracklib/cracklib.conf
	      cracklib configuration file used by the cracklib daily cron program to rebuild the cracklib dictionary database.

       /usr/include/crack.h
	      cracklib header file defining the subroutine FascistCheck(3) and the constant CRACKLIB_DICTPATH used to compile in the  location	of
	      the cracklib dictionary database for these utilities.

       /usr/sbin/cracklib-format
	      cracklib shell script to create initial list of words for dictionary database.

SEE ALSO

       FascistCheck(3), cracklib-check(8), update-cracklib(8), create-cracklib-dict(8)
       /usr/share/doc/libcrack2/libcrack2.html
       /usr/share/doc/cracklib-runtime/cracklib-runtime.html

AUTHOR

       cracklib2 is written by Alec Muffett <alecm@crypto.dircon.co.uk>. Manual added by Jean Pierre LeJacq <jplejacq@quoininc.com>.

2.7-8.5 						   Sat Jun 21 22:43:12 CEST 2008					cracklib-format(8)
All times are GMT -4. The time now is 11:29 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy