Sponsored Content
Top Forums Shell Programming and Scripting Preserve output order when redirecting stdout and stderr Post 302382478 by radoulov on Thursday 24th of December 2009 04:30:04 AM
Old 12-24-2009
Quote:
For me those great tools was new, but I searched around for infos about
and the reason for the empty error.log is, that expect merges the stdout and stderr
together internal and afterwards the information, where the output comes from (stderr or stdout)
is gone away.
Yes,
that's why I said you'll still need to modify your program to distinguish error from output.
The idea is to "mark" the error with "error:" for example, and output with "output:" Smilie

Quote:
So if there is no way to use some wrapper "around" the binary or php script,
which adds the leading numbers and preserves the channel where the output was written
(so that stdout still is stdout and stderr still is stderr) this is not a working solution
for my problem ...
Well,
I don't know php, may be you should avoid using external commands and shell pipes in those cases.
I believe the only solution is to modify the libc you're using (I'm joking Smilie).

Could you explain why you need such a thing?
There could be a different, better way to solve your problem.

---------- Post updated 12-24-09 at 10:30 AM ---------- Previous update was 12-23-09 at 04:46 PM ----------

Well,
now that I think again, with shells that support process substitution you can do something like this:

Code:
prog 2> >(
  awk '{ 
    c++ || "date +%N" | getline sdt
    $0 = c ":" sdt ":ERR:" $0
    print > "err.log"
    }1' 
  ) > >(
    awk '{
      c++ || "date +%N" | getline sdt
      $0 = c ":" sdt ":OUT:" $0
      print > "out.log"
      }1'
    ) | 
      sort -n

Notice that here I'm using the N format specifier which is not portable. If your date implementation does not support it,
you can use Perl's Time::HiRes gettimeofday. We need it to get only the start time in order to be able to sort the output properly.

For example:
Code:
$ ./s 2> >(
  awk '{
    c++ || "date +%N" | getline sdt
    $0 = c ":" sdt ":ERR:" $0
print > "err.log"
}1'
  ) > >(
    awk '{
  c++ || "date +%N" | getline sdt
  $0 = c ":" sdt ":OUT:" $0
  print > "out.log"
  }1'
) |    sort -n > out_and_err.log
$ head *log
==> err.log <==
1:694103195:ERR:err 1
2:694103195:ERR:err 2
3:694103195:ERR:err 3
4:694103195:ERR:err 4
5:694103195:ERR:err 5

==> out_and_err.log <==
1:693535244:OUT:out 1
1:694103195:ERR:err 1
2:693535244:OUT:out 2
2:694103195:ERR:err 2
3:693535244:OUT:out 3
3:694103195:ERR:err 3
4:693535244:OUT:out 4
4:694103195:ERR:err 4
5:693535244:OUT:out 5
5:694103195:ERR:err 5

==> out.log <==
1:693535244:OUT:out 1
2:693535244:OUT:out 2
3:693535244:OUT:out 3
4:693535244:OUT:out 4
5:693535244:OUT:out 5
$

Here I'm using AWK, but you can use Perl or whatever scripting language you like.
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

sending syslog output to stderr or stdout

Is there a way to send the syslog output for a given facility to stderr or stdout? I do not want to use the "tail" command to achieve this, I would like it to go directly to stderr. Thanks in advance (1 Reply)
Discussion started by: dmirza
1 Replies

2. Shell Programming and Scripting

redirecting STDOUT & STDERR

In bash, I need to send the STDOUT and STDERR from a command to one file, and then just STDERR to another file. Doing one or the other using redirects is easy, but trying to do both at once is a bit tricky. Anyone have any ideas? (9 Replies)
Discussion started by: jshinaman
9 Replies

3. Shell Programming and Scripting

getting stderr & stdout output lively modified

This is about getting all output to stderr and stdout localized. Nothing to do with redirecting output to a file (there already are some interesting threads about that issue on this forum). What I intend to do is capturing all lines of text sent to the screen, compare them with an array of... (2 Replies)
Discussion started by: teo ramirez
2 Replies

4. Shell Programming and Scripting

Redirecting STDERR message to STDOUT & file at same time

Friends I have to redirect STDERR messages both to screen and also capture the same in a file. 2 > &1 | tee file works but it also displays the non error messages to file, while i only need error messages. Can anyone help?? (10 Replies)
Discussion started by: vikashtulsiyan
10 Replies

5. Shell Programming and Scripting

Redirecting part of output to stdout

Hi, I am trying to execute a command like this: find ./ -name "*.gz" -exec sh -c 'zcat {} | awk -f parse.awk' \; >> output If I want to print the filename, i generally use the -print argument to the find command but when I am redirecting the output to a file, how can I print just the... (2 Replies)
Discussion started by: Legend986
2 Replies

6. Shell Programming and Scripting

redirect stdout and stderr to file wrong order problem with subshell

Hello I read a lot of post related to this topic, but nothing helped me. :mad: I'm running a ksh script with subshell what processing some ldap command. I need to check output for possible errors. #!/bin/ksh ... readinput < $QCHAT_INPUT |& while read -p line do echo $line ... (3 Replies)
Discussion started by: Osim
3 Replies

7. Shell Programming and Scripting

File descriptors, redirecting output, and stdout

Hello all. I've been lurking here for a year or two and finally decided to post. I need some assistance with file descriptors, stdout, and redirecting output. I've searched through a number of very helpful threads here (unfortunately I can't link to any of them yet due to my low post count...),... (2 Replies)
Discussion started by: Michael_K
2 Replies

8. Shell Programming and Scripting

Redirecting STDERR to file and screen, STDOUT only to file

I have to redirect STDERR messages both to screen and also capture the same in a file but STDOUT only to the same file. I have searched in this formum for a solution, but something like srcipt 3>&1 >&2 2>&3 3>&- | tee errs doesn't work for me... Has anyone an idea??? (18 Replies)
Discussion started by: thuranga
18 Replies

9. Shell Programming and Scripting

Lost redirecting stderr & stdout to 3 files - one each plus combined

Hi folks I need/want to redirect output (stdout, stderr) from an exec call to separate files. One for stderr only and two(!) different (!) ones for the combined output of stderr and stdout. After some research and testing i got this so far : (( exec ${command} ${command_parameters} 3>&1... (6 Replies)
Discussion started by: MDominok
6 Replies

10. Shell Programming and Scripting

Redirecting stdout output to whiptail menu box

As a result of whiptail menu option I am getting a data from a file. Naturally it is output to terminal as stdour. I like to redirect the output back to the menu. It can be done with single input of line of text , see attached. I just cannot see where or how the sample... (0 Replies)
Discussion started by: annacreek
0 Replies
All times are GMT -4. The time now is 06:32 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy