Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Abnormality while piping tr command output to sed
Top Forums Shell Programming and Scripting Abnormality while piping tr command output to sed Post 302746565 by Don Cragun on Wednesday 19th of December 2012 03:48:49 PM
Old 12-19-2012
Quote:
Originally Posted by chidori
I have the file in unix system only and i dont see any any extra character. I am using solaris 10 .
Code:
# cat myfile
alpha
beta
gamma

# od -c myfile
0000000   a   l   p   h   a  \n   b   e   t   a  \n   g   a   m   m   a
0000020  \n
0000021
#

Code:
# tr -s '\n' ',' < myfile | sed 's/,$//'
#

I have tried this with bourne and bash shell. not same result.

sed path : /bin/sed

I tried with xpg4 path and output looks promising but with a warning message

Code:
# tr -s '\n' ',' < myfile | /usr/xpg4/bin/sed 's/,$//'
sed: Missing newline at end of file standard input.
alpha,beta,gamma

---------- Post updated at 03:16 PM ---------- Previous update was at 03:10 PM ----------

@Don Cragun your code worked. I am not able to get the point on why this behaviour is seen. why does a strip of trailing newlines piped to sed/awk wont work ?
The sed and awk utilities are only defined to work on text files. If the last line fed to sed or awk does not end in a <newline> character, the results are unspecified. Basically, sed and awk try to read in a line, and until they find the terminating <newline> character they don't have a line; so the partial line at the end of the file may be ignored as Solaris 10's /usr/bin/sed did. Or as Solaris 10's /usr/xpg4/bin/sed did; it can add the newline for you and warn you that it did so. Some versions of sed will silently add the trailing <newline> without a warning. Which behavior is better depends on the source of your data. (If your data source dies in the middle of transmitting/producing your data, the warning lets you know that data from the end of your input stream may have been lost.)
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Piping output to while read

Hi. Im using cat to output the contents of a file, then piping it to my while read loop.In this loop variables get assigned values. However when i try to use the variables outside the loop their values has been reset.I understand about subshells etc. but I have no idea how to "preserve" the... (3 Replies)
Discussion started by: Ultimodiablo
3 Replies

2. UNIX for Dummies Questions & Answers

piping the output of find command to grep

Hi, I did not understand why the following did not work out as I expected: find . -name "pqp.txt" | grep -v "Permission" I thought I would be able to catch whichever paths containing my pqp.txt file without receiving the display of messages such as "find: cannot access... Permisson... (1 Reply)
Discussion started by: 435 Gavea
1 Replies

3. Shell Programming and Scripting

piping output to echo

Hi, I was wondering why ls * | echo does not print the contents of the directory to the screen? The way I see it, ls * returns a whole lot of information, and then we pipe all this info to echo, so surely it should all come to our screen! Is there a serious flaw in my understanding? ... (3 Replies)
Discussion started by: A1977
3 Replies

4. Shell Programming and Scripting

piping output of tail running in background

Not sure why this does not work in bash: tail -f err.log |& -bash: syntax error near unexpected token `&' I am attempting to continuously read a file that is being updated by doing a "tail -f" on the file and piping the output to stdin which can then be read by the next shell command Thnx (4 Replies)
Discussion started by: anuramdas
4 Replies

5. Shell Programming and Scripting

piping oracle output to a file?

Hi All... Does anyone know how to pipe the output of a "select" statement from a call to Oracle to a file? ANy ideas woule be greatly appreciated! Code is as below... echo "producing CSV file 2..." sqlplus -s $username/$password@$database<<EOF set serveroutput on size 1000000 set... (13 Replies)
Discussion started by: satnamx
13 Replies

6. Shell Programming and Scripting

Piping and assigning output to a variable in Perl

Hi All, I am trying to convert the below Csh code into Perl. But i have the following error. Can any expert help ? Error: ls: *tac: No such file or directory Csh set $ST_file = `ls -rt *$testid*st*|tail -1`; Perl my $ST_file = `ls -rt *$testid*st*|tail -1`; (10 Replies)
Discussion started by: Raynon
10 Replies

7. Shell Programming and Scripting

Piping output from a command into bash script

Hi all. I am using procmail to deliver an email to a script I am developing. Procmail delivers the email to the script on standard input. I imagine this is the same as piping input from a command into the script. Hence I've been testing my script by running echo 'test' | sms-autosend-backup.sh ... (2 Replies)
Discussion started by: akindo
2 Replies

8. Shell Programming and Scripting

need help piping the output from an app... uh, yeah...

Ok, so there is a perl script that runs as a server, on my local host. It tells me which port to use. I want to pipe that output into my browser so I can do the whole thing with a single command. The problem is, I think, that the program doesn't actually exit cause it's running a server, so...... (6 Replies)
Discussion started by: ninjaaron
6 Replies

9. Shell Programming and Scripting

Piping output of ls to a text file

Basically I was wondering if any of you know how to pipe the output of ls to a text file? so in my shell script one of the lines is ls but i want to pipe it into a file called directory listing. Cheers. I have tried ls | Directorylisting.txt but it keeps saying " line 7: DirectoryListing.txt:... (9 Replies)
Discussion started by: LinuxNubBrah
9 Replies

10. UNIX for Beginners Questions & Answers

Facing abnormality in Find command

Whenever the below command is being executed by a scheduler at UNIX environment, we are getting below error cd /tmp/log find . -ignore_readdir_race ! -name . -prune -iname 'XYZ*' -type f -mtime +4 -printf "%f\n" ./tmpfile.script_name.2.31885.201906071336.tmp': No such file or directory... (2 Replies)
Discussion started by: Anirban2208
2 Replies

LEARN ABOUT DEBIAN

largefile

largefile(5)                                            Standards, Environments, and Macros                                           largefile(5)

NAME

       largefile - large file status of utilities

DESCRIPTION

       A  large file is a regular file whose size is greater than or equal to 2 Gbyte ( 2**31 bytes). A small file is a regular file whose size is
       less than 2 Gbyte.

   Large file aware utilities
       A utility is called large file aware if it can process large files in the same manner as it does small files. A utility that is large  file
       aware is able to handle large files as input and generate as output large files that are being processed. The exception is where additional
       files  are used as system configuration files or support files that can augment the processing. For example, the file utility supports  the
       -m  option  for  an  alternative "magic" file and the -f option for a support file that can contain a list of file names. It is unspecified
       whether a utility that is large file aware will accept configuration or support files that are large files. If a large file  aware  utility
       does  not accept configuration or support files that are large files, it will cause no data loss or corruption upon encountering such files
       and will return an appropriate error.

       The following /usr/bin utilities are large file aware:

       adb           awk           bdiff         cat           chgrp
       chmod         chown         cksum         cmp           compress
       cp            csh           csplit        cut           dd
       dircmp        du            egrep         fgrep         file
       find          ftp           getconf       grep          gzip
       head          join          jsh           ksh           ln
       ls            mdb           mkdir         mkfifo        more
       mv            nawk          page          paste         pathchck
       pg            rcp           remsh         rksh          rm
       rmdir         rsh           sed           sh            sort
       split         sum           tail          tar           tee
       test          touch         tr            uncompress    uudecode
       uuencode      wc            zcat

       The following /usr/xpg4/bin utilities are large file aware:

       awk           cp            chgrp         chown         du
       egrep         fgrep         file          grep          ln
       ls            more          mv            rm            sed
       sh            sort          tail          tr

       The following /usr/xpg6/bin utilities are large file aware:

       getconf       ls            tr

       The following /usr/sbin utilities are large file aware:

       install       mkfile        mknod         mvdir         swap

       See the USAGE section of the swap(1M) manual page for limitations of swap on block devices greater than 2 Gbyte on a 32-bit operating  sys-
       tem.

       The following /usr/ucb utilities are large file aware:

       chown         from          ln            ls            sed
       sum           touch

       The /usr/bin/cpio and /usr/bin/pax utilities are large file aware, but cannot archive a file whose size exceeds 8 Gbyte - 1 byte.

       The /usr/bin/truss utilities has been modified to read a dump file and display information relevant to large files, such as offsets.

   cachefs file systems
       The following /usr/bin utilities are large file aware for cachefs file systems:

       cachefspack      cachefsstat

       The following /usr/sbin utilities are large file aware for cachefs file systems:

       cachefslog       cachefswssize   cfsadmin         fsck
       mount            umount

   nfs file systems
       The following utilities are large file aware for nfs file systems:

       /usr/lib/autofs/automountd    /usr/sbin/mount
       /usr/lib/nfs/rquotad

   ufs file systems
       The following /usr/bin utility is large file aware for ufs file systems:

              df

       The following /usr/lib/nfs utility is large file aware for ufs file systems:

              rquotad

       The following /usr/xpg4/bin utility is large file aware for ufs file systems:

              df

       The following /usr/sbin utilities are large file aware for ufs file systems:

       clri          dcopy         edquota       ff            fsck
       fsdb          fsirand       fstyp         labelit       lockfs
       mkfs          mount         ncheck        newfs         quot
       quota         quotacheck    quotaoff      quotaon       repquota
       tunefs        ufsdump       ufsrestore    umount

   Large file safe utilities
       A  utility  is called large file safe if it causes no data loss or corruption when it encounters a large file. A utility that is large file
       safe is unable to process properly a large file, but returns an appropriate error.

       The following /usr/bin utilities are large file safe:

       audioconvert     audioplay    audiorecord    comm          diff
       diff3            diffmk       ed             lp            mail

       mailcompat       mailstats    mailx          pack          pcat
       red              rmail        sdiff          unpack        vi
       view

       The following /usr/xpg4/bin utilities are large file safe:

       ed            vi            view

       The following /usr/xpg6/bin utility is large file safe:

       ed

       The following /usr/sbin utilities are large file safe:

       lpfilter      lpforms

       The following /usr/ucb utilities are large file safe:

       Mail          lpr

       The following /usr/lib utility is large file safe:

              sendmail

SEE ALSO

       lf64(5), lfcompile(5), lfcompile64(5)

SunOS 5.10                                                          7 Nov 2003                                                        largefile(5)
All times are GMT -4. The time now is 07:06 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy