Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to Avoid intermediate files when pipe does nt work
Top Forums Shell Programming and Scripting How to Avoid intermediate files when pipe does nt work Post 302284070 by w020637 on Wednesday 4th of February 2009 04:49:31 PM
Old 02-04-2009
How to Avoid intermediate files when pipe does nt work
problem with piping one output to another.Would like to avoid the intermediate file creation.The piping does nt work on places where files have been created and goes in an endless loop.


sed -e "s/^\.\///g" $LINE1| sed -e "s/_\([a-zA-Z]\)/kkk\1/g" > $file1
tr -s '_' ' ' < $file1| \
sort -n -k 1.1,1.1 -k 2.1,2.8 -k 3.1,3.6 | \
awk '{ arr[$1]=$0 } END {for (i in arr) { print arr[i] } }' | \
tr '_' ' ' | sort > $resultsfile
sed -e "s/ [ ]*/_/g" $resultsfile |sed -e "s/^_//g"|sed -e "s/_$//g"| \
grep -v "^$"|sed -e "s/kkk/_/g"| while read LINE4
do
process
done
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help needed in removing intermediate segments from a pipe delimited segment file

Hi, I just stuckup in doing some regular expressions on a file. I have data which has multiple FHS and BTS segments like: FHS|12121|LOCAL|2323 MSH|10101|POTAMAS|2323 PID|121221|THOMAS|DAVID|23432 OBX|2342|H1211|3232 BTS|0000|MERSTO|LIABLE FHS|12121|LOCAL|2323 MSH|10101|POTAMAS|2323... (3 Replies)
Discussion started by: naren_0101bits
3 Replies

2. Shell Programming and Scripting

Avoid files being archived

hi all, i want to write a shell script which can automatically touch my all files within a folder in an interval of 90 days ...so that i can avoid them being archived. I don't want to manually touch the all files instead i want an automated shell script to do this. Thanks in advance, Om (3 Replies)
Discussion started by: koti
3 Replies

3. UNIX for Dummies Questions & Answers

How does pipe work?

I am confused over piping. :confused: A | B Will A and B run at the same time? or must A finish running before B starts to run? Suppose I want to do the following: sqlplus ... | split -1000 - filename_ sqlplus will return 1million rows, I want write the output into files of 1000... (4 Replies)
Discussion started by: Leion
4 Replies

4. Shell Programming and Scripting

How to avoid duplication within 2 files?

Hi all, Actually 2 files are there - file1, file2. file1 contains ---> london mosco america russia mosco file2 contains --> europe india japan mosco england london Question is I want to print all the city names without duplication cities in those... (10 Replies)
Discussion started by: balan_mca
10 Replies

5. Shell Programming and Scripting

initializing loop to delete intermediate output files

Hi, I am running a script which produces a number of intermediate output files for each time step. is there a way to remove these intermediate files and just retain the final output at every end of the loop, like sort of an initialization process? this the inefficient way i do it. for i in... (3 Replies)
Discussion started by: ida1215
3 Replies

6. Shell Programming and Scripting

pipe to grep doesn't work in bash script

Hi, I'm trying to write a script that checks gvfs to see if a mount exists so I can run it from network-manager's status hooks. I thought I'd pipe the output of gvfs-mount -l to grep for the particular mounts I care about. When I do this in a bash script: cmnd="gvfs-mount -l | grep -i... (4 Replies)
Discussion started by: kcstrom
4 Replies

7. Shell Programming and Scripting

piping from grep to awk without intermediate files

I am trying to extract the file names alone, for example "TVLI_STATS_NRT_XLSTWS03_20120215_132629.csv", from below output which was given by the grep. sam:/data/log: grep "C10_Subscribe.000|subscribe|newfile|" PDEWG511_TVLI_JOB_STATS.ksh.201202* Output: ... (6 Replies)
Discussion started by: siteregsam
6 Replies

8. Shell Programming and Scripting

How to avoid ssh :Write failed: Broken pipe?

Hello, I am trying to run some code on Matlab over ssh . The code takes around 5-6 hours to complete. so after giving the command to run it , I locked my machine and then went off to sleep at night, only to discover in the morning that I get this message : ...Code running, partial results... (1 Reply)
Discussion started by: ajayram
1 Replies

9. Shell Programming and Scripting

Why does bc work with 'here string' and not via pipe in this example?

Hi! I actually got it running, but I still would like to understand, why and how, since I am a beginner in bash scripting. I Need floating numbers and thus use bc in my bash script. Here it is: #!/bin/bash num1="10^-15" | bc -l #power function piped to bc - DOES NOT WORK echo $num1... (4 Replies)
Discussion started by: McHale
4 Replies

10. Shell Programming and Scripting

Would pipe work better with this command

Hi again, have a script that I would like run, but before I can run it I need to strip out the windows \r end of lines. I have put the command into a text file and set the command to run every 10 seconds the coomand I use to do this is while sleep 10; do... (15 Replies)
Discussion started by: Paul Walker
15 Replies

LEARN ABOUT CENTOS

fop

FOP(1)								   User Commands							    FOP(1)

NAME

       fop - Command line wrapper for the java version of fop.

DESCRIPTION

       Apache  FOP (Formatting Objects Processor) is a print formatter driven by XSL formatting objects (XSL-FO) and an output independent format-
       ter. It is a Java application that reads a formatting object (FO) tree and renders the resulting pages to a specified output.  Output  for-
       mats  currently	supported  include  PDF, PS, PCL, AFP, XML (area tree representation), Print, AWT and PNG, and to a lesser extent, RTF and
       TXT. The primary output target is PDF.

SYNOPSIS

       fop [options] [-fo|-xml] infile [-xsl file] [-awt|-pdf|-mif|-rtf|-tiff|-png|-pcl|-ps|-txt|-at [mime]|-print] <outfile>

OPTIONS

       -version
	      print FOP version and exit

       -d     debug mode

       -x     dump configuration settings

       -q     quiet mode

       -c cfg.xml
	      use additional configuration file cfg.xml

       -l lang
	      the language to use for user information

       -r     relaxed/less strict validation (where available)

       -dpi xxx
	      target resolution in dots per inch (dpi) where xxx is a number

       -s     for area tree XML, down to block areas only

       -v     run in verbose mode (currently simply print FOP version and continue)

       -o [password]
	      PDF file will be encrypted with option owner password

       -u [password]
	      PDF file will be encrypted with option user password

       -noprint
	      PDF file will be encrypted without printing permission

       -nocopy
	      PDF file will be encrypted without copy content permission

       -noedit
	      PDF file will be encrypted without edit content permission

       -noannotations
	      PDF file will be encrypted without edit annotation permission

       -a     enables accessibility features (Tagged PDF etc., default off)

       -pdfprofile prof
	      PDF file will be generated with the specified profile (Examples for prof: PDF/A-1b or PDF/X-3:2003)

       -conserve
	      Enable memory-conservation policy (trades memory-consumption for disk I/O) (Note: currently only influences whether the area tree is
	      serialized.)

INPUT

       infile xsl:fo input file (the same as the next) (use '-' for infile to pipe input from stdin)

       -fo    infile	   xsl:fo input file

       -xml infile
	      xml input file, must be used together with -xsl

       -atin infile
	      area tree input file

       -ifin infile
	      intermediate format input file

       -imagein infile
	      image input file (piping through stdin not supported)

       -xsl stylesheet
	      xslt stylesheet

       -param name value <value> to use for parameter <name> in xslt stylesheet
	      (repeat '-param name value' for each parameter)

       -catalog
	      use catalog resolver for input XML and XSLT files

OUTPUT

       outfile
	      input will be rendered as PDF into outfile (use '-' for outfile to pipe output to stdout)

       -pdf outfile
	      input will be rendered as PDF (outfile req'd)

       -pdfa1b outfile
	      input will be rendered as PDF/A-1b compliant PDF (outfile req'd, same as "-pdf outfile -pdfprofile PDF/A-1b")

       -awt   input will be displayed on screen

       -rtf outfile
	      input will be rendered as RTF (outfile req'd)

       -pcl outfile
	      input will be rendered as PCL (outfile req'd)

       -ps outfile
	      input will be rendered as PostScript (outfile req'd)

       -afp outfile
	      input will be rendered as AFP (outfile req'd)

       -tiff outfile
	      input will be rendered as TIFF (outfile req'd)

       -png outfile
	      input will be rendered as PNG (outfile req'd)

       -txt outfile
	      input will be rendered as plain text (outfile req'd)

       -at [mime] out
	      representation  of  area	tree  as  XML (outfile req'd) specify optional mime output to allow the AT to be converted to final format
	      later

       -if [mime] out
	      representation of document in intermediate format XML (outfile req'd) specify optional mime output to allow the IF to  be  converted
	      to final format later

       -print input file will be rendered and sent to the printer see options with "-print help"

       -out mime outfile input will be rendered using the given MIME type
	      (outfile req'd) Example: "-out application/pdf D:out.pdf" (Tip: "-out list" prints the list of supported MIME types)

       -svg outfile
	      input will be rendered as an SVG slides file (outfile req'd) Experimental feature - requires additional fop-sandbox.jar.

       -foout outfile
	      input will only be XSL transformed. The intermediate XSL-FO file is saved and no rendering is performed.	(Only available if you use
	      -xml and -xsl parameters)

EXAMPLES

	      fop foo.fo foo.pdf

	      fop -fo foo.fo -pdf foo.pdf (does the same as the previous line)

	      fop -xml foo.xml -xsl foo.xsl -pdf foo.pdf

	      fop -xml foo.xml -xsl foo.xsl -foout foo.fo

	      fop -xml - -xsl foo.xsl -pdf -

	      fop foo.fo -mif foo.mif

	      fop foo.fo -rtf foo.rtf

	      fop foo.fo -print

	      fop foo.fo -awt

HYPENATION

       fop can make use of external hyphenation rules that can be supplied in the form	of  a  hyphenation  jar.  You  can  find  such	a  one	at
       http://offo.sourceforge.net/.

       To  actually  use  that,  set  the FOP_HYPHENATION_PATH environment variable to the full path of this file, or use configuration files, see
       below.

CONFIGURATION FILES

       fop reads two configuration files on startup: /etc/fop.conf and $HOME/.foprc. These are plain shell script files where you can  define  for
       instance the FOP_HYPHENATION_PATH variable.

JAVA-WRAPPERS NOTE
       This  program  is  a shell script wrapper based on java-wrappers(7). You therefore benefit from several features; please see the java-wrap-
       pers(7) manual page for more information about them.

AUTHOR

       Wrapper author: Ola Lundqvist <opal@debian.org>

       This manual page was written by Mathieu Malaterre <mathieu.malaterre@gmail.com>, for the Debian project (and may be used by others).

SEE ALSO

       fop-ttfreader(1), java-wrappers(7).

fop Version 1.0 						   January 2012 							    FOP(1)
All times are GMT -4. The time now is 01:41 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy