How to Strip lines off Streamed EDI Output


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to Strip lines off Streamed EDI Output
# 8  
Old 11-19-2008
Code:
stdout | \                #pipe the output to awk, one line only
awk -F'~' '{              #set the field separator to ~
for(i=1;i<NF;i++)         #for each field except the last one(you don't have one anyway)
  { 
   if($i !~ /^[ISA|GS]/)  #if field Don't start with ISA or GS
      printf $i FS        #print(f) in the same line the field plus the field separator(~)
   }
}'

just copy/paste and try.

Last edited by danmero; 11-19-2008 at 12:19 PM.. Reason: typo
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

EDI File Parser

I've one EDI file which is to be parsed into 7 different file. I managed to extract required segments for a file(HEADER) to a separate file(sample3.dat) and is given below. $ cat sample3.dat REF*EI*273543997~ REF*2U*HELLO~ REF*G2*77685|132~ CLM*1000*0.00***12>B>1*N*A*Y*I~ CN1*05~... (5 Replies)
Discussion started by: ashokv3
5 Replies

2. UNIX for Dummies Questions & Answers

Strip out number from wc output?

I am trying to output two command substitutions echo "$(command) $(command)" with a single echo however when using wc -l within the second substitution, that substitution, instead of appearing in order at the end of the line output, it overwrites the beginning of the output line. I've tried... (2 Replies)
Discussion started by: somegeek
2 Replies

3. SCO

Add memory and EDI hard disk space

Dear all I would like to know if you have face to the problems as add 1. 256 MB DDR Ram memory 2. IDE 40 GB slaved hard-disk my current machine is GA-SIML Rev 1.0, 1.6 GHz CPU, 1GB HDD, 256 MB DDR-Ram memory, as I add another 256 DDR-Ram, and 40 GB Slaved EDI Hard disk it, the systems... (1 Reply)
Discussion started by: TinhNhi
1 Replies

4. Shell Programming and Scripting

parsing issue with edi file

Hello, We have edi files we need to do some extra parsing on. There is a line that shows up that looks like this: GE|8,845|000000000 We need to parse the file, find the line ( that begins with GE "^GE" ), and remove the comma(s). What is the easiest way to do that ? I know I can grab... (5 Replies)
Discussion started by: fwellers
5 Replies

5. Shell Programming and Scripting

KSH Output/Strip portion of file in HP-UX

I have a file, we'll call it file.txt. It has thousands of lines of all kinds of output at any given time (ie. foo bar foo bar) I need to copy out just a portion of the file from Point-A to Point-B. I'd like to save off just that portion to a file called test123xyz.txt. How do I do that? ... (7 Replies)
Discussion started by: austin881
7 Replies

6. Shell Programming and Scripting

Strip one line from 2 blank lines in a file

Hi Is there any command to scan thru a file looking for 2 consecutive blank lines and if any remove one of them. Please let me know. Regards, Tipsy (6 Replies)
Discussion started by: tipsy
6 Replies

7. Shell Programming and Scripting

strip first 4 and last 2 lines from a file using perl

Hi I have a file from which i need to remove the first 4 and the last 2 lines.. i know how to do it with sed but i need to do it in a perl script.. can you please help me how to do that. Thanks (10 Replies)
Discussion started by: meghana
10 Replies

8. Shell Programming and Scripting

How do you buffer streamed lines?

If I am running a cat|awk|sed on a file to get a bunch of numbers between 1 and 500 billion, how can I stay in stream, and still compare "this value" with "the previous value"? Really I could do this all in Perl, but if I can get it to work in-stream, its gonna be TONS faster... even if I can... (14 Replies)
Discussion started by: jjinno
14 Replies

9. Shell Programming and Scripting

Strip 3 header lines and 4 trailer lines

Hello friends, I want to remove 3 header lines and 4 trailer lines, I am using following , is it correct ? sed '1,3d';'4,$ d' filename (9 Replies)
Discussion started by: ganesh123
9 Replies
Login or Register to Ask a Question
sed(1)							      General Commands Manual							    sed(1)

NAME
sed - stream text editor SYNOPSIS
script [file]... script]... script_file]... [file]... DESCRIPTION
copies the named text files (standard input default) to the standard output, edited according to a script containing up to 100 commands. Only complete input lines are processed. Any input text at the end of a file that is not terminated by a new-line character is ignored. Options recognizes the following options: Take script from file script_file. Edit according to script. If there is just one option and no options, the flag can be omitted. Suppress the default output. interprets all and arguments in the order given. Use caution, if mixing and options, to avoid unpredictable or incorrect results. Command Scripts A script consists of editor commands, one per line, of the following form: [address address]] function [arguments] In normal operation, cyclically copies a line of input into a pattern space (unless there is something left after a command), applies in sequence all commands whose addresses select that pattern space, and, at the end of the script, copies the pattern space to the standard output (except under and deletes the pattern space. Some of the commands use a hold space to save all or part of the pattern space for subsequent retrieval. Command Addresses An address is either a decimal number that counts input lines cumulatively across files, a which addresses the last line of input, or a context address; that is, a in the style of ed(1) modified thus: o In a context address, the construction where ? is any character, is identical to Note that in the context address the second stands for itself, so that the regular expression is o The escape sequence matches a new-line character embedded in the pattern space. o A period matches any character except the terminal new-line of the pattern space. o A command line with no addresses selects every pattern space. o A command line with one address selects each pattern space that matches the address. o A command line with two addresses selects the inclusive range from the first pattern space that matches the first address through the next pattern space that matches the second (if the second address is a number less than or equal to the line number first selected, only one line is selected). Thereafter the process is repeated, looking again for the first address. supports Basic Regular Expression syntax (see regexp(5)). Editing commands can also be applied to only non-selected pattern spaces by use of the negation function (described below). Command Functions In the following list of functions, the maximum number of permissible addresses for each function is indicated in parentheses. Other func- tion elements are interpreted as follows: text One or more lines, all but the last of which end with to hide the new-line. Backslashes in text are treated like back- slashes in the replacement string of an command, and can be used to protect initial blanks and tabs against the strip- ping that is done on every script line. rfile Must terminate the command line, and must be preceded by exactly one blank. wfile Must terminate the command line, and must be preceded by exactly one blank. Each wfile is created before processing begins. There can be at most 10 distinct wfile arguments. recognizes the following functions: text Append. Place text on the output before reading next input line. Branch to the command bearing label. If no label is specified, branch to the end of the script. text Change. Delete the pattern space. With 0 or 1 address or at the end of a 2-address range, place text on the output. Start the next cycle. Delete pattern space and start the next cycle. Delete initial segment of pattern space through first new-line and start the next cycle. Replace contents of the pattern space with contents of the hold space. Append contents of hold space to the pattern space. Replace contents of the hold space with contents of the pattern space. Append the contents of the pattern space to the hold space. text Insert. Place text on the standard output. List the pattern space on the standard output in an unambiguous form. Non-printing characters are spelled in three-digit octal number format (with a preceding backslash), and long lines are folded. Copy the pattern space to the standard output if the default output has not been suppressed (by the option on the command line or the command in the script file). Replace the pattern space with the next line of input. Append the next line of input to the pattern space with an embedded new-line. (The current line number changes.) Print. Copy the pattern space to the standard output. Copy the initial segment of the pattern space through the first new-line to the standard output. Quit. Branch to the end of the script. Do not start a new cycle. Read contents of rfile and place on output before reading the next input line. Substitute replacement string for instances of regular expression in the pattern space. Any character can be used instead of For a fuller description see ed(1). flags is zero or more of: n n=1-2048 Substitute for just the nth occurrence of regular expression in the pattern space. Global. Substitute for all non-overlapping instances of regular expression rather than just the first one. Print the pattern space if a replacement was made and the default output has been suppressed (by the option on the command line or the command in the script file). Under the environment (see standards(5)), the pattern space is printed twice, if the option is not specified on the command line. Write. Append the pattern space to wfile if a replacement was made. Test. Branch to the command bearing the label if any substitutions have been made since the most recent reading of an input line or execution of a If label is empty, branch to the end of the script. Write. Append the pattern space to wfile. Exchange the contents of the pattern and hold spaces. Transform. Replace all occurrences of characters in string1 with the corresponding character in string2. The lengths of string1 and string2 must be equal. Any character other than backslash or newline can be used instead of slash to delimit the two strings. If a backslash character is immediately followed by another backslash character in string1 or string2, the two backslash char- acters will be handled as a single literal backslash character. The delimiter itself can be used as a literal character in string1 and string2 if it is preceded by a backslash. The only exception is character "n" as the delimiter, because backslash-n, " ", will be interpreted as a newline. The meaning of a backslash is undefined if it is followed by any character that is not "n", a backslash, or the delimiter char- acter. Don't. Apply the function (or group, if function is only to lines selected by the address or addresses. This command does nothing; it bears a label for and commands to branch to. Place the current line number on the standard output as a line. Execute the following commands through a matching only when the pattern space is selected. The syntax is: (0) An empty command is ignored. If a appears as the first character on the first line of a script file, that entire line is treated as a comment with one exception: If the character after the is an the default output is suppressed. The rest of the line after is also ignored. A script file must contain at least one non-comment line. EXTERNAL INFLUENCES
For information about the UNIX Standard environment, see standards(5). Environment Variables provides a default value for the internationalization variables that are unset or null. If is unset or null, the default value of "C" (see lang(5)) is used. If any of the internationalization variables contains an invalid setting, will behave as if all internationalization variables are set to "C". See environ(5). If set to a non-empty string value, overrides the values of all the other internationalization variables. determines the interpretation of text as single and/or multi-byte characters, the classification of characters as printable, and the char- acters matched by character class expressions in regular expressions. determines the locale that should be used to affect the format and contents of diagnostic messages written to standard error and informa- tive messages written to standard output. determines the location of message catalogues for the processing of International Code Set Support Single- and multi-byte character code sets are supported. EXAMPLES
Make a simple substitution in a file from the command line or from a shell script, changing to Same as above but use shell or environment variables and in search and replacement strings: or Multiple substitutions in a single command: or WARNINGS
limits command scripts to a total of not more than 100 commands. The hold space is limited to 8192 characters. processes only text files. See the glossary for a definition of text files and their limitations. AUTHOR
was developed by OSF and HP. SEE ALSO
awk(1), ed(1), grep(1), environ(5), lang(5), regexp(5), standards(5). tutorial in the STANDARDS CONFORMANCE
sed(1)