Formatting a text file based on newline and delimiter characters
Hi Everybody,
I need some help on formatting the files coming into unix box on the fly.
I get a file some thing like this in a single line.
Code:
ISA^M00^M ^M00^M ^M14^M006929681900 ^M01^M095449419 ^M061130^M2240^MU^M00401^M000003791^M0^MP^M>~GS^MPO^M006929681900^M095449419^M20061130^M2240^M41^MX^M004010~ST^M850^M000000059~BEG^M00^MNE^M11302346F2600^M^M20061130~REF^MIA^M0028910^MTANKO COMPANY~FOB^MPP^MDE^M00300DO~ITD^M^M^M^M^M^M^M^M^M^M^M^M 02% 60 DAYS~DTM^M010^M20061214~TD5^M^M^M^M^MAUTHORIZED CARRIER~
Now all I want is :
1) To identify my delimiter character at 4th position(which is ^M[single character] for this file and it could be varying for other files)
2) Change the delimiter character whatever it is to *(asterisk)
3) To identify my newline character at 105 position(which is a tilde(~) in this file and it could be varying for other files)
4) Break into new line when ever there is a newline character which cud be ~ or any thing else.
5)Finally changed file should look like below :
ISA*00* *00* *14*006929681900 *01*095449419 *061130*2240*U*00401*000003791*0*P*>
GS*PO*006929681900*095449419*20061130*2240*41*X*004010
ST*850*000000059
BEG*00*NE*11302346F2600**20061130
REF*IA*0028910*TANKO COMPANY
FOB*PP*DE*00300DO
ITD************ 02% 60 DAYS
DTM*010*20061214
TD5*****AUTHORIZED CARRIER
6)Also when the script is run on already formatted file like above it should not disturb the file since it is already in perfect shape.
I am new to the shell script and my part of struggle I did by looking threads in this forum but my requirement did not match any
Please help me with the script.
Hi,
I have a string like ABC.123.XYZ-A1-B2-P1-C4. I want to delimit the string based on "-" and then get result as only two strings. One with string till last hyphen and other with value after last hyphen... For this case, it would be something like first string as "ABC.123.XYZ-A1-B2-P1" and... (6 Replies)
Hi All,
I have raw data in the format :-
--------------------------------------------------------------------
NUT070
3 ./opc.sh SQLSCRIPT &SID sysdate.sql 20120105
NUW004
3 ./opc.sh SQLSCRIPT &SID sab_supp.sql
UNUW032
3 ./opc.sh SQLSCRIPT &SID sab_unsupp.sql... (3 Replies)
Hi All,
Just need small help in resolving the special new line character in generated output file.
In one of my shell script I am using following lines to get the spool file (i.e. sfile.txt) and
AAA_XXXX_p111_n222.txt
AAA_YYYY_p111_n222.txt
Here assuming
v_pnum="p111"
v_nid="n222"
... (1 Reply)
Good day ...
Well i do have this project in school, in our Principles Of Operating System Class
We are using Cygwin....
And our project goes like this...
Create a dictionary using cygwin. Display the following menu at the start of
execution
1-add a word in the dictionary # specify... (1 Reply)
Good day ...
Well i do have this project in school, in our Principles Of Operating System Class
We are using Cygwin....
And our project goes like this...
Create a dictionary using cygwin. Display the following menu at the start of execution
1-add a word in the dictionary # specify the... (1 Reply)
My source file is pipe delimeted file with 53 fields.In 33 rd column i am getting mutlple new line characters,dule to that record is breaking into multiple records.
Note : here record delimter also \n
sample Source file with 6 fields :
1234|abc| \nabcd \n bvd \n cde \n |678|890|900\n
... (6 Replies)
Hi,
I have a No Delimiter variable length text file with following schema -
Column Name Data length
Firstname 5
Lastname 5
age 3
phoneno1 10
phoneno2 10
phoneno3 10
sample data - ... (16 Replies)
A text file has 2 fields (Data, Filename) delimited by # as below,
Data,Filename
Row1 -> abc#Test1.xml
Row2 -> xyz#Test2.xml
Row3 -> ghi#Test3.xml
The content in first field has to be written into a file where filename should be considered from second field.
So from... (4 Replies)
The input file is as below
AR,age,marks,roll,section,evin,25,80,456,A,atch,23,56,789,B,eena,24
,78H245,C,Ps,ot,ecessary,hat,ame comes first then age and rest AR
AZ,kevin,25,80,456,A,Satch,23,56,789,Satch,23,56,789,B,Meena,24,78,H245,C,AZ
................
................
I am writting... (8 Replies)
My file has data that looks like below:
more data.txt
I wish to display each string seperated by a delimiter :
Expected output:
I tried the below but I m not getting every split string on a new line.
#!/bin/bash
for i in `sed 's/:/\\n/g' data.txt`;
do
echo -n... (2 Replies)
Discussion started by: mohtashims
2 Replies
LEARN ABOUT HPUX
fold
fold(1) General Commands Manual fold(1)NAME
fold - fold long lines for finite width output device
SYNOPSIS
width] [file ...]
Obsolete form:
width] [file ...]
DESCRIPTION
The command is a filter that folds the contents of the specified files, breaking the lines to have a maximum of width column positions (or
bytes, if the option is specified). The command breaks lines by inserting a newline character so that each output line is the maximum
width possible that does not exceed the specified number of column positions (or bytes). A line cannot be broken in the middle of a char-
acter. If no files are specified or if a file name of is specified, the standard input is used.
The command is often used to send text files to line printers that truncate, rather than fold, lines wider than the printer is able to
print.
If the backspace, tab, or carriage-return characters are encountered in the input, and the option is not specified, they are treated spe-
cially as follows:
Backspace The current count of line width is decremented by one, although the count never becomes negative. Thus, the char-
acter sequence character-backspace-character counts as using one column position, assuming both characters each
occupy a single column position. does not insert a newline character immediately before or after any backspace
character.
Tab Each tab character encountered advances the column position pointer to the next tab stop. Tab stops are set 8 col-
umns apart at column positions 1, 9, 17, 25, 33, etc.
Carriage-return The current count of line width is set to zero. does not insert a newline character immediately before or after
any carriage-return character.
Note that may affect any underlining that is present.
Options
The command recognizes the following options and command-line arguments:
Count width in bytes rather than in column positions.
Break the line on the last blank character found
before the specified number of column positions (or bytes). If none are found, break the line at the specified
line length.
Specify the maximum line length, in column positions (or bytes if
is specified). The default value is 80. width should be a multiple of 8 if tabs are present, or the tabs should
be expanded using before processing by (see expand(1)). The option is obsolescent and may be removed in a future
release.
EXTERNAL INFLUENCES
Environment Variables
determines the interpretation of text as single- and/or multi-byte characters.
determines the language in which messages are displayed.
If or is not specified in the environment or is set to the empty string, the value of is used as a default for each unspecified or empty
variable. If is not specified or is set to the empty string, a default of "C" (see lang(5)) is used instead of
If any internationalization variable contains an invalid setting, behaves as if all internationalization variables are set to "C". See
environ(5).
International Code Set Support
Single- and multi-byte character code sets are supported.
SEE ALSO expand(1).
STANDARDS CONFORMANCE fold(1)
05-10-2007
