11-18-2016
Looks like I've misread/misinterpreted your specification. Sorry for that.
So, in your picture, we're seeing many empty fields (e.g. 15 after the first), 81 fields make up a record of unpredictable length, and there's no <NL> (\n, ^J, 0x0A) char in it.
Are other non-printable, control characters possible, like <TAB>s? Or are all field contents printable alphanumeric characters?
Please note that it is far better to post or attach a sample input file, be it abbreviated, to work (and test) upon, than to show a picture.
This User Gave Thanks to RudiC For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi Guys,
I want to write a perl/shell script do parse the following file
input file content
NPA-NXX SC
2084549 45
2084552 45
2084563 2007
2084572 45
2084580 45
3278411 45
3278430 45
3278493 530
3278507 530... (3 Replies)
Discussion started by: pistachio
3 Replies
2. Shell Programming and Scripting
Hi,
I need add leading zeroes to a field in a file based on the character count. The field can be of 1 character to 6 character length. I need to make the field 14bytes.
eg:
8351,20,1
8351,234,6
8351,2,0
8351,1234,2
8351,123456,1
8351,12345,2
This should become.
... (3 Replies)
Discussion started by: gpaulose
3 Replies
3. Shell Programming and Scripting
Hi,
I have a No Delimiter variable length text file with following schema -
Column Name Data length
Firstname 5
Lastname 5
age 3
phoneno1 10
phoneno2 10
phoneno3 10
sample data - ... (16 Replies)
Discussion started by: Gaurav Martha
16 Replies
4. Shell Programming and Scripting
Hi not sure if this is possible but I need some help with a bash script, I have a text file and on the first line that starts with 7150230 I need it to put a 1 at position 79 and a 2 at position 88, this is where it gets complicated, on the next line it finds that starts with 7150230 I then need it... (8 Replies)
Discussion started by: firefox2k2
8 Replies
5. Shell Programming and Scripting
Hi,
I have a requirement where in I need to insert delimiters before the last column of the total delimiters is less than a specified number.
Say if the delimiters is less than 139, I need to insert 2 columns ( with blanks) before the last field
awk -F 'Ç' '{ if (NF-1 < 139)} END { "Insert 2... (5 Replies)
Discussion started by: arunkesi
5 Replies
6. Shell Programming and Scripting
I have file listed in my directory in following format
-rwxrwxr-x+ 1 test test 4.9M Oct 3 16:06 test20141002150108.txt
-rwxrwxr-x+ 1 test test 4.9M Oct 4 16:06 test20141003150108.txt
-rwxrwxr-x+ 1 test test 4.9M Oct 5 16:06 test20141005150108.txt
-rwxrwxr-x+ 1 test ... (2 Replies)
Discussion started by: krish2014
2 Replies
7. Shell Programming and Scripting
Hi,
I have tried to remove dublicate lines based on first column with pipe delimiter . but i ma not able to get some uniqu lines
Command : sort -t'|' -nuk1 file.txt
Input :
38376KZ|09/25/15|1.057
38376KZ|09/25/15|1.057
02006YB|09/25/15|0.859
12593PS|09/25/15|2.803... (2 Replies)
Discussion started by: parithi06
2 Replies
8. Shell Programming and Scripting
Hi Folks,
I have a file with fields as follows which has last field in multiple lines. I would like to combine a line which has three fields with single field line for as shown in expected output. Please help.
INPUT
hname01 windows appnamec1eda_p1, ... (5 Replies)
Discussion started by: shunya
5 Replies
9. Shell Programming and Scripting
I want to count the number of lines, I need this result be a number, and sum the last numeric column, I had done to make this one at time, but I need to make this for a crontab, so, it has to be an script, here is my lines:
It counts the number of lines:
egrep -i String file_name_201611* |... (5 Replies)
Discussion started by: Elly
5 Replies
10. Shell Programming and Scripting
I have a huge file (around 4-5 GB containing 20 million rows) which has text like:
<EOFD>11<EOFD>22<EORD>2<EOFD>2222<EOFD>3333<EORD>3<EOFD>44<EOFD>55<EORD>66<EOFD>888<EOFD>9999<EORD>
Actually above is an extracted file from a Sql Server with each field delimited by <EOFD> and each row ends... (8 Replies)
Discussion started by: amvip
8 Replies
vis(1) General Commands Manual vis(1)
NAME
vis, inv - make unprintable and non-ASCII characters in a file visible or invisible
SYNOPSIS
file ...
file ...
DESCRIPTION
reads characters from each file in sequence and writes them to the standard output, converting those that are not printable or not ASCII
into a visible form. inv performs the inverse function, reading printable characters from each file, returning them to non-printable or
non-ASCII form, if appropriate, then writing them to standard output;
Non-printable ASCII characters are represented using C-like escape conventions:
backslash
backspace
escape
form-feed
new-line
carriage return
space
horizontal tab
vertical tab
the character whose
ASCII code is the 3-digit octal number n.
the character whose
ASCII code is the 2-digit hexadecimal number n.
Non-ASCII single- or multi-byte characters are examined one byte at a time. For each byte, if it can be displayed as an ASCII character,
it is treated as if it is an ASCII character; Otherwise, it is represented in the following conventions:
the 8-bit character whose
code value is the 3-digit octal number n.
the 8-bit character whose
code value is the 2-digit hexadecimal number n.
Space, horizontal-tab, and new-line characters can be treated as printable (and therefore passed unaltered to the output) or non-printable
depending on the options selected. Backslash, although printable, is expanded by vis, to a pair of backslashes so that when they are
passed back through inv, they convert back to a single backslash.
If no input file is given, or if the argument is encountered, and inv read from the standard input.
Options
and recognize the following options:
Treat new-line, space, and horizontal tab as non-printable characters.
expands them visibly as and rather than passing them directly to the output. discards these characters, expecting only the
printable expansions. New-line characters are inserted by every 16 bytes so that the output will be in a form that is
usable by most editors.
Make and silent about non-existent files, identical input and output, and write errors. Normally, no input file can be the same
as the output file unless it is a special file.
Treat horizontal-tab and space characters as non-printable
in the same manner that treats them.
Cause output to be unbuffered (byte-by-byte);
normally, output is buffered.
Cause output to be in hexadecimal form rather than the default octal form. Either form is accepted to as input.
EXTERNAL INFLUENCES
Environment Variables
determines the language in which messages are displayed.
International Code Set Support
Single- and multi-byte character code sets are supported.
WARNINGS
Redirecting output to an input file destroys the original data. Therefore, command forms such as
should be avoided unless the source file can be safely discarded.
AUTHOR
was developed by HP.
SEE ALSO
cat(1), echo(1), od(1).
vis(1)