Sponsored Content
Top Forums Shell Programming and Scripting sort truncates line when they contain nulls Post 302187760 by era on Tuesday 22nd of April 2008 02:29:01 AM
Old 04-22-2008
Quote:
Originally Posted by massrobe
I can not change the byte because it is part of my data.
The idea is to change it temporarily so sort can work, then change it back. You just need to take care to use a byte which doesn't occur in your data.

For example, octal \200 or \001 might work if they don't occur in the data file already. So you'd change the NULs to (something unique), sort, and change (something unique) back to NUL. Now the data should be sorted, with the NULs preserved.

(\200 might be problematic too, because it's NUL with the eight bit set, and some procedure might still live in 7-bit land and strip the 8th bit internally; try some other high-value byte between \201 and \377 if it doesn't work.)
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

GREPing for Nulls

I just had a filesystem / file corruption issue on my HSP's server due to disk capacity limits and fileswapping. I discovered that certain files got corrupted when fileswapping was not successful and they ended up with a string of control characters, or what I believe to be nulls, in them. Does... (4 Replies)
Discussion started by: Dr. DOT
4 Replies

2. Shell Programming and Scripting

PS truncates the o/p

Hi , I have faced a strange situation in Solaris. the command ps -eo pid,args | grep 'SOMEPROCESS' truncates the output. outpt looks like 111 xxxxxxxxxxxxx SOMEPROCES 123 xxxxxxxxxxxxx SOMEPROCES 323 xxxxxxxxxxxxx SOMEPROCES The above doesn't return the complete command/args, infact if... (1 Reply)
Discussion started by: braindrain
1 Replies

3. UNIX for Advanced & Expert Users

who truncates the output? redirection? tty? Bug?

Hi, Output of running berkeley ps is truncated to 80 chars when using redirections. $ /usr/ucb/ps -e 12490|cat #truncated to 80 chars PID TT S TIME COMMAND 12490 pts/24 S 0:00 sleep 4000 aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa getting longer lines is done by changing the stty $... (7 Replies)
Discussion started by: fredy
7 Replies

4. Shell Programming and Scripting

Sort a file line by line alphabetically

infile: z y x c b a desired output: x y z a b c I don't want to sort the lines into this: a b c x y z nor this: c b a z y x The number of fields per line and number of lines is indeterminate. The field separator is always a space. Thanks for the use of your collective brains.... (11 Replies)
Discussion started by: H2OBoodle
11 Replies

5. Programming

Blanks vs: Nulls

I'm relatively new to Pro*C programming. In the following example: char name; EXEC SQL SELECT 'John Doe' INTO :name FROM DUAL; "John Doe" is in positions 0-7, blanks in 8-19, and a null in 20. I would really prefer the null to be in position 8 and I don't care what's after that. I wrote a... (1 Reply)
Discussion started by: ebock
1 Replies

6. Shell Programming and Scripting

include NULLs in line length check

Hello, I am checking the length of each line of a fixed length file and making sure all lines are 161 length. My problem is that some files contain null characters which gets stripped out of my echo. How do I have the NULLs included in my check? (and I cannot replace or sub the NULL values with... (10 Replies)
Discussion started by: ironmix
10 Replies

7. Shell Programming and Scripting

Sort a line and Insert sorted word(s) in a line

Hello, I am looking to automate a task - which is updating an existing access control instruction of a server and making sure that the attributes defined in the instruction is in sorted order. The instructions will be of a specific syntax. For example lets assume below listed is one of an... (6 Replies)
Discussion started by: sanjayroc
6 Replies

8. Shell Programming and Scripting

Replace nulls with a value in a file

Hi, I've a PIPE delimited file with about 5 fields. Sometimes the records in the 4th field is null, so I want to replace it based on values we get it on 2nd field in the same file. Following is an example. ABCD|X-TYPE 3.0|2010|X-TYPE|20000 CDEF|C-TYPE 2.5|2011|C-TYPE|10000 XYZ|LX... (4 Replies)
Discussion started by: rudoraj
4 Replies

9. Shell Programming and Scripting

/usr/bin/expect script truncates data

I have a script on a Linux machine that connects remotely, via telnet on a windows machine to launch several commands and colect their output. On the Linux machine the output of these commands is redirected in a file. The script: #!/usr/bin/expect log_user 0 spawn telnet 10.10.10.10... (6 Replies)
Discussion started by: black_fender
6 Replies
PACK(3) 								 1								   PACK(3)

pack - Pack data into binary string

SYNOPSIS
string pack (string $format, [mixed $args], [mixed $...]) DESCRIPTION
Pack given arguments into a binary string according to $format. The idea for this function was taken from Perl and all formatting codes work the same as in Perl. However, there are some formatting codes that are missing such as Perl's "u" format code. Note that the distinction between signed and unsigned values only affects the function unpack(3), where as function pack(3) gives the same result for signed and unsigned format codes. PARAMETERS
o $format - The $format string consists of format codes followed by an optional repeater argument. The repeater argument can be either an integer value or * for repeating to the end of the input data. For a, A, h, H the repeat count specifies how many characters of one data argument are taken, for @ it is the absolute position where to put the next data, for everything else the repeat count specifies how many data arguments are consumed and packed into the resulting binary string. Currently implemented formats are: pack(3) format characters +-----+---------------------------------------------------+ |Code | | | | | | | Description | | | | +-----+---------------------------------------------------+ | a | | | | | | | NUL-padded string | | | | | A | | | | | | | SPACE-padded string | | | | | h | | | | | | | Hex string, low nibble first | | | | | H | | | | | | | Hex string, high nibble first | | | | | c | | | | | | | signed char | | | | | C | | | | | | | unsigned char | | | | | s | | | | | | | signed short (always 16 bit, machine byte order) | | | | | S | | | | | | | unsigned short (always 16 bit, machine byte | | | order) | | | | | n | | | | | | | unsigned short (always 16 bit, big endian byte | | | order) | | | | | v | | | | | | | unsigned short (always 16 bit, little endian byte | | | order) | | | | | i | | | | | | | signed integer (machine dependent size and byte | | | order) | | | | | I | | | | | | | unsigned integer (machine dependent size and byte | | | order) | | | | | l | | | | | | | signed long (always 32 bit, machine byte order) | | | | | L | | | | | | | unsigned long (always 32 bit, machine byte order) | | | | | N | | | | | | | unsigned long (always 32 bit, big endian byte | | | order) | | | | | V | | | | | | | unsigned long (always 32 bit, little endian byte | | | order) | | | | | q | | | | | | | signed long long (always 64 bit, machine byte | | | order) | | | | | Q | | | | | | | unsigned long long (always 64 bit, machine byte | | | order) | | | | | J | | | | | | | unsigned long long (always 64 bit, big endian | | | byte order) | | | | | P | | | | | | | unsigned long long (always 64 bit, little endian | | | byte order) | | | | | f | | | | | | | float (machine dependent size and representation) | | | | | d | | | | | | | double (machine dependent size and representa- | | | tion) | | | | | x | | | | | | | NUL byte | | | | | X | | | | | | | Back up one byte | | | | | Z | | | | | | | NUL-padded string (new in PHP 5.5) | | | | | @ | | | | | | | NUL-fill to absolute position | | | | +-----+---------------------------------------------------+ o $args - RETURN VALUES
Returns a binary string containing data. CHANGELOG
+--------+---------------------------------------------------+ |Version | | | | | | | Description | | | | +--------+---------------------------------------------------+ | 5.6.3 | | | | | | | The "q", "Q", "J" and "P" codes were added to | | | enable working with 64-bit numbers. | | | | | 5.5.0 | | | | | | | The "Z" code was added with equivalent function- | | | ality to "a" for Perl compatibility. | | | | +--------+---------------------------------------------------+ EXAMPLES
Example #1 pack(3) example <?php $binarydata = pack("nvc*", 0x1234, 0x5678, 65, 66); ?> The resulting binary string will be 6 bytes long and contain the byte sequence 0x12, 0x34, 0x78, 0x56, 0x41, 0x42. NOTES
Caution Note that PHP internally stores integer values as signed values of a machine-dependent size (C type long). Integer literals and operations that yield numbers outside the bounds of the integer type will be stored as float. When packing these floats as integers, they are first cast into the integer type. This may or may not result in the desired byte pattern. The most relevant case is when packing unsigned numbers that would be representable with the integer type if it were unsigned. In systems where the integer type has a 32-bit size, the cast usually results in the same byte pattern as if the integer were unsigned (although this relies on implementation-defined unsigned to signed conversions, as per the C standard). In systems where the integer type has 64-bit size, the float most likely does not have a mantissa large enough to hold the value without loss of precision. If those systems also have a native 64-bit C int type (most UNIX-like systems don't), the only way to use the I pack format in the upper range is to create integer negative values with the same byte representation as the desired unsigned value. SEE ALSO
unpack(3). PHP Documentation Group PACK(3)
All times are GMT -4. The time now is 11:09 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy