Sorry, I haven't been able to hobble this together...

11-06-2014

Registered User

4, 0

Join Date: Nov 2014

Last Activity: 10 November 2014, 4:12 PM EST

Posts: 4

Thanks Given: 2

Thanked 0 Times in 0 Posts

Sorry, I haven't been able to hobble this together...

I have a file containing about 100 lines, each with a ';' the end.

Each line is a string represented in UTF-16 hex and they vary in length.

I am thinking I ought to be able to use (g)awk to insert ',00,' after each two characters on each line in the file so that in the end, I have a comma-delimited UTF-16LE hex file:

From:

Code:

224C6F72656D20697073756D20646F6C6F722073697420616D65742C20636F6E73656374657475722061646970697363696E6720656C69742E2050656C6C656E74657371756520697073756D206D617373612200;
224C6F72656D20697073756D20646F6C6F722073697420616D65742C20636F6E73656374657475722061646970697363696E6720656C69742E2050656C6C656E74657371756520697073756D206D617373612200;

To:

Code:

22,00,4C,00,6F,00,72,00,65,00,6D,00,20,00,69,00,70,00,73,00,75,00,6D,00,20,00,64,00,6F,00,6C,00,6F,00,72,00,20,00,73,00,69,00,74,00,20,00,61,00,6D,00,65,00,74,00,2C,00,20,00,63,00,6F,00,6E,00,73,00,65,00,63,00,74,00,65,00,74,00,75,00,72,00,20,00,61,00,64,69,00,70,00,69,00,73,00,63,00,69,00,6E,00,67,00,20,00,65,00,6C,00,69,00,74,00,2E,00,20,00,50,00,65,00,6C,00,6C,00,65,00,6E,00,74,00,65,00,73,00,71,00,75,00,65,00,20,00,69,00,70,00,73,00,75,00,6D,00,20,00,6D,00,61,00,73,00,73,00,61,00,22,00,00;
22,00,4C,00,6F,00,72,00,65,00,6D,00,20,00,69,00,70,00,73,00,75,00,6D,00,20,00,64,00,6F,00,6C,00,6F,00,72,00,20,00,73,00,69,00,74,00,20,00,61,00,6D,00,65,00,74,00,2C,00,20,00,63,00,6F,00,6E,00,73,00,65,00,63,00,74,00,65,00,74,00,75,00,72,00,20,00,61,00,64,69,00,70,00,69,00,73,00,63,00,69,00,6E,00,67,00,20,00,65,00,6C,00,69,00,74,00,2E,00,20,00,50,00,65,00,6C,00,6C,00,65,00,6E,00,74,00,65,00,73,00,71,00,75,00,65,00,20,00,69,00,70,00,73,00,75,00,6D,00,20,00,6D,00,61,00,73,00,73,00,61,00,22,00,00;

I've fiddled around all day (on and off) and have nothing to show for my efforts. If any of you can show me the way, I'd be most appreciative.

Thanks,

gus

Moderator's Comments:

Please use code tags

Last edited by jim mcnamara; 11-06-2014 at 10:37 PM.. Reason: code tags

gusbrown

View Public Profile for gusbrown

Find all posts by gusbrown

11-06-2014

Registered User

12,315, 4,560

Join Date: Jul 2012

Last Activity: 22 November 2019, 4:29 PM EST

Location: San Jose, CA, USA

Posts: 12,315

Thanks Given: 952

Thanked 4,560 Times in 3,818 Posts

This could be done with awk, but you don't need that much power for this. A simple editor (e.g., ed, ex, sed, or vi is all you need for this. Here is an example using sed:

Code:

sed 's/../&,00,/g; s/,;/;/' input

After massaging your sample input and output to get rid of spaces in the middle of your lines (since you didn't use CODE tags), I also found that this code does not produce the sample output you said you want; you're missing a ,00 close to the end of each line and a ,00, in the middle of the line.

This User Gave Thanks to Don Cragun For This Post:

Don Cragun

View Public Profile for Don Cragun

Find all posts by Don Cragun

11-07-2014

Registered User

15,129, 5,008

Join Date: Jul 2012

Last Activity: 4 May 2020, 4:31 PM EDT

Location: Aachen, Germany

Posts: 15,129

Thanks Given: 735

Thanked 5,008 Times in 4,483 Posts

Please be aware that the result is NOT a UTF-16LE file, but sort of a textual representation of such. Hexdump of . . .
UTF-16LE:

Code:

00000000  22 00 4c 00 6f 00 72 00  65 00 6d 00 0a 00        |".L.o.r.e.m...|

Your text:

Code:

00000000  32 32 2c 30 30 2c 34 43  2c 30 30 2c 36 46 2c 30  |22,00,4C,00,6F,0|
00000010  30 2c 37 32 2c 30 30 2c  36 35 2c 30 30 2c 36 44  |0,72,00,65,00,6D|
00000020  2c 30 30 2c 0a                                    |,00,.|

RudiC

View Public Profile for RudiC

Find all posts by RudiC