How to determine the encoding of this dd image?


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users How to determine the encoding of this dd image?
# 1  
Old 06-16-2014
Gnome How to determine the encoding of this dd image?

I have extracted a raw data file from a magnetic tape using the dd command

Afterwards, I managed to read the extracted data with Bless HexEditor and I found out that at offset 0x200000 there is a sequence of value which originally was stored in a table.

I would like to extract this data and import it in an Excel or CSV file, but above all I would like to understand the data encryption.

This is an example of the data extracted in hexadecimal format and its representation in unsigned int little endian:
Code:
//Hex Not.    // Little-Endian unsigned int 32
10 00 00 00   // 84       (Ref Number)  
55 F1 2E 04   // 20070306 (Date)
A2 3F 32 01   // 15144184 (Time)
F8 14 E7 00   // 20070306 (Date)
A2 3F 32 01   // 15491037 (Time)
DD 5F EC 00   // 1
01 00 00 00   // 1
01 00 00 00   // 4486656
00 76 44 00   // 492
EC 01 00 00   // 1
01 00 00 00   // 814185724
FC 7C 87 30   // 814185728
00 7D 87 30   // 814185732
04 7D 87 30   // 16

New Line

10 00 00 00   // 84
55 F1 2E 04   // 20070306
A2 3F 32 01   // 15491037
DD 5F EC 00   // 20070306
A2 3F 32 01   // 15534889
29 0B ED 00   // 18
12 00 00 00   // 1
01 00 00 00   // 4486656
00 76 44 00   // 492
EC 01 00 00   // 1
01 00 00 00   // 814185724
FC 7C 87 30   // 814185728
00 7D 87 30   // 814185732
04 7D 87 30   // 16

Can you understand starting from this piece of converted data how the raw file is encoded and how I can create a bash script to decode it??

Thanks

Moderator's Comments:
Mod Comment Please use code tags next time for your code and data. Thanks

Last edited by NICEPeppino; 07-30-2014 at 08:03 AM..
# 2  
Old 06-16-2014
Try the file command. It might give you some info about the file.
# 3  
Old 06-16-2014
Do you suggest any particular parameter?

It returns that that file is a normal data stream (Very Useful Smilie)
The magic file cannot be found and the data is in a proprietary format.
# 4  
Old 06-16-2014
Before we can help more: What is the source of the tape?

Please: Give the name of the OS or brand of machine that wrote it - the OS or brand of computer, not the tape drive name.

There are some ways to "resurrect" tape data from ancient systems.
# 5  
Old 06-16-2014
The hardware configuration should be:
CPU Pentium II 400 MHz
Internal memory 128 Mb

Operating System: Windows 2000 server
# 6  
Old 06-16-2014
Quote:
Originally Posted by NICEPeppino
...

The magic file cannot be found and the data is in a proprietary format.
If the data is in a proprietary format, you pretty much have to go back to the proprietor of that format.

You might get something useful by running "strings" against the file.
# 7  
Old 06-16-2014
Thank you for your reply

I have heard many times that this job cannot be done without knowing the source of my data and how it has been written on the tape and I agree with you. Unfortunately, I must do it without any insight and this is the reason why I started looking at its hexadecimal notation with an hex editor.

The tape is a mix of metadata and voice audio and I need to figure out how I can decrypt both these source within the image.

Thanks to the hex editor I now understand that before each audio there is a piece information concerning the audio.

The information above is regarding this info.
My knowledge about reverse engineering is limited but I must do it (Job is Job Smilie)

Apprarently I was previously wrong since I have copied and pasted this piece of data on this
HTML Code:
http://www.scadacore.com/field-applications/miscellaneous/online-hex-converter.html
website and the data format seems to be big endian 32 Smilie

Btw I have typed this command in the shell to convert the file

Code:
cat file | strings --encoding=B > convToString

but something went wrong.

whereas the command
Code:
cat file | strings > convToString

convert it but with many errors

Any help?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Solaris

View file encoding then change encoding.

Hi all!! I´m using command file -i myfile.xml to validate XML file encoding, but it is just saying regular file . I´m expecting / looking an output as UTF8 or ANSI / ASCII Is there command to display the files encoding? Thank you! (2 Replies)
Discussion started by: mrreds
2 Replies

2. Shell Programming and Scripting

matching image files to create one image

Hi, I have two sets of image files. Both sets have names A to Z but set 1 ends with .cdt.png and set 2 ends with .matrix.png. I want set 1 to match with set 2 if the names match (i.e. A.cdt.png will match with A.matrix.png) and with the convert image tool (program for images), it will merge the... (6 Replies)
Discussion started by: kylle345
6 Replies

3. Solaris

Encoding problem

Hi All, Hope you can help me with the below :). I'm working on a script on SUN solaris and I'm facing a problem with the number encoding as shown below, 1 is encoded to 31 (this is ASCII so it's ok) 11 is encoded as B118 !!! don't know why 111 is encoded as B1580C !!! don't know why ... (4 Replies)
Discussion started by: /dev/bag
4 Replies

4. Shell Programming and Scripting

How to find the file encoding and updating the file encoding?

Hi, I am beginner to Unix. My requirement is to validate the encoding used in the incoming file(csv,txt).If it is encoded with UTF-8 format,then the file should remain as such otherwise i need to chnage the encoding to UTF-8. Please advice me how to proceed on this. (7 Replies)
Discussion started by: cnraja
7 Replies

5. Shell Programming and Scripting

UTF8 encoding

Hi experts, I have a gz file from other system(solaris), which is ftped to our system(solaris). After gunzip, the file is a xml file and we are using ORACLE built in xml transformiing tool ORAXSL to transform XML to TXT. Now the issue is we come accross issue regarding UTF8 as below:... (1 Reply)
Discussion started by: summer_cherry
1 Replies

6. UNIX for Dummies Questions & Answers

Encoding Type

Hi, Where can I find the encoding type in a unix server ? Thanks in advance !!! (1 Reply)
Discussion started by: risshanth
1 Replies

7. Shell Programming and Scripting

Araic Encoding

hi folks , I have a shell script which contain SQL query that dump some data from the DB in arabic and this data is written to a file in unix machine but the problem that the arabic data is appear like ??????????|111|???????? even when I move it to my windows XP machine. Any one have an Idea... (2 Replies)
Discussion started by: habuzahra
2 Replies

8. Shell Programming and Scripting

URL encoding

Hi All, I want to do URL encoding using shell script in my project. I decided that the sed is the correct tool to do this. But I am unable achieve what I wanted using sed. kindly help me to get rid of this. My requirement is , there will be one URL with all special character, spaces etc... ... (8 Replies)
Discussion started by: Vichu
8 Replies

9. UNIX for Dummies Questions & Answers

encoding

Hi, I'm using putty and when I try to write ü it writes | (or when I try to write é , it writes i) I tried to change settings/translation of putty but with no success I have KSH # locale LANG= LC_CTYPE="C" LC_NUMERIC="C" LC_TIME="C" LC_COLLATE="C" LC_MONETARY="C" LC_MESSAGES="C"... (3 Replies)
Discussion started by: palmer18
3 Replies

10. UNIX for Advanced & Expert Users

Create an Ignite image on tape from Online IgniteUX image

Hi, (HP-UX 11.11) I need to create a tape image of an igniteUX image created on our igniteUX server. That is to say. I have a "Online" image of the igniteUX of the targeted system but I now need to copy it to a useable TAPE (igniteUX) image so i can build an other server from it that is not... (3 Replies)
Discussion started by: Andrek
3 Replies
Login or Register to Ask a Question