Split binary file every occurrence of a group of characters
Hello I am new to scripts, codes, bash, terminal, etc.
I apologize this my be very scattered because I frankly don't have any idea where to begin and I have had trouble sleeping lately.
I have several 2GB files I wish to split.
This Code
reoccurs several times in each file, sadly they are not evenly spaced otherwise
would work just fine for what I am doing.
Out of the first 12 bits 5,6,7,8,9,10,11,12 are random, they change in sequential order and they must be included at the start of the file.
The files should start at
and end before the next occurrence of
Occurs every 2048 bits but is not the part I'm looking for.
Just the bits after the first 12 are important.
I have been searching for a code to split the file at every occurrence. After trying and failing with many different tricks around the internet, I have decide to ask for help.
Back Story to problem:
I have a 500GB HD that had a 40GB HFS+ partition that I was using to transfer files from an old Dell PC to my Mac. Well, I needed to reformat it I no longer remember why.
Well, somehow the partition map got messed up and instead formatted the HFS 450GB partition. Which had all my home videos on it.
I just got the disks to burn them all to DVD to save in a lock box. 20 Years of video.
I found an application called disk drill and used that to recover all the data.
I am not sure if everything was found but it seems like it may have reconstructed the important stuff.
My problem with resolution:
Well, the videos are all jumbled up, bits and pieces of Mpeg2 videos are mixed together.
I figured out where the files need to be split with the help of an app called HEX Fiend.
And turns out there is a type of timecode used in the mpeg 2 files binary data. So using that I was able to correct 2 video files. Took me a week.
Last edited by PatrickE; 03-29-2013 at 05:55 PM..
Reason: I realized I repeated things unnecessarily.
Hi all,
I have a binary file (orig.dat) and two special delimiter strings 'AAA' and 'BBB'. My binary file's content is as follow:
<Data1.1>AAA<Data1.2>BBB
<Data2.1>AAA<Data2.2>BBB
...
<DataN.1>AAA<DataN.2>BBB
DataX.Y might have any length, and contains any kind of special/printable... (1 Reply)
Guys
Following input line is from /etc/group file.As we know last entry in a line of /etc/group is userlist (all the users belonging to that group).
I need to splilt this one line into 3 lines as shown below (3 because userlist has 3 names in it).
Input:
lp:!:11:root,lp,printq
... (13 Replies)
Hi all,
I'm having a little trouble solving a file split I need to get done.
I have the following data:
1. Light
1A. Light Soft
texture: it's soft
color: the color value is that of something light
vital statistics: srm: 23 og: 1.035 sp: 1.065
comment: this is nice if you like... (8 Replies)
Hello!
Have some problem with extract files from saved session.
File contains any kind of special/printable characters.
DATA NumberA DATA
DATA Begin
DATA1.1
DATA1.2 NumberB1 DATA1.3
DATA1.4
End DATA
DATA
DATA Begin
DATA2.1
DATA2.2 NumberB2 DATA2.3
DATA2.4
End DATA
DATA
... (4 Replies)
Hi,
I want to know how I can remove the last characters of ANY pdf file. I read it under "od" in the command shell to see which were the last characters:
$od corruptedfile.pdf -c
When I see the file, I need to keep only the last characters, or "end of the file": %EOF (obviously keeping all... (1 Reply)
Hi,
can some one please help me to split the file based on groups.
like in the below scenario x indicates the begining of the group and the file should be split each with 2 groups below there are 10 groups it should create 5 files. could you please help? (4 Replies)
Hi All,
I have a text file with the following text in it:
file:///About/accessibility.html
file:///About/disclaimer.html
file:///About/disclaimer.html#disclaimer
file:///pubmed?term=%22Dacre%20I%22%5BAuthor%5D
file:///pubmed?term=%22Madigan%20J%22%5BAuthor%5D... (8 Replies)
Hi All,
Iam new to unix scripting and I want a split a string into 4 characters each, leaving the last two characters and convert the splitted values into binary.
For example:
string='ffd80012ffe20000ffebfffeffea0007fff0ffd70014fff1fff0fff0fff201'
this should split as
ffd8
0012
ffe2
.
.... (5 Replies)
Hello,
I have a string like this 0:1:2:0:2:2:4:0:0:0:-200:500......
what i want is to break down how many different characters are there and their count. For example for above string it should display
0 - 5 times
1 - 1 times
2 - 3 times
4 - 1 times
.
.
.
I am stuck in writing... (8 Replies)
I have a requirement to split a huge file to smaller text files based on first four characters which look like
ABCD
1234
DFGH
RREX
:
:
:
:
:
0000
Each of these records are OF EQUAL bytes with a different internal layout based on the above first digit identifier..
Any help to start... (5 Replies)