Parsing text file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Parsing text file
# 1  
Old 03-18-2012
Data Parsing text file

I'm totally stumped with how to handle this huge text file I'm trying to deal with. I really need some help!
Here is what is looks like:
Code:
ab1ba67c331a3d731396322fad8dd71a3b627f89359827697645c806091c40b9
0.2
812a3c3684310045f1cb3157bf5eebc4379804e98c82b56f3944564e7bf5dab5
0.6
0.6
9b27f7f2b07eb11e9576792d1105c3e43377c2659d18f0ac6ae894a2a548080e
0.1

It's pretty much hashes with values underneath each hash. It's quite large.

What I'm try to do is add all the numbers under each hash so the second one would be 1.2.

I also need a unique hash for each 0.2 value. So the first one would stay the same. The second one should have a total of six hashes. So the script would take the original hash and add a "1" and the end then sha256sum hash it again. (eg. sha256(812a3c3684310045f1cb3157bf5eebc4379804e98c82b56f3944564e7bf5dab51) Then take off the "1" add a "2" and all the way to "5". So in the end there would be 6 hashes under each other with 1.2 underneath.

Since the last hash has 0.1 it would add a "BAD AMOUNT" after the 0.1.

If the amount was 1.1 it would only make 5 hashes for the amount and add "EXTRA AMOUNT".

I've tried for days figuring it out but I can't. Any help would be appreciated!! THANK YOU!

Last edited by Franklin52; 03-19-2012 at 04:28 AM.. Reason: Please use code tags for code and data samples, thank you
# 2  
Old 03-18-2012
please post the code you have been working on.
# 3  
Old 03-18-2012
Also you should post desired output for this sample data.
# 4  
Old 03-18-2012
I'm trying to teach myself scripting as I'm doing it. I KNOW I'm probably not even close! Smilie

Code:
#!/bin/bash

for (( i = 1; i <= 10; i++ ))
do

linedata=`sed -n $i'p' ./exp.txt`
length=${#linedata}

if [ $length = 64 ]
then
echo $linedata
fi

total=0.0

while [ $length -ne 64 ]
do
total=$(echo "scale=9; $total+$linedata" | bc )
i=$(($i + 1))
linedata=`sed -n $i'p' ./exp.txt`
length=${#linedata}
done
echo $total

---------- Post updated at 04:39 PM ---------- Previous update was at 04:36 PM ----------

Eg output.
Code:
ab1ba67c331a3d731396322fad8dd71a3b627f89359827697645c806091c40b9
0.3 EXTRA
812a3c3684310045f1cb3157bf5eebc4379804e98c82b56f3944564e7bf5dab5
08e78bac1d7f4aff0daf79c77abf33dfe2b8d953e4807ad47a4212db147fd6bd
ed84fea7b54d62fd87fabc5ed6a02d96e2886db9c48e3b54d8b69e73cc91d76e
c566b1f5e12ac452886b4de5477dad191786866567957d9a3e40997e68301b11
cbb348256408a106c2f6329938d430f3748757dc0771a6f956d909e6675a4a5c
cf59c0735d7154ace594b97918c4dacbc6a4caa82d07d5cd973d7531a0955b1b
1.2
9b27f7f2b07eb11e9576792d1105c3e43377c2659d18f0ac6ae894a2a548080e
0.1 BAD AMOUNT


Last edited by comp8765; 03-18-2012 at 06:41 PM.. Reason: format
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parsing text file

Hi Friends, I am back for the second round today - :D My input text file is this way Home friends friendship meter Tools Mirrors Downloads My Data About Us Help My own results BLAT Search Results ACTIONS QUERY SCORE START END QSIZE IDENTITY CHRO STRAND ... (7 Replies)
Discussion started by: jacobs.smith
7 Replies

2. Programming

Parsing a Text file using C++

I was trying to parse the text file, which will looks like this ###XYZABC#### ############ int = 4 char = 1 float = 1 . . ############ like this my text file will contains lots of entries and I need to store these entries in the map eg. map.first = int and map.second = 4 same way I... (5 Replies)
Discussion started by: agupta2
5 Replies

3. Programming

Parsing a text file in Tcl

Hi all, I need to parse through a text file searching for a specific string, then after I find this string read in remaining data off the line to a variable. I've tried various things and can't seem to get any to work. Any help would be much appreciated. (2 Replies)
Discussion started by: caboose57
2 Replies

4. Shell Programming and Scripting

Need help parsing a text file

I have a text file: router1#sh ip blah blah | incl --- Gi2/8 10.60.4.181 --- 10.60.123.175 11 0000 0000 355K Gi2/8 10.60.83.28 --- 224.10.10.26 11 F9FF 3840 154K Gi2/8 10.60.83.198 --- ... (1 Reply)
Discussion started by: streetfighter2
1 Replies

5. Shell Programming and Scripting

Log file text parsing

I'm new to scripting and was wondering if there was a way to accomplish what I want below using shell script(s). If there is a log file as follows, where the id is the unique id of a process, with the timestamp of when the process began and completed displayed, would it be possible to find the... (3 Replies)
Discussion started by: dizydolly
3 Replies

6. UNIX for Dummies Questions & Answers

Help parsing and replacing text with file name

Hi everyone, I'm having trouble figuring this one out. I have ~100 *.fa files with multiple lines of fasta sequences like this: file1.fa >xyzsequence atcatgcacac...... ataccgagagg..... atataccagag..... >abcsequence atgagatatat..... acacacggd..... atcgaacac.... agttccagat.... The... (2 Replies)
Discussion started by: mycoguy
2 Replies

7. Shell Programming and Scripting

Parsing text from file

Any ideas? 1)loop through text file 2)extract everything between SOL and EOL 3)output files, for example: 123.txt and 124.txt for the file below So far I have: sed -n "/SOL/,/EOL/{p;/EOL/q;}" file Here is an example of my text file. SOL-123.go something goes here something goes... (0 Replies)
Discussion started by: ndnkyd
0 Replies

8. Shell Programming and Scripting

Need help in parsing text file contents

Hi, I need some help in extracting the Exception block between the lines 21 Feb 01:18:54:146 ERROR com.orbits.frameworks.integrationframework.ValidationException - Caught exception in validateRequest() (PID=565584) and 21 Feb 01:18:55:149 INFO ... (0 Replies)
Discussion started by: Alecs
0 Replies

9. Shell Programming and Scripting

Text File Parsing

Hey Guys.I am a newbie on Bash Shell Scripting and Perl.And I have a question about file parsing. I have a log file which contains reports about a communication device.I need to take some of the reports from the log file.Its hard to explain the issue.but shortly I can say that, the reports has a... (2 Replies)
Discussion started by: Djlethal
2 Replies

10. Shell Programming and Scripting

Parsing Lines from a text file

Hello Guru's I know there are people who live to be able to help people like me. That's why I'm here! I have a text file that has a corresponding address information that I need to be able to get maybe as a Unix Function. The text file contains the following: AIX17_JB_C;... (3 Replies)
Discussion started by: sallender
3 Replies
Login or Register to Ask a Question