noob question - is awk the tool to clean dirty text files?

Login or Register to Ask a Question and Join Our Community

noob question - is awk the tool to clean dirty text files?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting noob question - is awk the tool to clean dirty text files?

02-21-2010

Registered User

4, 0

Join Date: Feb 2010

Last Activity: 5 March 2010, 2:27 AM EST

Posts: 4

Thanks Given: 0

Thanked 0 Times in 0 Posts

noob question - is awk the tool to clean dirty text files?

Hi,

nevermind. I think I've found the answer. It appears I was looking for index, match, sub, and gsub.

I want to write a shell script that will clean the html out of a bunch of files and format the data for import into excel.

Awk seems like a powerful tool, but it seems oriented to text that is already formatted and delimited. From my cursory study, awk seems to only be able to access lines and words. Is there a way to find and manipulate chunks of text within an awk "word".

Or perhaps there are better tools...?

Last edited by yogert909; 02-21-2010 at 08:18 PM..

yogert909

View Public Profile for yogert909

Find all posts by yogert909

02-22-2010

Registered User

839, 54

Join Date: Oct 2009

Last Activity: 1 February 2016, 9:47 AM EST

Location: France

Posts: 839

Thanks Given: 4

Thanked 54 Times in 53 Posts

html2text exists

frans

View Public Profile for frans

Find all posts by frans

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Alignment tool to join text files in 2 directories to create a parallel corpus

I have two directories called English and Hindi. Each directory contains the same number of files with the only difference being that in the case of the English Directory the tag is .english and in the Hindi one the tag is .Hindi The file may contain either a single text or more than one text...

2. Shell Programming and Scripting

awk help or any other tool to sort between two files

Experts Good day, I want to sort two files f1 & f2 to matching with f1's first field with f2's 3rd field like to get in a result file : I tried with join but getting wrong result, I think there must be something with awk or other unix tool: cat f1 MYQCI63 srvcmi12 D7QDI ...

3. Shell Programming and Scripting

For loop -- noob question

Hello, I am new to shell scripting and i am trying to figure why is this not working with else statement. I am searching for every directory in that DIR i am in, however the "else" seems to be triggered whenever the run the script.. Much thanks in advance! #!/bin/shell for item in...

4. Shell Programming and Scripting

Need help with awk tool - finding text between two patterns

This is regarding using awk tool to find lines matching between 2 patterns. cat file | awk '/pat1/,/pat2/' But it's not working as expected in the following case. If pat1 also comes after pat2 then it's matching whole file after pat1. e.g. # > cat -n file 1 First line...

5. Ubuntu

Simple Noob Question

I am editing the squid.confi on my server. I am done editing. How do I exit the confi file? Thank you.

6. UNIX for Dummies Questions & Answers

Noob question on comparing #'s.

I have a file with 3 digit numbers in it formatted as such: 123 065 321 How would I go about seeing if each number is less than 100 and if so outputting it to another file Yes, I am a bit of a noob. I have tried with grep but I don't think it'll work. Any general direction would be...

7. UNIX for Dummies Questions & Answers

Noob sorting question

Ok here is the deal, I have a command given to me by some systems guy who I cannot get ahold of on the weekend without paying him alot of money to help me. I need to get this done before Monday as I am just getting pummeled by DOS attacks. The comand given was.... netstat -ntu | awk '{print...

8. Programming

Question about compiling (noob)

I'm just getting started to lean C and I'm using Ubuntu today I found a tutorial at this site: http://einstein.drexel.edu/courses/CompPhys/General/C_basics/c_tutorial.html and I got an error after compiling the fist code: #include < stdio.h> void main() { printf("\nHello World\n"); } ...

9. UNIX for Dummies Questions & Answers

Is there any non graphical tool that make selective merge between text files?

whitout using awk / sad and so on?

Login or Register to Ask a Question