Searching for text in a Space delimited File


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Searching for text in a Space delimited File
# 1  
Old 11-27-2007
Searching for text in a Space delimited File

Hi

I am trying to search a firewall syslog space delimeted file for all of the different tcp and udp destination ports.
I know that grep will find lines that contain specific text. And I have tried using the the the cut command to cut out of the file certain colums. However the test I am looking for is not always in the same colum.

What I would like to do is search through many log files in a directory for the text string dst_port=*** where the *** would be a wild card so I can see every destination port that has been requested from the firewall logs.
Below is a snap shot of the text im trying to search through.
Any help would be appreciated.
Andy

src=10.217.162.99 dst=10.217.208.105 src_port=4218 dst_port=135 src-xlated ip=10.217.162.99 port=4218 dst-xlated ip=10.217.208.105 po
rt=135 session_id=247646 reason=Close - TCP FIN
# 2  
Old 11-27-2007
Assuming that a sample log file record is one on ONE line...
one way:
Code:
sed 's/.*dst_port=\([^ ][^ ]*\).*/\1/' myLogFile

P.S. Pls use vB Codes when quoting sample data/source - no line wraps either.
# 3  
Old 11-27-2007
Thankyou for your response.
Im presuming that I would need to be in vi to run the search command?
Or can I run this from my regular user prompt?

I have lots of files in one directory so to run vi I would need to consolidate all these files into one big file and run vi on the one consolidated file and complete the search??

Andy
# 4  
Old 11-27-2007
Quote:
Originally Posted by andyblaylock
Thankyou for your response.
Im presuming that I would need to be in vi to run the search command?
why are you presuming that?
Quote:
Originally Posted by andyblaylock
Or can I run this from my regular user prompt?
yes
Quote:
Originally Posted by andyblaylock

I have lots of files in one directory so to run vi I would need to consolidate all these files into one big file and run vi on the one consolidated file and complete the search??

Andy
I don't understand what 'vi' has to do what you're trying to do...
Copy a sample set of files to a 'sand-box' directory and execute the script on this directory ONLY. Once satisfied with the result - proceed to the 'real' thing.
# 5  
Old 11-27-2007
Thankyou,

I did not realize that sed is a stream editor, with my limited knowledge of unix when I viewed your response /s I related that to searching within vi.
Sorry for the confusion, I will give it a shot.

Andy
# 6  
Old 11-27-2007
Quote:
Originally Posted by vgersh99
Assuming that a sample log file record is one on ONE line...
one way:
Code:
sed 's/.*dst_port=\([^ ][^ ]*\).*/\1/' myLogFile

P.S. Pls use vB Codes when quoting sample data/source - no line wraps either.
The above code sed 's/.*dst_port=\([^ ][^ ]*\).*/\1/' myLogFile
, is this the sed command being used with regular expression syntax?
If so what does the s do, I know that / means search
Andy
# 7  
Old 11-27-2007
no, 's' is short for 'Search'. do 'man sed' to get a full description of the tool's capabilities.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Changing only the first space to a tab in a space delimited text file

Hi, I have a space delimited text file but I only want to change the first space to a tab and keep the rest of the spaces intact. How do I go about doing that? Thanks! (3 Replies)
Discussion started by: evelibertine
3 Replies

2. UNIX for Dummies Questions & Answers

Swap two rows in a space delimited text file?

Hi, How do you swap two rows in a space delimited text file? Thanks! (4 Replies)
Discussion started by: evelibertine
4 Replies

3. UNIX for Dummies Questions & Answers

Adding tags to a specific column of a space delimited text file

I have a space delimited text file with two columns. I would like to add NA to the first column of the text file. Input: 19625 10.4791768259 19700 10.8146489183 19701 10.9084026759 19702 10.9861346978 19703 10.9304364984 Output: NA19625 10.4791768259 NA19700 10.8146489183... (1 Reply)
Discussion started by: evelibertine
1 Replies

4. UNIX for Dummies Questions & Answers

Converting a text file with irregular spacing into a space delimited text file?

I have a text file with irregular spacing between values which makes it really difficult to manipulate. Is there an easy way to convert it into a space delimited text file so that all the spaces, double spaces, triple spaces, tabs between numbers are converted into spaces. The file looks like this:... (5 Replies)
Discussion started by: evelibertine
5 Replies

5. UNIX for Dummies Questions & Answers

Deleting lines that contain a specific string from a space delimited text file?

Hi, I have a space delimited text file that looks like the following: 250 rs10000056 0.04 0.0888 4 189321617 250 rs10000062 0.05 0.0435 4 5254744 250 rs10000064 0.02 0.2403 4 127809621 250 rs10000068 0.01 NA 250 rs1000007 0.00 0.9531 2 237752054 250 rs10000081 0.03 0.1400 4 17348363... (5 Replies)
Discussion started by: evelibertine
5 Replies

6. UNIX for Dummies Questions & Answers

How do you view specific columns from a space delimited text file?

I have a space delimited text file with 1,000,000+ columns? I would only like to view specific ones (let's say through 1:10), how can I do that? Thanks! (3 Replies)
Discussion started by: evelibertine
3 Replies

7. UNIX for Dummies Questions & Answers

How do you delete cells from a space delimited text file given row and column number?

How do you delete cells from a space delimited text file given row and column number? Letś say the row number is r and the column number is c. Thanks! (5 Replies)
Discussion started by: evelibertine
5 Replies

8. UNIX for Dummies Questions & Answers

Deleting cells that contain a specific number only from a space delimited text file

I have this space delimited large text file with more than 1,000,000+ columns and about 100 rows. I want to delete all the cells that consist of just 2 (leave 2's that are not by themselves intact): File before modification aa bb cc 2 NA100 dd aa b1 c2 2 NA102 de File after modification... (1 Reply)
Discussion started by: evelibertine
1 Replies

9. UNIX for Dummies Questions & Answers

Deleting columns from a space delimited text file

I have a space delimited text file with 1,000,000+ columns and 100 rows. I want to delete columns 2 through 5 (2 and 5) included from the text file. How do I do that? Thanks. (3 Replies)
Discussion started by: evelibertine
3 Replies

10. Shell Programming and Scripting

replace 3rd field of space delimited text file

how to replace the 3rd colum? Each line begins similarly, but they all ends variously. XX YY 03 variable text here XX YY 03 more variable text here XX YY 03 even more variable text here really long setence XX YY 03 variable numbers also appear 03 11. 123 456 XX YY 03 the occasional comma,... (4 Replies)
Discussion started by: ajp7701
4 Replies
Login or Register to Ask a Question