Help with sed


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with sed
# 1  
Old 06-22-2010
Help with sed

Hi All, Here is my problem. I have a file with lots of lines in them. I need to find a pattern that looks like "21/06/2010 21:50:06 [5] " (with out double quotes) and replace it with enter.(Bring the rest of the text following it to newline) I was able to do it in VI but I need to do this via script. Please help thanks. John
# 2  
Old 06-22-2010
try:
Code:
sed 's|21/06/2010 21:50:06 \[5\] |\n|' infile

# 3  
Old 06-22-2010
i used it as following
Code:
sed 's|[0-9][0-9]/[0-9][0-9]/2010 [0-9][0-9]:[0-9][0-9]:[0-9][0-9] \[[0-9]*\] |\n|'

looks like it did it for few of them there are more partterns in between like "D:*/EXCLUSIVEISSUER%20OR%2021/06/2010 21:50:00 [10] action " where it dint do it.

Please suggest

Last edited by Scott; 06-22-2010 at 04:47 AM.. Reason: Please use code tags
# 4  
Old 06-22-2010
It seems to work fine for your example
Code:
$ echo 'D:*/EXCLUSIVEISSUER%20OR%2021/06/2010 21:50:00 [10] action ' | 
sed 's|[0-9][0-9]/[0-9][0-9]/2010 [0-9][0-9]:[0-9][0-9]:[0-9][0-9] \[[0-9]*\] |\n|'
D:*/EXCLUSIVEISSUER%20OR%20
action

Can you post a sample input file?
# 5  
Old 06-22-2010
looks like its not global.

here is the example
21/06/2010 21:50:06 [5] action=getQueryTagValues&Combine=Simple&DocumentCount=False&MatchAllTerms=false&AnyLanguage=true&Out pu
tEncoding=UTF8&DatabaseMatch=selects&FieldName=COUNTRYID&Text=*&FieldText=(((EXISTS%7B%7D:*/PREREL_DATE+AND+LTNOW%7B%7D:*/PRER
EL_DATE)+OR+((NOT%20EXISTS%7B%7D:*/PREREL_DATE)+AND+LTNOW%7B%7D:*/RELDATE)))+AND+(GTNOW%7B%7D:*/EXPDATE)+AND+((MATCH%7B0fff2a0
c2f13a110VgnVCM2000001b45640aRCRD%7D:ISSUERWHITELIST)+OR+((NOT(MATCH%7B0fff2a0c2f13a110VgnVCM2000001 b45640aRCRD%7D:ISSUERBLACK
LIST))+AND+(((MATCH%7Blocal%7D:LOCALONLY)+AND+(MATCH%7Bccfb43b68d898110VgnVCM2000007cc6410aRCRD%7D:C OUNTRYID))+OR+((MATCH%7Bto
urist%7D:LOCALONLY)+AND+(NOT(MATCH%7Bccfb43b68d898110VgnVCM2000007cc6410aRCRD%7D:COUNTRYID)))+OR+(MA TCH%7Bglobal%7D:LOCALONLY)
)+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEPROGRAM%20OR%20%20MATCH%7Bna%7D:EXCLUSIVEPROGRAM)+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEISSU
ER%20OR%20%20MATCH%7B0fff2a0c2f13a110VgnVCM2000001b45640aRCRD%7D:EXCLUSIVEISSUER)))&Start=121&MaxVal ues=180 (10.100.69.8)
21/06/2010 21:50:07 [10] action=getQueryTagValues&Combine=Simple&DocumentCount=True&MatchAllTerms=false&AnyLanguage=true&Outp u
tEncoding=UTF8&DatabaseMatch=selects&FieldName=/DOCS/DOCUMENT/CATEGORY&Text=4ad6124c73ce8110VgnVCM2000007cc6410aRCRD&FieldText
=(((EXISTS%7B%7D:*/PREREL_DATE+AND+LTNOW%7B%7D:*/PREREL_DATE)+OR+((NOT%20EXISTS%7B%7D:*/PREREL_DATE)+AND+LTNOW%7B%7D:*/RELDATE
)))+AND+(GTNOW%7B%7D:*/EXPDATE)+AND+((MATCH%7B801e64cab49ba110VgnVCM2000001b45640aRCRD%7D:ISSUERWHITELIST)+OR+((NOT(MATCH%7 B80
1e64cab49ba110VgnVCM2000001b45640aRCRD%7D:ISSUERBLACKLIST))+AND+(((MATCH%7Blocal%7D:LOCALONLY)+AND+( MATCH%7B4ad6124c73ce8110Vg
nVCM2000007cc6410aRCRD%7D:COUNTRYID))+OR+((MATCH%7Btourist%7D:LOCALONLY)+AND+(NOT(MATCH%7B4ad6124c73 ce8110VgnVCM2000007cc6410a
RCRD%7D:COUNTRYID)))+OR+(MATCH%7Bglobal%7D:LOCALONLY))+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEPROGRAM%20OR%20%20MATCH%7Bna%7D:EXCL
USIVEPROGRAM)+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEISSUER%20OR%20%20MATCH%7B801e64cab49ba110VgnVCM2000001b45640aRCRD%7D:EXCLUSIV
EISSUER)))&21/06/2010 21:50:07 [5] action=getQueryTagValues&Combine=Simple&DocumentCount=True&MatchAllTerms=false&AnyLanguage=
true&OutputEncoding=UTF8&DatabaseMatch=selects&FieldName=/DOCS/DOCUMENT/CATEGORY&Text=c459f8421068d110VgnVCM1000001445640aRCRD
&FieldText=(((EXISTS%7B%7D:*/PREREL_DATE+AND+LTNOW%7B%7D:*/PREREL_DATE)+OR+((NOT%20EXISTS%7B%7D:*/PREREL_DATE)+AND+LTNOW%7B%7D
:*/RELDATE)))+AND+(GTNOW%7B%7D:*/EXPDATE)+AND+((MATCH%7B801e64cab49ba110VgnVCM2000001b45640aRCRD%7D:ISSUERWHITELIST)+OR+((NOT(
MATCH%7B801e64cab49ba110VgnVCM2000001b45640aRCRD%7D:ISSUERBLACKLIST))+AND+(((MATCH%7Blocal%7D:LOCALO NLY)+AND+(MATCH%7Bc459f842
1068d110VgnVCM1000001445640aRCRD%7D:COUNTRYID))+OR+((MATCH%7Btourist%7D:LOCALONLY)+AND+(NOT(MATCH%7B c459f8421068d110VgnVCM1000
001445640aRCRD%7D:COUNTRYID)))+OR+(MATCH%7Bglobal%7D:LOCALONLY))+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEPROGRAM%20OR%20%20MATCH%7B
na%7D:EXCLUSIVEPROGRAM)+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEISSUER%20OR%20%20MATCH%7B801e64cab49ba110VgnVCM2000001b45640aRCRD%7
D:EXCLUSIVEISSUER)))&M21/06/2010 21:50:07 [10] action=query&Combine=Simple&TotalResults=true&MatchAllTerms=true&AnyLanguage=tr
ue&OutputEncoding=UTF8&LanguageType=englishUTF8&DatabaseMatch=selects&Text=5718625f12ac8110VgnVCM100 00018c6410aRCRD&FieldText=
(LTNOW%7B%7D:*/RELDATE)+AND+(GTNOW%7B%7D:*/EXPDATE)+AND+((MATCH%7B/amexnetwork/category/Shopping/Jewelry_and_Accessories%7D:CA
TEGORY)+AND+(((MATCH%7Blocal%7D:LOCALONLY)+AND+(MATCH%7Bdf18e8f8d0aad110VgnVCM2000001b45640aRCRD%7D: COUNTRYID))+OR+((MATCH%7Bt
ourist%7D:LOCALONLY)+AND+(NOT(MATCH%7Bdf18e8f8d0aad110VgnVCM2000001b45640aRCRD%7D:COUNTRYID)))+OR+(M ATCH%7Bglobal%7D:LOCALONLY
))+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEPROGRAM%20OR%20%20MATCH%7Bna%7D:EXCLUSIVEPROGRAM)+AND+(NOT%20EXISTS%7B%7D:*/EXCLUSIVEISS
UER%20OR%20%20MATCH%7Bna%7D:EXCLUSIVEISSUER))&MaxResults=1&PrintFields=FEATURED (10.100.69.8)
# 6  
Old 06-22-2010
your code is seem correct such Scrutinizer's said also

maybe you can try this
Code:
 
sed 's@[0-9][0-9]/.*/.*:.*:.*\[.*\]@\n@g' infile

regards
ygemici
# 7  
Old 06-22-2010
Indeed like ygemici suggests, try the global option, e.g.
Code:
sed 's|[0-9][0-9]/[0-9][0-9]/2010 [0-9][0-9]:[0-9][0-9]:[0-9][0-9] \[[0-9]*\] |\n|g'

This User Gave Thanks to Scrutinizer For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

I am learning regular expression in sed,Please help me understand the use curly bracket in sed,

I am learning SED and just following the shell scripting book, i have trouble understanding the grep and sed statement, Question : 1 __________ /opt/oracle/work/antony>cat teledir.txt jai sharma 25853670 chanchal singhvi 9831545629 anil aggarwal 9830263298 shyam saksena 23217847 lalit... (7 Replies)
Discussion started by: Antony Ankrose
7 Replies

2. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

3. Shell Programming and Scripting

sed inside sed for replacing string

My need is : Want to change docBase="/something/something/something" to docBase="/only/this/path/for/all/files" I have some (about 250 files)xml files. In FileOne it contains <Context path="/PPP" displayName="PPP" docBase="/home/me/documents" reloadable="true" crossContext="true">... (1 Reply)
Discussion started by: linuxadmin
1 Replies

4. Shell Programming and Scripting

How to use sed to replace the a string in the same file using sed?

How do i replace a string using sed into the same file without creating a intermediate file? (7 Replies)
Discussion started by: gomes1333
7 Replies

5. UNIX for Dummies Questions & Answers

SED: Can't Repeat Search Character in SED Output

I'm not sure if the problem I'm seeing is an artifact of sed or simply a beginner's mistake. Here's the problem: I want to add a zero-width space following each underscore between XML tags. For example, if I had the following xml: <MY_BIG_TAG>This_is_a_test</MY_BIG_TAG> It should look like... (8 Replies)
Discussion started by: rhetoric101
8 Replies

6. Shell Programming and Scripting

deleting text records with sed (sed paragraphs)

Hi all, First off, Thank you all for the knowledge I have gleaned from this site! Deleting Records from a text file... sed paragraphs The following code works nearly perfect, however each time it is run on the log file it adds a newline at the head of the file, run it 5 times, it'll have 5... (1 Reply)
Discussion started by: Festus Hagen
1 Replies

7. Shell Programming and Scripting

sed has zeored my files. Help me with sed please

i made a script to update a lot of xml files. to save me some time. Ran it and it replaced all the the files with a 0kb file. The problem i was having is that I am using sed to change xml node <doc_root>. The problem with this is it has a / in the closing xml tag and the stuff inside will also have... (4 Replies)
Discussion started by: timgolding
4 Replies

8. Shell Programming and Scripting

sed over writes my original file (using sed to remove leading spaces)

Hello and thx for reading this I'm using sed to remove only the leading spaces in a file bash-280R# cat foofile some text some text some text some text some text bash-280R# bash-280R# sed 's/^ *//' foofile > foofile.use bash-280R# cat foofile.use some text some text some text... (6 Replies)
Discussion started by: laser
6 Replies

9. Shell Programming and Scripting

Issue with a sed one liner variant - sed 's/ ; /|/g' $TMP1 > $TMP

Execution of the following segment is giving the error - Script extract:- OUT=$DATADIR/sol_rsult_orphn.bcp TMP1=${OUT}_tmp1 TMP=${OUT}_tmp ( isql -w 400 $dbConnect_OPR <<EOF select convert(char(10), s.lead_id) +'|' + s.pho_loc_type, ";", s.sol_rsult_cmnt, ";", +'|'+ s.del_ind... (3 Replies)
Discussion started by: kzmatam
3 Replies

10. Shell Programming and Scripting

Sed Question 1. (Don't quite know how to use sed! Thanks)

Write a sed script to extract the year, rank, and stock for the most recent 10 years available in the file top10_mktval.csv, and output in the following format: ------------------------------ YEAR |RANK| STOCK ------------------------------ 2007 | 1 | Exxon... (1 Reply)
Discussion started by: beibeiatNY
1 Replies
Login or Register to Ask a Question