04-02-2008
Awk or Sed help
Hi,
I have a data file with 5 columns - like this:
"20080401 09:43:08.770798 +0100s","TEST 1","R 1","A TEST","Nov 27 2007","1"
"20080401 09:43:08.770798 +0100s","THIS IS A TEST","R 2","B TEST","Nov 30 2007","10"
"20080401 09:43:08.770798 +0100s","ANOTHER TEST","R 3","B TEST","Nov 05 2007","14"
I would like to delete the last two values e.g. ,"Nov 05 2007","14"
How can I do this using sed or awk?
Many Thanks!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have many messages such as the test message below:
00:00000:00021:2002/05/13 13:57:00.51 ERROR:- Test error, my test error!!!
I am writing a script in which I need to get everything from the word "ERROR:-" onwards.
I normally use awk for these things, but I am not an expert at it so i am... (6 Replies)
Discussion started by: baileyr1
6 Replies
2. Shell Programming and Scripting
Hi,
I know sed is stream text editor and not a bit more than that. Can anyone explain its usage and advantages?
How is awk different from sed?
I donno i am a bit confused about it. But i have coded in awk and shell.
Thanks,
Nisha
:confused: (7 Replies)
Discussion started by: Nisha
7 Replies
3. Shell Programming and Scripting
Hi there,
I'm trying to process a comma delimited file to remove the seconds:
916901,0,488589834,TRADE,Trade, ,2002-07-2510:14:43.387,CITI.MW,970847, , , ,808.0,2526.0,0.0,0.0,-1
So basically the .*** from the 7th field
Any help appreciated
Jon (4 Replies)
Discussion started by: orange_one
4 Replies
4. UNIX for Advanced & Expert Users
Hey all,
Can I put sed command inside the awk action ?? If not then can i do grep in the awk action ??
For ex:
awk '$1=="174" { ppid=($2) ; sed -n '/$ppid/p' tempfind.txt ; }' tempfind.txt
Assume: 174 is string.
Assume: tempfind.txt is used for awk and sed both.
tempfind.txt... (11 Replies)
Discussion started by: varungupta
11 Replies
5. UNIX for Dummies Questions & Answers
I've got an inventory database with eight columns with things like product name, manufacturer, UPC code, etc. on each line. Our PO (purchase order) number is in the first column. I can grep the date and get the full line of data but I would like to strip out everything but the PO number in the... (5 Replies)
Discussion started by: NetJones
5 Replies
6. Shell Programming and Scripting
What if I wanted to add a word such as IT after the first character and if theres 3 characters, after the 2nd character?
output would be:
G, it H
G, H it P
G, H, P it L
I'm thinking that AWK would be the easiest way to do this... Currently looking it up.
Right now I'm using awk but I... (13 Replies)
Discussion started by: puttster
13 Replies
7. Shell Programming and Scripting
Hi All,
Is there a way of comparing two columns in the same file and deleting the row if the values of the columns match.
I have the sample data file as below.
M024900|175309.00|968.00|17
M025001|19861.79|97.90|148
M025002|431.70|159.00|3
M025003|912.30|159.90|6 ... (6 Replies)
Discussion started by: nua7
6 Replies
8. UNIX for Dummies Questions & Answers
I have a file that contain the data below:
B1
1
2
3
B2
20
30
40
B3
7
8
B4
100
B5
21
22
23How can I retrieve the data for B1 into a seperate file. (8 Replies)
Discussion started by: bobo
8 Replies
9. Shell Programming and Scripting
Dear Geeks,
I want to manipulate a file with certain modifications for that using sed or AWK how to do this process for one file i have this type of data.
Input File:
"Restricted and Reserved names .ANISH",3798,"TEST.CO",1201208,6/16/10 0:00,6/16/13 0:00,,,"CO","2nd"^M
"Restricted and... (4 Replies)
Discussion started by: anishkumarv
4 Replies
10. Shell Programming and Scripting
Hi,
I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :-
./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies
LEARN ABOUT SUSE
mail::spamassassin::plugin::shortcircuit
Mail::SpamAssassin::Plugin::Shortcircuit(3) User Contributed Perl Documentation Mail::SpamAssassin::Plugin::Shortcircuit(3)
NAME
Mail::SpamAssassin::Plugin::Shortcircuit - short-circuit evaluation for certain rules
SYNOPSIS
loadplugin Mail::SpamAssassin::Plugin::Shortcircuit
report Content analysis details: (_SCORE_ points, _REQD_ required, s/c _SCTYPE_)
add_header all Status "_YESNO_, score=_SCORE_ required=_REQD_ tests=_TESTS_ shortcircuit=_SCTYPE_ autolearn=_AUTOLEARN_ version=_VERSION_"
DESCRIPTION
This plugin implements simple, test-based shortcircuiting. Shortcircuiting a test will force all other pending rules to be skipped, if
that test is hit. In addition, a symbolic rule, "SHORTCIRCUIT", will fire.
Recomended usage is to use "priority" to set rules with strong S/O values (ie. 1.0) to be run first, and make instant spam or ham
classification based on that.
CONFIGURATION SETTINGS
The following configuration settings are used to control shortcircuiting:
shortcircuit SYMBOLIC_TEST_NAME {ham|spam|on|off}
Shortcircuiting a test will force all other pending rules to be skipped, if that test is hit.
Recomended usage is to use "priority" to set rules with strong S/O values (ie. 1.0) to be run first, and make instant spam or ham
classification based on that.
To override a test that uses shortcircuiting, you can set the classification type to "off".
on Shortcircuits the rest of the tests, but does not make a strict classification of spam or ham. Rather, it uses the default score
for the rule being shortcircuited. This would allow you, for example, to define a rule such as
body TEST /test/
describe TEST test rule that scores barely over spam threshold
score TEST 5.5
priority TEST -100
shortcircuit TEST on
The result of a message hitting the above rule would be a final score of 5.5, as opposed to 100 (default) if it were classified as
spam.
off Disables shortcircuiting on said rule.
spam
Shortcircuit the rule using a set of defaults; override the default score of this rule with the score from
"shortcircuit_spam_score", set the "noautolearn" tflag, and set priority to "-100". In other words, equivalent to:
shortcircuit TEST on
priority TEST -100
score TEST 100
tflags TEST noautolearn
ham Shortcircuit the rule using a set of defaults; override the default score of this rule with the score from
"shortcircuit_ham_score", set the "noautolearn" and "nice" tflags, and set priority to "-100". In other words, equivalent to:
shortcircuit TEST on
priority TEST -100
score TEST -100
tflags TEST noautolearn nice
shortcircuit_spam_score n.nn (default: 100)
When shortcircuit is used on a rule, and the shortcircuit classification type is set to "spam", this value should be applied in place
of the default score for that rule.
shortcircuit_ham_score n.nn (default: -100)
When shortcircuit is used on a rule, and the shortcircuit classification type is set to "ham", this value should be applied in place of
the default score for that rule.
TAGS
The following tags are added to the set available for use in reports, headers etc.:
_SC_ shortcircuit status (classification and rule name)
_SCRULE_ rulename that caused the shortcircuit
_SCTYPE_ shortcircuit classification ("spam", "ham", "default", "none")
SEE ALSO
"http://issues.apache.org/SpamAssassin/show_bug.cgi?id=3109"
perl v5.12.1 2010-03-16 Mail::SpamAssassin::Plugin::Shortcircuit(3)