01-28-2009
looking for some AWK help... hmmm maybe SED...???
ladies and gents..
im trying to do a surgical search and replace though a 3 GB file;
any timestamp fields that are spaces need to be changed to null
any numerics that are spaces need to be changed to null
so...
say i have a flat file such as this
numeric, char, numeric, date, char
pk|fname|weight|bday|city
1|john| |10-JAN-08|raleigh
2|steph|12| |denver
3|jane|8|21-MAR-01|atlanta
4|eric||06-APR-82|atherton
for any numeric or date field that contains all spaces, i.e.:
row 1 field 3, row 2 field 4
replace the spaces to make a null, such as:
1|john||10-JAN-08|raleigh
2|steph|12||denver
3|jane|8|21-MAR-01|atlanta
4|eric||06-APR-82|atherton
i was thinking something like:
BEGIN {
RS="\n"
FS="|"
}
{
if ($3==" ") {
$3="";
}
if ($4==" ") {
$4="";
}
print $1","$2","$3","$4","$5
}
is awk the way to go with this, or sed with a regex the way i should do it...
thanks much..
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have many messages such as the test message below:
00:00000:00021:2002/05/13 13:57:00.51 ERROR:- Test error, my test error!!!
I am writing a script in which I need to get everything from the word "ERROR:-" onwards.
I normally use awk for these things, but I am not an expert at it so i am... (6 Replies)
Discussion started by: baileyr1
6 Replies
2. Shell Programming and Scripting
Hi,
I know sed is stream text editor and not a bit more than that. Can anyone explain its usage and advantages?
How is awk different from sed?
I donno i am a bit confused about it. But i have coded in awk and shell.
Thanks,
Nisha
:confused: (7 Replies)
Discussion started by: Nisha
7 Replies
3. UNIX for Advanced & Expert Users
Hey all,
Can I put sed command inside the awk action ?? If not then can i do grep in the awk action ??
For ex:
awk '$1=="174" { ppid=($2) ; sed -n '/$ppid/p' tempfind.txt ; }' tempfind.txt
Assume: 174 is string.
Assume: tempfind.txt is used for awk and sed both.
tempfind.txt... (11 Replies)
Discussion started by: varungupta
11 Replies
4. UNIX for Advanced & Expert Users
Hi,
I have a data file with 5 columns - like this:
"20080401 09:43:08.770798 +0100s","TEST 1","R 1","A TEST","Nov 27 2007","1"
"20080401 09:43:08.770798 +0100s","THIS IS A TEST","R 2","B TEST","Nov 30 2007","10"
"20080401 09:43:08.770798 +0100s","ANOTHER TEST","R 3","B TEST","Nov 05... (7 Replies)
Discussion started by: MrG-San
7 Replies
5. UNIX for Dummies Questions & Answers
I've got an inventory database with eight columns with things like product name, manufacturer, UPC code, etc. on each line. Our PO (purchase order) number is in the first column. I can grep the date and get the full line of data but I would like to strip out everything but the PO number in the... (5 Replies)
Discussion started by: NetJones
5 Replies
6. Shell Programming and Scripting
What if I wanted to add a word such as IT after the first character and if theres 3 characters, after the 2nd character?
output would be:
G, it H
G, H it P
G, H, P it L
I'm thinking that AWK would be the easiest way to do this... Currently looking it up.
Right now I'm using awk but I... (13 Replies)
Discussion started by: puttster
13 Replies
7. Shell Programming and Scripting
Hi All,
Is there a way of comparing two columns in the same file and deleting the row if the values of the columns match.
I have the sample data file as below.
M024900|175309.00|968.00|17
M025001|19861.79|97.90|148
M025002|431.70|159.00|3
M025003|912.30|159.90|6 ... (6 Replies)
Discussion started by: nua7
6 Replies
8. UNIX for Dummies Questions & Answers
I have a file that contain the data below:
B1
1
2
3
B2
20
30
40
B3
7
8
B4
100
B5
21
22
23How can I retrieve the data for B1 into a seperate file. (8 Replies)
Discussion started by: bobo
8 Replies
9. Shell Programming and Scripting
Dear Geeks,
I want to manipulate a file with certain modifications for that using sed or AWK how to do this process for one file i have this type of data.
Input File:
"Restricted and Reserved names .ANISH",3798,"TEST.CO",1201208,6/16/10 0:00,6/16/13 0:00,,,"CO","2nd"^M
"Restricted and... (4 Replies)
Discussion started by: anishkumarv
4 Replies
10. Shell Programming and Scripting
Hi,
I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :-
./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies
LEARN ABOUT DEBIAN
apr::request::hook
Hook(3pm) User Contributed Perl Documentation Hook(3pm)
NAME
APR::Request::Hook - wrapper for libapreq2's hook API.
SYNOPSIS
use APR::Request::Hook;
DESCRIPTION
This manpage documents version 2.13 of the APR::Request::Hook package.
METHODS
APR::Request::Hook
disable_uploads
APR::Request::Hook->disable_uploads($pool)
APR::Request::Hook->disable_uploads($pool, $next)
Hook which returns APREQ_ERROR_GENERAL if a file upload field is detected. $pool is an APR::Pool object; $next (if present) is the next
APR::Request::Hook in the chain.
apr_xml_parser
APR::Request::Hook->apr_xml_parser($pool)
APR::Request::Hook->apr_xml_parser($pool, $next)
Xml parser hook. $pool is an APR::Pool object; $next (if present) is the next APR::Request::Hook in the chain.
discard_brigade
APR::Request::Hook->discard_brigade($pool)
APR::Request::Hook->discard_brigade($pool, $next)
Hook which discards the brigade it receives from the parser. $pool is an APR::Pool object; $next (if present) is the next
APR::Request::Hook in the chain.
SEE ALSO
APR::Request, APR::Request::Parser
COPYRIGHT
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
perl v5.10.1 2011-02-28 Hook(3pm)