01-14-2007
Remove Data from Fields
I would like some sugestions on how to solve the following problem with removing selected data from fields. Each day I receive a file containing 22,000 records that I use a combination of awk and the cut command to remove unwanted fields. This is a work in process as I learn more about awk, sed and other tools.
The problem I am struggling with is how can i remove only the time stamp, days, day from the last field? I only want the number days in the last field. For days less than 1 if I can place a "0" in field great, I think a blank will work for now.
Below is a sample of the file output.
Thanks
|1|8|0|0|10 days, 5:35:33
|1|8|0|0|0:00:00
|1|8|0|0|18 days, 12:08:44
|1|8|0|0|0:09:25
|1|8|0|0|23:59:25
|1|8|0|0|1 day, 1:16:25
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Dear All,
I have some data file.see below.
--------------ALARM CLEARING FROM SubNetwork=ONRM_RootMo,SubNetwork=AXE,ManagedElement=CGSN--------------
Alarm Record ID: 25196304
Event Time: 2006-08-28 13:41:35
Event Type: ... (1 Reply)
Discussion started by: Nayanajith
1 Replies
2. Shell Programming and Scripting
Hey ,
I have a file and it's having spaces for some of the fields in it. Like the one below. I want to remove the spaces in them through out the file. The spaces occur randomly and i can't say which field is having space. So please help. Here is sample file with spaces after 5th field. (3 Replies)
Discussion started by: dsravan
3 Replies
3. Shell Programming and Scripting
Hi,
I have a source file as mentioned below: I want to remove all the extra spaces between the fields.
a b--------|sa df-------|3232---|3
sf sa------|afs sdf-----|43-----|33
a b c------|adfsa dsf---|23-32|23
*Here '-' idicates spaces
Now, I want output as below:
a b|sa df|3232|3... (7 Replies)
Discussion started by: srilaxmi
7 Replies
4. Shell Programming and Scripting
I'm working with a set of files where I'm trying to remove a set of characters from specific fields. The files are comma-delimited, and the characters I want to remove include:
- open parentheses - (
- close parentheses - )
- space followed by a dollar sign - $
I don't want to remove every... (1 Reply)
Discussion started by: HLee1981
1 Replies
5. Shell Programming and Scripting
Hi Friends,
I have large volume of data file as shown below.
Beganing or end of each filed, there are some blank spaces.
How do I remove those spaces?
AAA AAA1 | BBB BB1 BB2 |CC CCCC
DDDD DD | EEEEEEE EEEEEEEE | FFF FFFFFF FFFF
GG GGGGGG |HH HH ... (3 Replies)
Discussion started by: ppat7046
3 Replies
6. Shell Programming and Scripting
Hi,
I have a scenario like, I need to replace a hyphens(-) for date field alone in the file.
I have minus(-) sign for other fields it should remain as such, only for date fields hyphens must be removed. Please find the content for the file below:
sample.txt:
-----------... (4 Replies)
Discussion started by: G.K.K
4 Replies
7. Shell Programming and Scripting
Hi,
I am trying to use awk to remove all rows where the first 4 fields are duplicates. e.g. in the following data lines 6-9 would be removed, leaving one copy of the duplicated row (row 5)
Borgarhraun FH9822 ol24 FH9822_ol24_m20 ol Deformed c
Borgarhraun FH9822 ol24 ... (3 Replies)
Discussion started by: tomahawk
3 Replies
8. Shell Programming and Scripting
how can i remove records which have 2 same fields?
my file:
saeed 1 2 sa
vahid 2 3 45
reza 212 33 sa
amir 1 1 ui
reza 21 33 sa
i want to remove records which first and 3rd field of that are as the same, here line 3 and 5 must be removed. (3 Replies)
Discussion started by: saeed.soltani
3 Replies
9. UNIX for Dummies Questions & Answers
Hello Everyone,
I've got a comma-delimited file that looks like this:
0012,123 ,456 ,05/12/2014
0123,525 ,286 ,05/12/2014
0456,791 ,300 ,05/12/2014
1095,759 ,300 ,05/12/2014
1344,576 ,292 ,05/12/2014
1558,551 ,283 ,05/12/2014
002183719, , ... (9 Replies)
Discussion started by: Scottie1954
9 Replies
10. Shell Programming and Scripting
I am trying to cut a range of fields in awk. The below seems to work for removing field 50, but what is the correct syntax for removing a range ($50-$62). Thank you :).
awk
awk 'BEGIN{FS=OFS="\t"}{$50=""; gsub(/\t\t/,"\t")}1' test.vcf.hg19_multianno.txt > output.csv
Maybe:
awk... (6 Replies)
Discussion started by: cmccabe
6 Replies
LEARN ABOUT PHP
px_insert_record
PX_INSERT_RECORD(3) PX_INSERT_RECORD(3)
px_insert_record - Inserts record into paradox database
SYNOPSIS
int px_insert_record (resource $pxdoc, array $data)
DESCRIPTION
Inserts a new record into the database. The record is not necessarily inserted at the end of the database, but may be inserted at any
position depending on where the first free slot is found.
The record data is passed as an array of field values. The elements in the array must correspond to the fields in the database. If the
array has less elements than fields in the database, the remaining fields will be set to null.
Most field values can be passed as its equivalent php type e.g. a long value is used for fields of type PX_FIELD_LONG, PX_FIELD_SHORT and
PX_FIELD_AUTOINC, a double values is used for fields of type PX_FIELD_CURRENCY and PX_FIELD_NUMBER. Field values for blob and alpha fields
are passed as strings.
Fields of type PX_FIELD_TIME and PX_FIELD_DATE both require a long value. In the first case this is the number of milliseconds since mid-
night. In the second case this is the number of days since 1.1.0000. Below there are two examples to convert the current date or timestamp
into a value suitable for one of paradox's date/time fields.
Note
This function is only available if pxlib >= 0.6.0 is used.
PARAMETERS
o $pxdoc
- Resource identifier of the paradox database as returned by px_new(3).
o $data
- Associated or indexed array containing the field values as e.g. returned by px_retrieve_record(3).
RETURN VALUES
Returns FALSE on failure or the record number in case of success.
EXAMPLES
Example #1
Set the date/time fields in a paradox database to the current date/time
<?php
$px = px_new();
$fp = fopen("test.db", "w+");
px_create_fp($px, $fp, array(array("timestamp", "@"), array("time", "T"), array("date", "D")));
$curdate = getdate();
$jd = gregoriantojd($curdate["mon"], $curdate["mday"], $curdate["year"]);
$days = $jd - 1721425; /* Number of days between 1.1.4714 b.c. and 1.1.0000 */
$secs = $curdate["hours"]*3600 + $curdate["minutes"]*60 + $curdate["seconds"];
px_insert_record($px, array($days*86400000.0 + $secs*1000.0, $secs*1000.0, $days));
$curtimestamp = microtime(true);
$days = (int) ($curtimestamp/86400);
$secs = $curtimestamp - ($days * 86400.0);
$days += 2440588; /* Number of days between 1.1.4714 b.c. and 1.1.1970 */
$days -= 1721425; /* Number of days between 1.1.4714 b.c. and 1.1.0000 */
px_insert_record($px, array($days*86400000.0 + $secs*1000.0, $secs*1000.0, $days));
for($i=0; $i<2; $i++) {
$rec = px_retrieve_record($px, $i);
echo px_timestamp2string($px, $rec["timestamp"], "n/d/Y H:i:s")."
";
echo px_date2string($px, $rec["date"], "n/d/Y")."
";
}
px_close($px);
px_delete($px);
?>
The above example will output:
2/21/2006 21:42:30
2/21/2006
2/21/2006 20:42:30
2/21/2006
The Julian day count as passed to jdtogregorian(3) has a different base of 1.1.4714 b.c. and must therefore be calculated by adding
1721425 to the day count used in the paradox file. Turning the day count into a timestamp is easily done by multiplying with 86400000.0 to
obtain milli seconds.
SEE ALSO
px_update_record(3)
PHP Documentation Group PX_INSERT_RECORD(3)