Sponsored Content
Top Forums Shell Programming and Scripting awk command on .DAT file not working? Post 302767413 by sagar.cumar on Wednesday 6th of February 2013 10:35:35 PM
Old 02-06-2013
awk command on .DAT file not working?

Hi All,

I am trying to run awk command on .DAT file and it is not working. The same command is working on .txt file:
Contents of the file ZZ_55555555_444444_ZZZZZZ_7777777_888_99.DAT:

Code:
HEADER|ZZ_55555555_444444_ZZZZZZ_7777777_888_99.DAT
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|A|YY|111111111|111111111|111111111||111111111|15|3|NNNNNN|Y||1|AAA|ZZZ|Y|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|A|AA|111111111|111111111|111111111||111111111|30|3|NNNNNN|Y||1|AAA|ZZZ|Y|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|B|YY|111111111|111111111|111111111|111111111|15|3|NNNNNN|Y|3|AAA|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|B|AA|111111111|111111111|111111111|111111111|15|3|NNNNNN|Y|3|AAA|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|C|YY|111111111|111111111|111111111|111111111|15|1|NNNNNN|N|4|AAA|BBB|N|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|C|AA|111111111|111111111|111111111|111111111|15|1|NNNNNN|N|4|AAA|BBB|N|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|D|YY|111111111|111111111|111111111|111111111|45|NNNNNN|Y|IND|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|D|AA|111111111|111111111|111111111|111111111|45|NNNNNN|Y|IND|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|E|YY|111111111|111111111|111111111||111111111|3|N|N|Y|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|E|AA|111111111|111111111|111111111||111111111|3|N|N|Y|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|F|YY|111111111|111111111|111111111|111111111|3|N|Y|111111111
XXXXXXX|YYYYYYY|ZZZZZZZZZZ|12334446456|F|AA|111111111|111111111|111111111|111111111|3|N|Y|111111111
TRAILER|0000000012

Command I am using is below:
Code:
awk -F'|' -v FN=DAT_FILENAME '/^[0-9]/{o=FN "_" $5 ".DAT";print $0 >>o}' ZZ_55555555_444444_ZZZZZZ_7777777_888_99.DAT

Could any one please advise.

Thanks a lot in advance.

Sagar.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk system() command not working

I am using Sun Solaris 5.8 I am trying to run a system command such as ls and echo inside awk, but when I run the following code system echo is not displayed. bash-2.03$ ls | awk 'BEGIN { print "first print" system("echo system echo") print "second print" ... (1 Reply)
Discussion started by: rakeshou
1 Replies

2. Shell Programming and Scripting

awk command not working

Hi all, Trying to write a script that reads a file and prints everything after a certain string is found to the end of the file. Awk is giving me an error and not sure why it doesn't work: # cat test_file Mon Nov 16 2009 16:11:08 abc def Tue Nov 17 2009 16:08:06 ghi jkl Wed Nov 18... (8 Replies)
Discussion started by: jamie_collins
8 Replies

3. Shell Programming and Scripting

Remove interspersed headers in .dat file with AWK

Heya there, A small selection of my data is shown below. DATE TIME FRAC_DAYS_SINCE_JAN1 2011-06-25 08:03:20.000 175.33564815 2011-06-25 08:03:25.000 175.33570602 2011-06-25 ... (4 Replies)
Discussion started by: gd9629
4 Replies

4. Shell Programming and Scripting

Compute average ignoring outliers of different segments within a dat file using awk

I have data files that look like this, say data.txt 0.00833 6.34 0.00833 6.95 0.00833 7.08 0.00833 8.07 0.00833 8.12 0.00833 8.26 0.00833 8.70 0.00833 9.36 0.01667 20.53 0.01667 6.35 0.01667 6.94 0.01667 7.07 0.01667 8.06 0.01667 8.10 0.01667 8.25 0.01667 8.71 0.01667 9.31... (7 Replies)
Discussion started by: malandisa
7 Replies

5. Shell Programming and Scripting

Awk: System command not working in awk

Hi, I have around 10 files in a folder in which I want to change the file format from tab(\t) to pipe(|) with some changes in the fields as well. Below is the code, while tmp file is getting generated but move command is not working, please help Following is the code awk -F"\t" '{print... (2 Replies)
Discussion started by: siramitsharma
2 Replies

6. Shell Programming and Scripting

awk command not working as expected

Following one line of awk code removes first 3 characters from each line but when I run the same code on another linux platform it doesn't work and only prints blank lines for each record. Can anyone please explain why this doesn't work? (31 Replies)
Discussion started by: later_troy
31 Replies

7. Shell Programming and Scripting

Help with Getting distinct record count from a .dat file using UNIX command

Hi, I have a .dat file with contents like the below: Input file ============SEQ NO-1: COLUMN1========== 9835619 7152815 ============SEQ NO-2: COLUMN2 ========== 7615348 7015548 9373086 ============SEQ NO-3: COLUMN3=========== 9373086 Expected Output: (I just... (1 Reply)
Discussion started by: MS06
1 Replies

8. Shell Programming and Scripting

How to use 'ls' command to list files like *.dat, not *.*.dat?

How to use 'ls' command to list files like *.dat, not *.*.dat (5 Replies)
Discussion started by: pmcginni777
5 Replies

9. Shell Programming and Scripting

Execute a Command in a .Dat File and use it in other Files

We have a process where we store the database password in a config file like below from where the password is picked up and used in Database Scripts ID, Password But we now have a Audit Requirement not to have the passwords in Config Files directly. We have a command which could fetch the... (2 Replies)
Discussion started by: infernalhell
2 Replies

10. Shell Programming and Scripting

Using sed command to replace "|" with ^ for all *.dat files in a folder not working

I am trying to use the below sed command to replace all "|" to ^, in a folder had 50 dat files. when i tried with 1 file it worked but when i tried with wild card, is not working. sed -i 's/"|"/\^/g' *.dat Is this the proper way to use sed command thank you very much for help. (3 Replies)
Discussion started by: cplusplus1
3 Replies
regalgebra(7)							SAORD Documentation						     regalgebra(7)

NAME
RegAlgebra - Boolean Algebra on Spatial Regions SYNOPSIS
This document describes the boolean arithmetic defined for region expressions. DESCRIPTION
When defining a region, several shapes can be combined using boolean operations. The boolean operators are (in order of precedence): Symbol Operator Associativity ------ -------- ------------- ! not right to left & and left to right ^ exclusive or left to right | inclusive or left to right For example, to create a mask consisting of a large circle with a smaller box removed, one can use the and and not opera- tors: CIRCLE(11,11,15) & !BOX(11,11,3,6) and the resulting mask is: 1234567890123456789012345678901234567890 ---------------------------------------- 1:1111111111111111111111.................. 2:1111111111111111111111.................. 3:11111111111111111111111................. 4:111111111111111111111111................ 5:111111111111111111111111................ 6:1111111111111111111111111............... 7:1111111111111111111111111............... 8:1111111111111111111111111............... 9:111111111...1111111111111............... 10:111111111...1111111111111............... 11:111111111...1111111111111............... 12:111111111...1111111111111............... 13:111111111...1111111111111............... 14:111111111...1111111111111............... 15:1111111111111111111111111............... 16:1111111111111111111111111............... 17:111111111111111111111111................ 18:111111111111111111111111................ 19:11111111111111111111111................. 20:1111111111111111111111.................. 21:1111111111111111111111.................. 22:111111111111111111111................... 23:..11111111111111111..................... 24:...111111111111111...................... 25:.....11111111111........................ 26:........................................ 27:........................................ 28:........................................ 29:........................................ 30:........................................ 31:........................................ 32:........................................ 33:........................................ 34:........................................ 35:........................................ 36:........................................ 37:........................................ 38:........................................ 39:........................................ 40:........................................ A three-quarter circle can be defined as: CIRCLE(20,20,10) & !PIE(20,20,270,360) and looks as follows: 1234567890123456789012345678901234567890 ---------------------------------------- 1:........................................ 2:........................................ 3:........................................ 4:........................................ 5:........................................ 6:........................................ 7:........................................ 8:........................................ 9:........................................ 10:........................................ 11:...............111111111................ 12:..............11111111111............... 13:............111111111111111............. 14:............111111111111111............. 15:...........11111111111111111............ 16:..........1111111111111111111........... 17:..........1111111111111111111........... 18:..........1111111111111111111........... 19:..........1111111111111111111........... 20:..........1111111111111111111........... 21:..........1111111111.................... 22:..........1111111111.................... 23:..........1111111111.................... 24:..........1111111111.................... 25:...........111111111.................... 26:............11111111.................... 27:............11111111.................... 28:..............111111.................... 29:...............11111.................... 30:........................................ 31:........................................ 32:........................................ 33:........................................ 34:........................................ 35:........................................ 36:........................................ 37:........................................ 38:........................................ 39:........................................ 40:........................................ Two non-intersecting ellipses can be made into the same region: ELL(20,20,10,20,90) | ELL(1,1,20,10,0) and looks as follows: 1234567890123456789012345678901234567890 ---------------------------------------- 1:11111111111111111111.................... 2:11111111111111111111.................... 3:11111111111111111111.................... 4:11111111111111111111.................... 5:1111111111111111111..................... 6:111111111111111111...................... 7:1111111111111111........................ 8:111111111111111......................... 9:111111111111............................ 10:111111111............................... 11:...........11111111111111111............ 12:........111111111111111111111111........ 13:.....11111111111111111111111111111...... 14:....11111111111111111111111111111111.... 15:..11111111111111111111111111111111111... 16:.1111111111111111111111111111111111111.. 17:111111111111111111111111111111111111111. 18:111111111111111111111111111111111111111. 19:111111111111111111111111111111111111111. 20:111111111111111111111111111111111111111. 21:111111111111111111111111111111111111111. 22:111111111111111111111111111111111111111. 23:111111111111111111111111111111111111111. 24:.1111111111111111111111111111111111111.. 25:..11111111111111111111111111111111111... 26:...11111111111111111111111111111111..... 27:.....11111111111111111111111111111...... 28:.......111111111111111111111111......... 29:...........11111111111111111............ 30:........................................ 31:........................................ 32:........................................ 33:........................................ 34:........................................ 35:........................................ 36:........................................ 37:........................................ 38:........................................ 39:........................................ 40:........................................ You can use several boolean operations in a single region expression, to create arbitrarily complex regions. With the important exception below, you can apply the operators in any order, using parentheses if necessary to override the natural precedences of the operators. NB: Using a panda shape is always much more efficient than explicitly specifying "pie & annulus", due to the ability of panda to place a limit on the number of pixels checked in the pie shape. If you are going to specify the intersection of pie and annulus, use panda instead. As described in "help regreometry", the PIE slice goes to the edge of the field. To limit its scope, PIE usually is is combined with other shapes, such as circles and annuli, using boolean operations. In this context, it is worth noting that that there is a difference between -PIE and &!PIE. The former is a global exclude of all pixels in the PIE slice, while the latter is a local excludes of pixels affecting only the region(s) with which the PIE is combined. For example, the following region uses &!PIE as a local exclude of a single circle. Two other circles are also defined and are unaffected by the local exclude: CIRCLE(1,8,1) CIRCLE(8,8,7)&!PIE(8,8,60,120)&!PIE(8,8,240,300) CIRCLE(15,8,2) 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 - - - - - - - - - - - - - - - 15: . . . . . . . . . . . . . . . 14: . . . . 2 2 2 2 2 2 2 . . . . 13: . . . 2 2 2 2 2 2 2 2 2 . . . 12: . . 2 2 2 2 2 2 2 2 2 2 2 . . 11: . . 2 2 2 2 2 2 2 2 2 2 2 . . 10: . . . . 2 2 2 2 2 2 2 . . . . 9: . . . . . . 2 2 2 . . . . 3 3 8: 1 . . . . . . . . . . . . 3 3 7: . . . . . . 2 2 2 . . . . 3 3 6: . . . . 2 2 2 2 2 2 2 . . . . 5: . . 2 2 2 2 2 2 2 2 2 2 2 . . 4: . . 2 2 2 2 2 2 2 2 2 2 2 . . 3: . . . 2 2 2 2 2 2 2 2 2 . . . 2: . . . . 2 2 2 2 2 2 2 . . . . 1: . . . . . . . . . . . . . . . Note that the two other regions are not affected by the &!PIE, which only affects the circle with which it is combined. On the other hand, a -PIE is an global exclude that does affect other regions with which it overlaps: CIRCLE(1,8,1) CIRCLE(8,8,7) -PIE(8,8,60,120) -PIE(8,8,240,300) CIRCLE(15,8,2) 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 - - - - - - - - - - - - - - - 15: . . . . . . . . . . . . . . . 14: . . . . 2 2 2 2 2 2 2 . . . . 13: . . . 2 2 2 2 2 2 2 2 2 . . . 12: . . 2 2 2 2 2 2 2 2 2 2 2 . . 11: . . 2 2 2 2 2 2 2 2 2 2 2 . . 10: . . . . 2 2 2 2 2 2 2 . . . . 9: . . . . . . 2 2 2 . . . . . . 8: . . . . . . . . . . . . . . . 7: . . . . . . 2 2 2 . . . . . . 6: . . . . 2 2 2 2 2 2 2 . . . . 5: . . 2 2 2 2 2 2 2 2 2 2 2 . . 4: . . 2 2 2 2 2 2 2 2 2 2 2 . . 3: . . . 2 2 2 2 2 2 2 2 2 . . . 2: . . . . 2 2 2 2 2 2 2 . . . . 1: . . . . . . . . . . . . . . . The two smaller circles are entirely contained within the two exclude PIE slices and therefore are excluded from the region. SEE ALSO
See funtools(7) for a list of Funtools help pages version 1.4.2 January 2, 2008 regalgebra(7)
All times are GMT -4. The time now is 02:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy