Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Rearranging Data Set
Top Forums Shell Programming and Scripting Rearranging Data Set Post 302986945 by Evilknievel on Friday 2nd of December 2016 11:45:36 AM
Old 12-02-2016
Rearranging Data Set
Hello everybody,

I've got the following problem:

The data set I have is an ASCII file containing a header over 4 lines and the actual data comprised of dezimal numbers in a 1000x1000 grid (1000 lines and 1000 columns).

Since I want to plot the data in GMT I need to convert it into the following format:

[x coordinate] [y coordinate] [value]

This means every single value will be in a single line preceeded by its coordinates. For simplicity lets say the upper left corner has coordinats 0,0 and the grid spacing is 500 in both directions.

I tried the following using "awk"

Code:
awk 'BEGIN {
xUL=0
yUL=0
for (i=1; i<=1000; i++)
      print "xUL+($i-1)*500", yUL+($i-1)*500, $i
}'

input.txt > output.txt

Since I'm posting my problem here it is obvious the the code above is not working. Can anybody tell why it is not working or a better solution?

Cheers
Evil

PS: I'm scripting in bash.
 

7 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

rearranging the data in file (from columnwise to rowwise)

Hi I have one file which is having data like 10201 10202 10205 10206 10207 10208 10209 10210 10211 10213 10215 10801 10802 11406 11415 11422 11426 11513 11514 11515 11516 11517 11518 11519 11520 11521 11522 11523 11524 11525 11530 11604 11608 11611 11717 11718 11719 11722 11725... (3 Replies)
Discussion started by: reldb
3 Replies

2. Shell Programming and Scripting

Unable to set a data to array

Hi All, Iam trying to set the value to the array... Still its not happening Following is the code: #!/usr/bin/ksh filenames="x"; filenames="y"; echo $filenames; echo $filenames; O/P: x x Iam expecting (2 Replies)
Discussion started by: kiranlalka
2 Replies

3. Shell Programming and Scripting

Help with sum of data set

Input file 2 1159,310, 4 142,199,218,91, 3 91,273,349, Desired output result 2 1469 4 650 3 713 I have long list of input file as shown above. It has a "," delimited to separate between each record in column 2.... (1 Reply)
Discussion started by: perl_beginner
1 Replies

4. Shell Programming and Scripting

Help with reformat data set

Input file 4CL1 O24145 CoA1 4CL1 P31684 CoA1 4CL1 Q54P77 CoA_1 73 O36421 Unknown 4CL3 Q9S777 coumarate 4CL3 Q54P79 coumarate 4CL3 QP7932 coumarate Desired output result 4CL1 O24145#P31684 CoA1 4CL1 Q54P77 CoA_1 73 O36421 Unknown 4CL3 Q9S777#Q54P79#QP7932 coumarate I... (5 Replies)
Discussion started by: perl_beginner
5 Replies

5. Shell Programming and Scripting

Data rearranging from rows to column

Hello Everyone, I have a input file looks like -0.005-0.004-0.003-0.002-0.00100.0010.0020.0030.0040.005My desired output should look like -0.005 -0.004 -0.003 -0.002 -0.001 0 0.001 0.002 0.003 0.004 0.005I had some success in getting the desired output. But i face a problem when i... (15 Replies)
Discussion started by: dinesh.n
15 Replies

6. Shell Programming and Scripting

Help with sum range of data set together

Input File: 2000 3 1998 2 1997 2 1994 1 1991 1 1989 1 1987 2 1986 2 1985 1 1984 1 . . 10 277256 9 278274 8 282507 7 284837 6 287066 5 292967 (4 Replies)
Discussion started by: perl_beginner
4 Replies

7. Programming

C++ help in large data set

Hi All, We are trying to replace a 3rdparty where we don't know how they handled the reader part here. The query below is getting 197 * 2038017 row in the table. In the below code we are trying to run the query and execute in the DB part and fetch and read the record. That is where it is... (1 Reply)
Discussion started by: arunkumar_mca
1 Replies

LEARN ABOUT CENTOS

bwild

BWILD(8)						     Network backup, utilities							  BWILD(8)

NAME

	bwild - Bacula's 'wildcard' engine

SYNOPSIS

       bwild [options] -f <data-file>

DESCRIPTION

       This manual page documents briefly the bwild command.
       This is a simple program that will allow you to test wild-card expressions against a file of data.

OPTIONS

       A summary of options is included below.

       -?     Show version and usage of program.

       -d nn  Set debug level to nn.

       -dt    Print timestamp in debug output

       -f <data-file>
	      The  data-file  is  a  filename that contains lines of data to be matched (or not) against one or more patterns. When the program is
	      run, it will prompt you for a wild-card pattern, then apply it one line at a time against the data  in  the  file.  Each	line  that
	      matches will be printed preceded by its line number. You will then be prompted again for another pattern.
	      Enter  an  empty line for a pattern to terminate the program. You can print only lines that do not match by using the -n option, and
	      you can suppress printing of line numbers with the -l option.

       -n     Print lines that do not match

       -l     Suppress lines numbers.

       -i     use case insensitive match.

SEE ALSO

       fnmatch(3)

AUTHOR

       This manual page was written by Bruno Friedmann <bruno@ioda-net.ch>.

Kern Sibbald							  30 October 2011							  BWILD(8)
All times are GMT -4. The time now is 08:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy