Sponsored Content
Top Forums Shell Programming and Scripting Ranking data points from multiple files Post 302976433 by ncwxpanther on Wednesday 29th of June 2016 09:07:57 AM
Old 06-29-2016
Thanks for taking a look at this Don.

Based on your assumptions I have moved all 100+ input files over to my parent directory. I can now reference them as {1895..2016}05.pnt

To clarify your statement at the bottom of your post
Quote:
It wasn't clear to me why you talked about choosing one file to gather field 1 and 2 values.
I need to base the ranks off of a particular input file. In this case it would be 201605.pnt
So I figured I would gather fields 1 and 2 from that file; search through the other 100+ files for the same set of values in fields 1 and 2; rank the value in field 3 of 201605.pnt based on those other 100+ files.

The result would be a single value of field 1 and 2 with a (value) and rank. Value is optional and if its there would need to be taken from the primary input - 201605.pnt. In other words the expected output would be 201605.pnt with a rank added as a 4th field. The rank would be based on that value when compared to the other 100+ files with like fields 1 and 2.

I ran your script as
Code:
./grid-ranking.sh {1895..2016}05.pnt

and got output (rather quickly) that has the ranks as "1" and multiple listing of the same fields 1 and 2.
Code:
 25.8125  -80.9375    24.87     1
 25.8125  -80.9375    24.88     1
 25.8125  -80.9375    24.90     1
 25.8125  -80.9375    25.00     1
 25.8125  -80.9375    25.00     1
 25.8125  -80.9375    25.01     1
 25.8125  -80.9375    25.03     1
 25.8125  -80.9375    25.07     1

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

to extarct data points

suppose u have a file which consist of many data points separated by asterisk Question is to extract third part in each line . 0.0002*0.003*-0.93939*0.0202*0.322*0.3332*0.2222*0.22020 0.003*0.3333*0.33322*-0.2220*0.3030*0.2222*0.3331*-0.3030 0.0393*0.3039*-0.03038*0.033*0.4033*0.30384*0.4048... (5 Replies)
Discussion started by: cdfd123
5 Replies

2. Shell Programming and Scripting

recoding data points using SED??

Hello all, I have a data file that needs some serious work...I have no idea how to implement the changes that are needed! The file is a genotypic file with >64,000 columns representing genetic markers, a header line, and >1100 rows that looks like this: ID 1 2 3 4 ... (7 Replies)
Discussion started by: doobedoo
7 Replies

3. Shell Programming and Scripting

Group search (multiple data points) in Linux

Hi All I have a data set like this tab delimited: weft fgr-1 345 -1 fgrythdgd weft fgr-3 456 -2 ghjdklflllff weft fgr-11 456 -3 ghtjuffl weft fgr-1 213 -2 ghtyjdkl weft fgr-34 567 -5 fghytkflf frgt fgr-36 567 -1 ghrjufjf frgt fgr-45 678 -2 ghjruir frgt fgr-34 546 -5 gjjjgkldlld frgt... (4 Replies)
Discussion started by: Lucky Ali
4 Replies

4. UNIX for Dummies Questions & Answers

How to get data only inside polygon created by points which is part of whole data from file?

hiii, Help me out..i have a huge set of data stored in a file.This file has has 2 columns which is latitude & longitude of a region. Now i have a program which asks for the number of points & based on this number it asks the user to enter that latitude & longitude values which are in the same... (7 Replies)
Discussion started by: reva
7 Replies

5. Programming

GNUPLOT- how to change the style of data points

Hi, I am trying to arrange my graphs with GNUPLOT. Although it looked like simple at the beginning, I could not figure out an answer for the following: I want to change the style of my data points (not the line, just exact data points) The terminal assigns first + and then x to them but what I... (0 Replies)
Discussion started by: natasha
0 Replies

6. UNIX for Dummies Questions & Answers

Using AWK: Extract data from multiple files and output to multiple new files

Hi, I'd like to process multiple files. For example: file1.txt file2.txt file3.txt Each file contains several lines of data. I want to extract a piece of data and output it to a new file. file1.txt ----> newfile1.txt file2.txt ----> newfile2.txt file3.txt ----> newfile3.txt Here is... (3 Replies)
Discussion started by: Liverpaul09
3 Replies

7. UNIX for Dummies Questions & Answers

Finding data value that contains x% of points

Hi, I need help on finding the value of my data that encompasses certain percentage of my total data points (n). Attached is an example of my data, n=30. What I want to do is for instance is find the minimum threshold that still encompasses 60% (n=18), 70% (n=21) and 80% (n=24). manually to... (4 Replies)
Discussion started by: ida1215
4 Replies

8. Shell Programming and Scripting

Grabbing data between 2 points in text file

I have a text file that shows the output of my solar inverters. I want to separate this into sections. overview , device 1 , device 2 , device 3. Each device has different number of lines. but they all have unique starting points. Overview starts with 6 #'s, Devices have 4#'s and their data starts... (6 Replies)
Discussion started by: Mikey
6 Replies

9. UNIX for Dummies Questions & Answers

Stack data from multiple files into one, with variable column files

Hello Gurus, Im new to scripting. Got struck with a file merge issue in Unix. Was looking for some direction and stumbled upon this site. I saw many great posts and replies but couldnt find a solution to my issue. Greatly appreciate any help.. I have three csv files -> Apex_10_Latest.csv,... (1 Reply)
Discussion started by: wamshi
1 Replies

10. Shell Programming and Scripting

In PErl script: need to read the data one file and generate multiple files based on the data

We have the data looks like below in a log file. I want to generat files based on the string between two hash(#) symbol like below Source: #ext1#test1.tale2 drop #ext1#test11.tale21 drop #ext1#test123.tale21 drop #ext2#test1.tale21 drop #ext2#test12.tale21 drop #ext3#test11.tale21 drop... (5 Replies)
Discussion started by: Sanjeev G
5 Replies
add mapping(1m) 														   add mapping(1m)

NAME
add mapping - Adds or replaces server address information in the local endpoint map SYNOPSIS
rpccp add mapping -b string-binding -i interface-identifier [-a annotation-string] [-o object-uuid] [-N] OPTIONS
Specifies a string representation of a binding over which the server can receive remote procedure calls. At least one binding is required. The value has the form of an RPC string binding, without an object UUID, for example: -b ncadg_ip_udp:63.0.2.17[5347] Note that depending on your system, string binding delimiters such as brackets ([ ]) may need to be preceded by an escape symbol () or placed within quotation marks (' ' or `` ''). Requirements vary from system to system, and you must conform to the usage rules of a system. Specifies an interface identifier to register with the local endpoint map. An interface identifier is required. Only one interface can be added (i.e., registered) in a single operation. The interface identifier has the following form: interface-uuid,major-version.minor-ver- sion The UUID is a hexadecimal string and the version numbers are decimal strings, for example: -i ec1eeb60-5943-11c9-a309-08002b102989,1.1 Leading zeros in version numbers are ignored. Specifies a character string comment to be applied to each cross product element that is added to the local endpoint map. The string can be up to 64 characters long, including the NULL terminating character. The string is used by applications for informational purposes only. The RPC runtime does not use this string to determine which server instance a client communicates with, or for enumerating endpoint map elements. Defines an object UUID that further determines the endpoint map elements that are removed (optional). Each add mapping command accepts up to 32 -o options. The UUID is a hexadecimal string, for example: -o 3c6b8f60-5945-11c9-a236-08002b102989 Specifies that existing elements in the local host's endpoint map should not be replaced when the new information is added. DESCRIPTION
The add mapping command adds to, replaces, or adds server address information to the local endpoint map. Each element in the local endpoint map logically contains the following: Interface ID, consisting of an interface UUID and versions (major and minor) Binding information Object UUID (optional) Annotation (optional) This command should be used without the -N option when only a single instance of the server in question runs on the server's host. Do not use the -N option if no more than one server instance on the host ever offers the same interface UUID, object UUID, and protocol sequence. When local endpoint map elements are not replaced, obsolete elements accumulate each time a server instance stops running without explic- itly unregistering its endpoint map information. Periodically, the RPC Daemon (RPCD) will identify these obsolete elements and remove them. However, during the interval between these removals, the presence of the obsolete elements increases the chance that clients will receive endpoints to nonexistent servers. The clients will then waste time trying to communicate with these servers before giving up and obtaining another endpoint. Allowing RPCD to replace any existing local endpoint map elements (by not specifying -N) reduces the chance of this happening. For example, suppose an existing element in the local endpoint map matches the interface UUID, binding information exclusive of the end- point, and object UUID of an element this routine provides. The routine changes the endpoint map according to the elements' interface major and minor version numbers. NOTE
This command is replaced at Revision 1.1 by the dcecp command and may not be provided in future releases of DCE. EXAMPLES
The following command operates from the system prompt to add a map element to the local endpoint map. The command adds the map element that contains the specified interface identifier, server address (specified as a string binding), and object UUIDs. $ rpccp add mapping -i ec1eeb60-5943-11c9-a309-08002b102989,1.1 -b ncadg_ip_udp:63.0.2.17[5347] -o 005077d8-8022-1acb-9375-10005a4f533a -o 001bc29a-8041-1acb-b377-10005a4f533a -a 'Calendar version 1.1' $ The previous command adds the following elements: ec1eeb60-5943-1169-a309-08002b102989,1.1 ncadg_ip_udp:63.0.2.17[5347] 005077d8-8022-1acb-9375-10005a4f533a 001bc29a-8041-1acb-b377-10005a4f533a Calendar version 1.1 RELATED INFORMATION
Commands: export(1m), remove mapping(1m), show mapping(1m), show server(1m) Subroutines: rpc_ep_register, rpc_ep_register_no_replace add mapping(1m)
All times are GMT -4. The time now is 12:42 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy