If you really need to limit the output to only contain field 1 and field 2 value combinations that appear in a specific file, I can add code to my script to make that happen.
Don
Sorry I am not explaining myself clear enough for you. It would be much easier if we were face to face. You hit the nail on the head with your comment above.
Your latest suggestions worked as designed, printing out the rank of every field 1 and field 2 data point for all 100+ files.
However I am only interested in the fields 1 and 2 of a specific file to be printed. In this case it would be 201605.pnt, but it will be called with a variable each month.
I guess one way would be to print out the file names associated with each data point and then grep out the needed files.
Last edited by ncwxpanther; 07-12-2016 at 12:33 PM..
Sorry I am not explaining myself clear enough for you. It would be much easier if we were face to face. You hit the nail on the head with your comment above.
Your latest suggestions worked as designed, printing out the rank of every field 1 and field 2 data point for all 100+ files.
However I am only interested in the fields 1 and 2 of a specific file to be printed. In this case it would be 201605.pnt, but it will be called with a variable each month.
I guess one way would be to print out the file names associated with each data point and then grep out the needed files.
Or, you could CLEARLY state your requirements and give us examples that show what your inputs actually are and what output you actually want so we might all be able to understand what you are trying to do.
Every post you make changes something or adds a new requirement. We now know that your script will be called with a variable each month. Great! What is the name of this variable? What is the value of this variable? What should your script do with this variable?
Please stop making us guess at what your requirements might be! Please help us help you.
The variable input will be called from a file named control.status
This file contains the YYYY MM. In this case its 2016 05
The variables are set using the following syntax:
So this variable can be used to determine the name of the specific file to use. In this case it would be $curyr$curmo.pnt
OK. So you say you are passing variables to to your script, but you aren't; you're extracting values from a configuration file. And, the variable names you chose (curmo and curyr) would seem to imply that they are intended to contain the current month and year, but if that is what they were, they would be set by invoking the date utility to get the current month and year. But, of course you say that the current month is 05 which makes no sense in July.
And, now that we have two values defined in a configuration file, you still haven't explained exactly what is supposed to be done with those values. But I made a guess after rereading this entire thread. If offer the following guess at a script that might do what you want. Obviously, the text shown in red will have to be modified to fit in your environment. If it does what you want, I'll consider myself very luck. It it doesn't maybe you can use it as a base on which you can build something that will do what you want.
As always, if someone wants to try this on a Solaris/SunOS system, change awk in the script to /usr/xpg4/bin/awk or nawk. This was written and tested using a Korn shell, but should work with any shell that performs the basic parameter expansions required by the POSIX standards (such as ksh, bash, ash, dash, or zsh; but not a pure Bourne shell and not a shell based on csh).
Don, All of your assumptions are spot on. But as an update:
The output is still printing out the rank of every field 1 and field 2 data point for all 100+ files. Even though I am only interested in the fields 1 and 2 of the Month and Year within the control file.
Don, All of your assumptions are spot on. But as an update:
The output is still printing out the rank of every field 1 and field 2 data point for all 100+ files. Even though I am only interested in the fields 1 and 2 of the Month and Year within the control file.
The script I provided has code to prevent that from happening.
Please show us the contents of your control file, the contents of a sample base file and a sample additional file for a different year but the same month as your base file that exhibits the problem you are experiencing so we can track down what is wrong. (I'm not asking for entire files and you can sanitize any private data, but we need to see enough input in both files to get output that contains unwanted rankings for at least one pair of points.)
control.file
Sample base file 201606.pnt. I also tried using files that had values only of xx.xx in the 3rd field. This sample has both xx.xx and xxx.xx in the 3rd filed....if that matters.
Sample base file 201506.pnt
We have the data looks like below in a log file.
I want to generat files based on the string between two hash(#) symbol like below
Source:
#ext1#test1.tale2 drop
#ext1#test11.tale21 drop
#ext1#test123.tale21 drop
#ext2#test1.tale21 drop
#ext2#test12.tale21 drop
#ext3#test11.tale21 drop... (5 Replies)
Hello Gurus,
Im new to scripting. Got struck with a file merge issue in Unix. Was looking for some direction and stumbled upon this site. I saw many great posts and replies but couldnt find a solution to my issue. Greatly appreciate any help..
I have three csv files -> Apex_10_Latest.csv,... (1 Reply)
I have a text file that shows the output of my solar inverters. I want to separate this into sections. overview , device 1 , device 2 , device 3. Each device has different number of lines. but they all have unique starting points. Overview starts with 6 #'s, Devices have 4#'s and their data starts... (6 Replies)
Hi, I need help on finding the value of my data that encompasses certain percentage of my total data points (n). Attached is an example of my data, n=30. What I want to do is for instance is find the minimum threshold that still encompasses 60% (n=18), 70% (n=21) and 80% (n=24).
manually to... (4 Replies)
Hi,
I'd like to process multiple files. For example:
file1.txt
file2.txt
file3.txt
Each file contains several lines of data. I want to extract a piece of data and output it to a new file.
file1.txt ----> newfile1.txt
file2.txt ----> newfile2.txt
file3.txt ----> newfile3.txt
Here is... (3 Replies)
Hi,
I am trying to arrange my graphs with GNUPLOT. Although it looked like simple at the beginning, I could not figure out an answer for the following: I want to change the style of my data points (not the line, just exact data points) The terminal assigns first + and then x to them but what I... (0 Replies)
hiii, Help me out..i have a huge set of data stored in a file.This file has has 2 columns which is latitude & longitude of a region. Now i have a program which asks for the number of points & based on this number it asks the user to enter that latitude & longitude values which are in the same... (7 Replies)
Hello all,
I have a data file that needs some serious work...I have no idea how to implement the changes that are needed!
The file is a genotypic file with >64,000 columns representing genetic markers, a header line, and >1100 rows that looks like this:
ID 1 2 3 4 ... (7 Replies)
suppose u have a file which consist of many data points separated by asterisk
Question is to extract third part in each line .
0.0002*0.003*-0.93939*0.0202*0.322*0.3332*0.2222*0.22020
0.003*0.3333*0.33322*-0.2220*0.3030*0.2222*0.3331*-0.3030
0.0393*0.3039*-0.03038*0.033*0.4033*0.30384*0.4048... (5 Replies)