Shell script for .Txt to .csv conversion with data processing
Hi experts,
I want to convert a txt file having rows and columns (CNAI_DUMP_raw.txt) by comparing it with another text file (paramaters.txt) and generate a output in CSV which contains only 3rd column from CNAI_DUMP_raw.txt, and the columns mentioned in parameters.txt.
FYI: There are two columns in parameters.txt one containing some column name from CNAI_DUMP.txt and other with the ideal value against it.
The output should contain actual value of the cell and the ideal value mentioned in parameters.txt.
Hi There
I needed to write a Unix shell script which will pick up the data from a .CSV file and reformat it as per the requirement and write it to another .CSV file.
Currently I am in the proess of Data Import to "Remedy System" (A one kind of incident mangement Application) and this... (8 Replies)
Hi,
I have gps receiver, by using gpsd data i can read gps log data to my database(my sql).
Steps:
1. telenet localhost 2947 > gps.txt (press enter)
2. r (press enter) //then i will get the data like below in gps.txt file
Trying 127.0.0.1...
Connected to localhost.... (1 Reply)
Hi all,
I have written a shell script to search a specified directory (e.g. /home/user) for a list of specific words (shown as ${TMPDIR}/wordlist below). The script works well enough, but I was wondering if there was a way to display the line number that the word is found on?
Thanks!
cat... (1 Reply)
thanks for allowing me join your forum
i have an output of linux command "who"
which provides following details.....
CURRENT USER/ACCT INFO
17:31:36 up 4:49, 4 users, load average: 0.03, 0.04, 0.00
USER TTY FROM LOGIN@ IDLE JCPU PCPU WHAT
root :0 - 12:59 ?xdm? 4:54 0.02s /bin/sh /usr/bi... (1 Reply)
Request if some one could provide me shell script that converts the below "input file" to "CSV format file" given
Name Domain Contact Phone Email Location
----------------------- ------------------------------------------------ ------- ----- ---------------------------------... (7 Replies)
Hi Unix Gurus,
I tried to convert the attached xhtml table content into csv file using unix shell script (lynx -dump filename) and got the below results:
Title ID Owner Priority Estimate Project Change Date Changed By
Complexity Create Date Created By Detail Estimate Total De tail... (6 Replies)
Hi Everyone ,
Below is output from a TL1 , I want just the NE Name: and beside that the Temperature and the voltages in a csv file , Is this possible?
> act-user:AB1S2a:ArshadFO:493::**********;
AB1S2a 2016-02-07 10:13:24
M 493 COMPLD
"ArshadFO:2016-02-07 10-04-55,0"
;... (11 Replies)
Hello Unix Shell Script Experts,
I have a script that would mask the columns in .csv file or .txt file.
First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder.
Two parameters are passed
... (5 Replies)
i have written my shell script in notepad however i am struggling to pass the data file to be read to the script the data file is of .txt format. My target is to run the shell script from the terminal and pass 3 arguments e.g. polg@DESKTOP-BVPDC5C:~/CS1420/coursework$ bash valsplit.sh input.txt... (11 Replies)
Discussion started by: Gurdza32
11 Replies
LEARN ABOUT DEBIAN
x2sys_solve
X2SYS_SOLVE(1gmt) Generic Mapping Tools X2SYS_SOLVE(1gmt)NAME
x2sys_solve - Determine systematic corrections from crossovers
SYNOPSIS
x2sys_solve -Ccolumn -TTAG -Emode [ COE_list.d ] [ -V ] [ -W ] [ -Z ] [ -bi[s|S|d|D[ncol]|c[var1/...]] ]
DESCRIPTION
x2sys_solve will use the supplied crossover information to solve for systematic corrections that can then be applied per track to improve
data quality. Several systematic corrections can be solved for using a least-squares approach. Note: Only one data column can be processed
at the time.
-T Specify the x2sys TAG which tracks the attributes of this data type.
-C Specify which data column you want to process. Needed for proper formatting of the output correction table and must match the same
option used in x2sys_list when preparing the input data.
-E The correction type you wish to model. Choose among the following functions f(p), where p are the m parameters per track that we
will fit simultaneously using a least squares approach:
c will fit f(p) = a (a constant offset); records must contain cruise ID1, ID2, COE.
d will fit f(p) = a + b * d (linear drift; d is distance; records must contain cruise ID1, ID2, d1, d2, COE.
g will fit f(p) = a + b sin(y)^2 (1980-1930 gravity correction); records must contain cruise ID1, ID2, latitude y, COE.
h will fit f(p) = a + b cos(H) + c cos(2H) + d sin(H) + e sin(2H) (magnetic heading correction); records must contain cruise ID1,
ID2, heading H, COE.
s will fit f(p) = a * z (a unit scale correction); records must contain cruise ID1, ID2, z1, z2.
t will fit f(p) = a + b * (t - t0) (linear drift; t0 is the start time of the track); records must contain cruise ID1, ID2, t1-t0,
t2-t0, COE.
OPTIONS
No space between the option flag and the associated arguments.
COE_list.d
Name of file with the required crossover columns as produced by x2sys_list. NOTE: If -bi is used then the first two columns are
expected to hold the integer track IDs; otherwise we expect those columns to hold the text string names of the two tracks.
-V Selects verbose mode, which will send progress reports to stderr [Default runs "silently"].
-W Means that each input records has an extra column with the composite weight for each crossover record. These are used to obtain a
weighted least squares solution [no weights].
-Z For -Ed and -Et, determine the earliest time or shortest distance for each track, then use these values as the local origin for time
duration or distance calculations. The local origin is then included in the correction table [Default uses 0].
-bi Selects binary input. Append s for single precision [Default is d (double)]. Uppercase S or D will force byte-swapping. Option-
ally, append ncol, the number of columns in your binary input file if it exceeds the columns needed by the program. Or append c if
the input file is netCDF. Optionally, append var1/var2/... to specify the variables to be read.
EXAMPLES
To fit a simple bias offset to faa for all tracks under the MGD77 tag, try
x2sys_list COE_data.txt -V -TMGD77 -Cfaa -Fnc > faa_coe.txt
x2sys_solve faa_coe.txt -V -TMGD77 -Cfaa -Ec > coe_table.txt
To fit a faa linear drift with time instead, try
x2sys_list COE_data.txt -V -TMGD77 -Cfaa -FnTc > faa_coe.txt
x2sys_solve faa_coe.txt -V -TMGD77 -Cfaa -Et > coe_table.txt
To estimate heading corrections based on magnetic crossovers associated with the tag MGD77 from the file COE_data.txt, try
x2sys_list COE_data.txt -V -TMGD77 -Cmag -Fnhc > mag_coe.txt
x2sys_solve mag_coe.txt -V -TMGD77 -Cmag -Eh > coe_table.txt
To estimate unit scale corrections based on bathymetry crossovers, try
x2sys_list COE_data.txt -V -TMGD77 -Cdepth -Fnz > depth_coe.txt
x2sys_solve depth_coe.txt -V -TMGD77 -Cdepth -Es > coe_table.txt
SEE ALSO x2sys_binlist(1), x2sys_cross(1), x2sys_datalist(1), x2sys_get(1), x2sys_init(1), x2sys_list(1), x2sys_put(1), x2sys_report(1)GMT 4.5.7 15 Jul 2011 X2SYS_SOLVE(1gmt)