07-09-2007
Shell script to separte columns...
Hi all,
I have a data file and need to load the data into tables in a database. The problem is I cannot use a while loop with each line as the data is free text and has all kinds of weird characters including carriage returns and new line characters.
Each column is separated by ~^~ and a new line by ^~EOR~^
so an example would be
ID NAME DESCRIPTION
123~^~SAM~^~HELLO^~EOR~^
~^~~^~HELLO^~EOR~^
456~^~~^~^~EOR~^
How do I separate different columns from above.
Thanks in advance...
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Friends,
I have a log file as below
siteid = HYD
spc = 100
rset = RS_D_M
siteid = DEL
spc = 200
rset = RS_K_L
siteid = DEL2
spc = 210
rset = RS_D_M
Now I need a output like column wise as below.
siteid SPC rset
HYD 100 RS_D_M (2 Replies)
Discussion started by: suresh3566
2 Replies
2. Shell Programming and Scripting
i have a file which if you will open as xls will yield something like this:
Column1 Column2 Column3
ABC CDE EFG
GHI IJK KLM
MNO OPQ QRS
what i want to need is to have this kind of results:
Column1
ABC CDE EFG
GHI IJK ... (10 Replies)
Discussion started by: kingpeejay
10 Replies
3. Shell Programming and Scripting
Hi,
I am using ksh, I want to read one csv file and append the columns of another file with new column.
My input file:
col1,col2
---------
siri,886
satya,890
priya,850
Another file with the below date:(test.csv)
col3
-----
321
333
442 (1 Reply)
Discussion started by: siri_886
1 Replies
4. Shell Programming and Scripting
I have a script which converts rows to columns.
file_name=$1
mailid=$2
#CREATE BACKUP OF ORIGINAL FILE
#cp ${file_name}.xlsx ${file_name}_temp.xlsx
#tr '\t' '|' < ${file_name}_temp.xlsx > ${file_name}_temp.csv
#rm ${file_name}_temp.xlsx
pivot_row=`head -1 ${file_name}`
sed 1d... (3 Replies)
Discussion started by: andy538
3 Replies
5. Shell Programming and Scripting
Hello All,
I have datas in the below format.
Mark 45
Steve 60
Johnson 79
Elizabeth 90
My requirement is to arrange the data in the order as shown in the attachment.
My OS is Solaris.
... (6 Replies)
Discussion started by: vashece
6 Replies
6. Shell Programming and Scripting
Hi
I have a file having the values like below
----------------------------
.set A
col1=”ABC”
col2=34
col3=”DEF”
col4=”LMN”
col5=25
.set A
.set B
col1=55
col3=”XYZ”
col4=”PQR”
col5=66
.set B
.set C
col2=”NNN” (1 Reply)
Discussion started by: Suneel Mekala
1 Replies
7. Shell Programming and Scripting
Hello,
Can someone please help in below requirement.
My requirement is to add date before to first column,some text before 1st,2nd coulmns and insert a new column in between 2 and 3 columns.
input file.
aa 123 dddd
aa 667 kdkdk
ddj 738 kkkk
aa 123 dddd
aa 667 ... (5 Replies)
Discussion started by: Cva2568
5 Replies
8. Shell Programming and Scripting
Hello Unix Shell Script Experts,
I have a script that would mask the columns in .csv file or .txt file.
First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder.
Two parameters are passed
... (5 Replies)
Discussion started by: Mahesh G
5 Replies
9. UNIX for Beginners Questions & Answers
My program output text file data in columns format. My problem is the column headers do not align with the data and if filesystem and Mounted On columns pathname are too long the text will not wrap.
Is there any function in Unix that I can use in my code that will align the data for each... (11 Replies)
Discussion started by: dellanicholson
11 Replies
10. UNIX for Beginners Questions & Answers
Hi friends,
i want to compare first columns from two different files ,if equal print the file2's second column else print the zero.Please help me...
file1:
a
b
c
d
efile2:
a 1
c 20
e 30
desired output:
1
0
20
0
30
Please use CODE tags as required by forum rules!
Please post in... (1 Reply)
Discussion started by: bhaskar illa
1 Replies
LEARN ABOUT DEBIAN
tabfunc
TABFUNC(1) General Commands Manual TABFUNC(1)
NAME
tabfunc - convert table to functions for rcalc, etc.
SYNOPSIS
tabfunc [ -i ] func1 [func2 ..]
DESCRIPTION
Tabfunc reads a table of numbers from the standard input and converts it to an expression suitable for icalc(1), rcalc(1) and their
cousins. The input must consist of a M x N matrix of real numbers, with exactly one row per line. The number of columns must always be
the same in each line, separated by whitespace and/or commas, with no missing values. The first column is always the independent variable,
whose value indexes all of the other elements. This value does not need to be evenly spaced, but it must be either monotonically increas-
ing or monotonically decreasing. (I.e. it cannot go up and then down, or down and then up.) Maximum input line width is 4096 characters
and the maximum number of data rows is 1024. Input lines not beginning with a numerical value will be silently ignored.
The command-line arguments given to tabfunc are the names to be assigned to each column. Tabfunc then produces a single function for each
column given. If there are some columns which should be skipped, the dummy name "0" may be given instead of a valid identifier. (It is
not necessary to specify a dummy name for extra columns at the end of the matrix.)
The -i option causes tabfunc to produce a description that will interpolate values in between those given for the independent variable on
the input.
EXAMPLE
To convert a small data table and feed it to rcalc for some calculation:
rcalc -e `tabfunc f1 f2 < table.dat` -f com.cal
AUTHOR
Greg Ward
SEE ALSO
cnt(1), icalc(1), neaten(1), rcalc(1), rlam(1), total(1)
RADIANCE
10/8/97 TABFUNC(1)