05-04-2008
cut a row into pieces
Terribly sorry wizards to bug you all again. There was an additional extraction I needed to perform. If I use the cut -f suggest above, I will get this interim text file:
1234 12.0000. 2/29/2008
1234 13.0000. 3/29/2008
However, I really want to create a text file that looks like this:
1234 12 0000 2/29/2008
1234 13 0000 3/29/2008
so that I can load into my Hyperion database. So if I can do one cut using -c (character/column) at multiple columns, that would give me the final result using only one "cut".
By the way, does anyone know of a software similar to UnixDos5.1a that will give me "awk" as well as "cut" Unix tools? UnixDos5.1a deficiency is that it does not have "awk" utility.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello!!
I have the text file with following format...
--SubTotal-----------------------------------0--161---------------44---13739369-67---
--SubTotal-----------------------------------0--147---------------0----49643---1----... (2 Replies)
Discussion started by: Danish Shakil
2 Replies
2. Shell Programming and Scripting
I have huge fixed width, text file in unix box and I need to extract columns found between the width 105 and 200 and output it to a new file.
Can anyone tell me how to extract it?
Thanks for your help. (1 Reply)
Discussion started by: kiran2k
1 Replies
3. Shell Programming and Scripting
Hi All,
Could you please help me with following:
I have to parse a .csv file.
For example: If the csv file contains 3 columns, then i have to print the column names. The field separator is (comma).
example.csv (contains 2 lines as follows)
This is,a test file, for validation... (2 Replies)
Discussion started by: vfrg
2 Replies
4. UNIX for Dummies Questions & Answers
Hello Gurus,
I have a text file containing nearly 12,000 tab delimited characters with 4000 rows. If the file size is small, excel can convert the text into coloumns. However, the file that I have is very big. Can some body help me in solving this problem?
The input file example,
... (6 Replies)
Discussion started by: Unilearn
6 Replies
5. UNIX for Dummies Questions & Answers
I have a text file that has three columns. But at the end of the text file, there are trailing lines that have missing second and third columns:
4 0.04972604 KLHL28
4 0.0497332 CSTB
4 0.04979822 AIF1
4 0.04983331 DECR2
4 0.04990344 KATNB1
4
4
4
4
How can I remove the trailing... (3 Replies)
Discussion started by: evelibertine
3 Replies
6. Shell Programming and Scripting
hello,
i have publicly available txt file with little less than 300000 rows. i want to extract from column 1 to column 218 and save it in another text file. i use the cut command but the file is saved with multiple rows from the source file onto a single row in the destination. basically it is... (6 Replies)
Discussion started by: madrazzii
6 Replies
7. Shell Programming and Scripting
Hello,
I want to concatenate 2-columns by 2-columns separated by colon. How can I do so? For example, I have a text file containing 6 columns separated by tab. I want to concatenate column 1 and 2; column 3 and 4; column 5 and 6, respectively, and put a colon in between.
input file:
1 0 0 1... (10 Replies)
Discussion started by: huiyee1
10 Replies
8. UNIX for Dummies Questions & Answers
Dear all,
I want to extract around 300 columns from a very large file with almost 2million columns. There are no headers, but I can find out which column numbers I want. I know I can extract with the function 'cut -f2' for example just the second column but how do I do this for such a large... (1 Reply)
Discussion started by: fndijk
1 Replies
9. Shell Programming and Scripting
I have a comma delimited file as per the one below and I am currently extracting the values in 2 columns (COL1 & COL6) to produce a smaller trimmed down version of the file which only contains the columns we need;
COL1,COL2,COL3,COL4,COL5,COL6,COL7,COL8,COL9... (1 Reply)
Discussion started by: Ads89
1 Replies
10. Shell Programming and Scripting
Kindly help merging information from two files with the following data structure.
I want to match for the CHR-SNP in Foo and get the columns that match from CHROM-rsID
Fields 1 & 2 of foo may have duplicates, however, a joint key of Fields $1$2$3$4 is unique.
Also would be helpful to clean up... (4 Replies)
Discussion started by: genehunter
4 Replies
LEARN ABOUT DEBIAN
rlm_sql_log
rlm_sql_log(5) FreeRADIUS Module rlm_sql_log(5)
NAME
rlm_sql_log - FreeRADIUS Module
DESCRIPTION
The rlm_sql_log module appends the SQL queries in a log file which is read later by the scripts/radsqlrelay Perl program.
The purpose of this module is to de-couple the storage of long-term accounting data in SQL from "live" information needed by the RADIUS
server as it's running. If you are not using SQL for simultaneous login restrictions (i.e. "sql" is not listed in the "session" section of
"radiusd.conf"), then this module allows you to log SQL queries to a file, and then process them at your leisure.
The benefit of this approach is that for a busy server, the overhead of performing SQL qeuries may be significant. Also, if the SQL data-
bases are large (as is typical for ones storing months of data), the INSERTs and UPDATEs may take a relatively long time. Rather than
slowing down the RADIUS server by having it interact with a database, you can just log the queries to a file, and then run those queries on
another machine, or at a time when the RADIUS server is typically lightly loaded.
If the "sql" module is listed in the "session" section of "radiusd.conf", then a similar system can still be used. In that case, one data-
base would be used to maintain "live" session information. That database would be small, fast, and information would be deleted from it
when a user logs out. A second database would store long-term accounting information, as described above.
LIMITATIONS
This module only performs the dynamic expansion of the variables found in the SQL statements. No operation is executed on the database
server. (this would be done later by an external program) That means the module is useful only with non-"SELECT" statements.
CONFIGURATION
The main configuration items to be aware of are the path of the log file and the different SQL queries.
path An entry named "path" sets the full path of the file where the SQL queries are recorded. (this variable is run through dynamic
string expansion, and can include FreeRADIUS variables to create a dynamic filename)
Accounting queries
When a accounting record is processed, the module searches a config entry keyed by the Acct-Status-Type attribute present in the
packet. For example, the SQL to be run on an accounting start must be named "Start" in the configuration for the module. Other usual
values for Acct-Status-Type are "Stop", "Alive", "Accounting-On", etc. See the VALUEs for Acct-Status-Type in the dictio-
nary.rfc2866 file.
Post-Auth query
An entry named "Post-Auth" sets the query to run during the post-authentication stage. This query is mainly used to log sessions
where there may not be a later accounting packet.
modules {
...
sql_log {
path = "${radacctdir}/sql-relay"
acct_table = "radacct"
postauth_table = "radpostauth"
sql_user_name = "%{%{User-Name}:-DEFAULT}"
Start = "INSERT INTO ${acct_table} ..."
Stop = "UPDATE ${acct_table} SET ..."
Alive = "UPDATE ${acct_table} SET ..."
Post-Auth = "INSERT INTO ${postauth_table} ..."
}
...
}
accounting {
...
sql_log
...
}
post-auth {
...
sql_log
...
}
SECTIONS
accounting, post-auth
FILES
/etc/raddb/radiusd.conf
SEE ALSO
radsqlrelay(8), radiusd(8), radiusd.conf(5)
AUTHOR
Nicolas Baradakis <nicolas.baradakis@cegetel.net>
28 May 2005 rlm_sql_log(5)