08-10-2007
Shell script to check the unique numbers in huge data
Friends,
I have to write a shell script,the description is----
i Have to check the uniqueness of the numbers in a file.
A file is containing 200thousand tickets and a ticket have 15 numbers in asecending order.And there is a strip that is having 6 tickets that means 90 numbers.I have to write a shell script like this----- No two tickets are common in 200thousand tickets and no two numers are repeating in a strip.
I would appericiate your help.
If you want some more info i am pasting it here.
---------------------------------------------------
Each ticket strip will have six tickets.
A strip is a group of 6 tickets. Every possible number from 1 through to 90 will appear on each full strip.
Each ticket will have 9 columns, and 3 rows. Hence a ticket strip will effectively have 9 columns and 18 rows.
Column 1 will have numbers between 1-9, 2 will have 10-19, so on till 8th column having 70-79; the only exception is the last column (9th column) having 80-90.
In each row there will be only 5 columns generated, the other 4 will be blank.
If there are more than 1 value in a column within a ticket, then they should be in ascending order.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
here i have two files:
file 1
1
2
3
4
5
5
6
7
8
9
file 2
4
5
6
6
8
8 (6 Replies)
Discussion started by: i.scientist
6 Replies
2. UNIX for Dummies Questions & Answers
i All
I have scripting question.
I have a file "out.txt"
which is generated by another script
the file contains the following
my_identifier8859574
logout
The number is generated in the script and I have put the my_identifier bit in front of it as a unique identifier
I now have... (7 Replies)
Discussion started by: grahambo2005
7 Replies
3. UNIX for Dummies Questions & Answers
Hi,
I am going to fetch a list of numbers that starts with "0032" from a file with a format like the given below:
"
0032459999 0032458888 0032457777
0032451111 0032452222 0032453333
0032459999 0032458888 0032457777
0032451111 0032452222 0032453333
"
I want to get a unique... (6 Replies)
Discussion started by: tinku
6 Replies
4. Shell Programming and Scripting
Hello All,
I have 3 types of files. The names of which starts with P,I,M
like P*********
D*********
M*********
now I need to do some operations witht hese files..
so
if file name starts with P or p
then
do the operation for P file...
fi
else (20 Replies)
Discussion started by: smarty86
20 Replies
5. Shell Programming and Scripting
Below is my perl script:
#!/usr/bin/perl
open(FILE,"$ARGV") or die "$!";
@DATA = <FILE>;
close FILE;
$join = join("",@DATA);
@array = split( ">",$join);
for($i=0;$i<=scalar(@array);$i++){
system ("/home/bin/./program_name_count_length MULTI_sequence_DATA_FILE -d... (5 Replies)
Discussion started by: patrick87
5 Replies
6. Shell Programming and Scripting
Hello Everyone,
I have a perl script that reads two types of data files (txt and XML). These data files are huge and large in number. I am using something like this :
foreach my $t (@text)
{
open TEXT, $t or die "Cannot open $t for reading: $!\n";
while(my $line=<TEXT>){
... (4 Replies)
Discussion started by: ad23
4 Replies
7. Shell Programming and Scripting
HI All,
I have a CSV file of 30 columns separated by ,. I want to get a count of all unique rows written to a flat file. The CSV file is around 5000 rows
The first column is a time stamp and I need to exclude while counting unique
Thanks,
Ravi (4 Replies)
Discussion started by: Nani369
4 Replies
8. Shell Programming and Scripting
Hi All,
bash-3.00$ gzgrep -i '\ ExecuteThread:' /******/******/******/******/stdout.log.txt.gz
<Jan 7, 2012 5:54:55 PM UTC> <Error> <WebLogicServer> <BEA-000337> < ExecuteThread: '414' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "696" seconds working on the request... (4 Replies)
Discussion started by: osmanux
4 Replies
9. Shell Programming and Scripting
I have a file containing data like so:
2012-01-02 GREEN 4
2012-01-02 GREEN 6
2012-01-02 GREEN 7
2012-01-02 BLUE 4
2012-01-02 BLUE 3
2012-01-02 GREEN 4
2012-01-02 RED 4
2012-01-02 RED 8
2012-01-02 GREEN 4
2012-01-02 YELLOW 5
2012-01-02 YELLOW 2
I can't always predict what the... (4 Replies)
Discussion started by: rich@ardz
4 Replies
10. UNIX for Advanced & Expert Users
Optimization shell/awk script to aggregate (sum) for all the columns of Huge data file
File delimiter "|"
Need to have Sum of all columns, with column number : aggregation (summation) for each column
File not having the header
Like below -
Column 1 "Total
Column 2 : "Total
...
...... (2 Replies)
Discussion started by: kartikirans
2 Replies
KINIT(1) General Commands Manual KINIT(1)
NAME
kinit - obtain and cache Kerberos ticket-granting ticket
SYNOPSIS
kinit [-5] [-4] [-V] [-l lifetime] [-s start_time] [-r renewable_life] [-p | -P] [-f | -F] [-A] [-v] [-R] [-k [-t keytab_file]] [-c
cache_name] [-S service_name] [principal]
DESCRIPTION
kinit obtains and caches an initial ticket-granting ticket for principal.Thetypicaldefaultbehavioristoacquireonly Kerberos 5 tickets. How-
ever, if kinit was built with both Kerberos 4 support and with the default behavior of acquiring both types of tickets, it will try to
acquire both Kerberos 5 and Kerberos 4 by default. Any documentation particular to Kerberos 4 does not apply if Kerberos 4 support was not
built into kinit.
OPTIONS
-5 get Kerberos 5 tickets. This overrides whatever the default built-in behavior may be. This option may be used with -4
-4 get Kerberos 4 tickets. This overrides whatever the default built-in behavior may be. This option is only available if kinit was
built with Kerberos 4 compatibility. This option may be used with -5
-V display verbose output.
-l lifetime
requests a ticket with the lifetime lifetime. The value for lifetime must be followed immediately by one of the following delim-
iters:
s seconds
m minutes
h hours
d days
as in "kinit -l 90m". You cannot mix units; a value of `3h30m' will result in an error.
If the -l option is not specified, the default ticket lifetime (configured by each site) is used. Specifying a ticket lifetime
longer than the maximum ticket lifetime (configured by each site) results in a ticket with the maximum lifetime.
-s start_time
requests a postdated ticket, valid starting at start_time. Postdated tickets are issued with the invalid flag set, and need to be
fed back to the kdc before use. (Not applicable to Kerberos 4.)
-r renewable_life
requests renewable tickets, with a total lifetime of renewable_life. The duration is in the same format as the -l option, with the
same delimiters. (Not applicable to Kerberos 4.)
-f request forwardable tickets. (Not applicable to Kerberos 4.)
-F do not request forwardable tickets. (Not applicable to Kerberos 4.)
-p request proxiable tickets. (Not applicable to Kerberos 4.)
-P do not request proxiable tickets. (Not applicable to Kerberos 4.)
-A request address-less tickets. (Not applicable to Kerberos 4.)
-v requests that the ticket granting ticket in the cache (with the invalid flag set) be passed to the kdc for validation. If the
ticket is within its requested time range, the cache is replaced with the validated ticket. (Not applicable to Kerberos 4.)
-R requests renewal of the ticket-granting ticket. Note that an expired ticket cannot be renewed, even if the ticket is still within
its renewable life. When using this option with Kerberos 4, the kdc must support Kerberos 5 to Kerberos 4 ticket conversion.
-k [-t keytab_file]
requests a host ticket, obtained from a key in the local host's keytab file. The name and location of the keytab file may be speci-
fied with the -t keytab_file option; otherwise the default name and location will be used. When using this option with Kerberos 4,
the kdc must support Kerberos 5 to Kerberos 4 ticket conversion.
-c cache_name
use cache_name as the Kerberos 5 credentials (ticket) cache name and location; if this option is not used, the default cache name
and location are used.
The default credentials cache may vary between systems. If the KRB5CCNAME environment variable is set, its value is used to name
the default ticket cache. Any existing contents of the cache are destroyed by kinit. (Note: The default name for Kerberos 4 comes
from the KRBTKFILE environment variable. This option does not apply to Kerberos 4.)
-S service_name
specify an alternate service name to use when getting initial tickets. (Applicable to Kerberos 5 or if using both Kerberos 5 and
Kerberos 4 with a kdc that supports Kerberos 5 to Kerberos 4 ticket conversion.)
ENVIRONMENT
Kinit uses the following environment variables:
KRB5CCNAME Location of the Kerberos 5 credentials (ticket) cache.
KRBTKFILE Filename of the Kerberos 4 credentials (ticket) cache.
FILES
/tmp/krb5cc_[uid] default location of Kerberos 5 credentials cache ([uid] is the decimal UID of the user).
/tmp/tkt[uid] default location of Kerberos 4 credentials cache ([uid] is the decimal UID of the user).
/etc/krb5.keytab
default location for the local host's keytab file.
SEE ALSO
klist(1), kdestroy(1), krb5(3)
KINIT(1)