|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Need to Extract Data From 94000 records
Post 302306794 by KevinADC on Monday 13th of April 2009 08:27:43 PM
04-13-2009
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
i have a pipe delimited file with records spread in many lines.
i need to extract those records
1)having X in beginning of that record
2)and having at least one Y in beginning before other record begins
eg:
X|Rec1|
A|Rec1|
Y|Rec1|
X|Rec2|
Y|Rec2|
Z|Rec3|
X|Rec4|
M|Rec4|
... (4 Replies)
Discussion started by: finder255
4 Replies
2. Shell Programming and Scripting
Hello,
I have got one file with more than 120+ million records(35 GB in size). I have to extract some relevant data from file based on some parameter and generate other output file.
What will be the besat and fastest way to extract the ne file.
sample file format :--... (2 Replies)
Discussion started by: learner16s
2 Replies
3. Shell Programming and Scripting
My input file:
data_5 Ali 422 2.00E-45 102/253 140/253 24
data_3 Abu 202 60.00E-45 12/23 140/23 28
data_1 Ahmad 256 7.00E-45 120/235 140/235 22
data_4 Aman 365 8.00E-45 15/65 140/65 20
data_10 Jones 869 9.00E-45 65/253 140/253 18... (12 Replies)
Discussion started by: patrick87
12 Replies
4. Shell Programming and Scripting
Example CSV:
$ cat myfile
HDR
COL_A,COL_B,COL_C
X,Y,Z
Z,Y,X
...
X,W,Z
In this example, I know that column names are on the second line. I also know that I would like to print lines where COL_A="X" and COL_C="Z". In this simple example, I know that COL_A = $1 and COL_C = $3, and hence... (6 Replies)
Discussion started by: cs03dmj
6 Replies
5. Shell Programming and Scripting
Hi Guys,
I have a file as follows:
a b c 1 2 3 4
pp gg gh hh 1 2 fm 3 4
g h i j k l m 1 2 3 4
d e f g h j i k l 1 2 3 f 3 4
r t y u i o p d p re 1 2 3 f 4
t y w e q w r a s p a 1 2 3 4
I am trying to extract all the 2's from each row. 2 is just an example... (6 Replies)
Discussion started by: npatwardhan
6 Replies
6. Shell Programming and Scripting
I am not an expert in awk, SED, etc... but I really hope there is a way to do this, because I don't want to have to right a program. I am using C shell.
FILE 1 FILE 2
H0000000 H0000000
MA1 MA1
CA1DDDDDD CA1AAAAAA
MA2 ... (2 Replies)
Discussion started by: jclanc8
2 Replies
7. Shell Programming and Scripting
Hello,
I have a file with various records in it (from length 30 - 195) and I want to run a script to read each line and copy only the recl=80 files to an output file.
Any help much appreciated (4 Replies)
Discussion started by: Grueben
4 Replies
8. Shell Programming and Scripting
Hi Gents,
I have a file 1 like this
1 1000 20
2 2000 30
3 1000 40
5 1000 50
And I have other file 1 like
2 1
I would like to get from the file 1 the complete line which are in file 2, the key to compare is the column 2 then output should be.
2 2000 30.
I was trying to get it... (5 Replies)
Discussion started by: jiam912
5 Replies
9. Shell Programming and Scripting
Hi,
I have a file with 20GB Pipe Delimited file where i have too many duplicate records.
I need an awk script to extract the unique records from the file and put it into another file.
Kindly help.
Thanks,
Arun (1 Reply)
Discussion started by: Arun Mishra
1 Replies
10. Shell Programming and Scripting
Hi All,
I have a requirement to extract para in XML file on the basis of another list file having specific parameters.
I will extract these para from XML and import in one scheduler tool.
file2
<FOLDER DATACENTER="ControlMserver" VERSION="800" PLATFORM="UNIX" FOLDER_NAME="SH_AP_INT_B01"... (3 Replies)
Discussion started by: looney
3 Replies
LEARN ABOUT CENTOS
iceauth
ICEAUTH(1) General Commands Manual ICEAUTH(1) NAME
iceauth - ICE authority file utility SYNOPSIS
iceauth [ -f authfile ] [ -vqib ] [ command arg ... ] DESCRIPTION
The iceauth program is used to edit and display the authorization information used in connecting with ICE. This program is usually used to extract authorization records from one machine and merge them in on another (as is the case when using remote logins or granting access to other users). Commands (described below) may be entered interactively, on the iceauth command line, or in scripts. OPTIONS
-f authfile Name of the authority file to use. Will default to the file currently in use by the session. -v Turns on extra messages (verbose mode) -q Turns off extra messages (quiet mode) -i Ignore the locks on the authority file -b Break the locks on the authority file -u Print basic usage instructions USAGE
When iceauth is run it will allow the following set of commands to be entered interactively or in scripts. ? List available commands. help Print help information. You may supply a command name to help to get specific information about it. info Print information about the entries in the authority file. list List (print) entries in the authority file. You may specify optional modifiers as below to specify which entries are listed. list [ protocol_name ] [ protocol_data ] [ netid ] [ authname ] add Add an entry to the authority file. This must be in the format add protocol_name protocol_data netid authname authdata remove Remove entries from the authority file. remove [ protocol_name ] [ protocol_data ] [ netid ] [ authname ] extract Extract entries from the authority file in to a destination file. You must supply the path to the destination to this command as in the following format. Optional specifiers allow you to narrow which entries are extracted. extract filename [ protocol_name ] [ protocol_data ] [ netid ] [ authname ] merge Merge entries from other files in to the authority file selected by the program. You may supply any number of file paths to this command as follows: merge filename1 [ filename2 ] [ filename3 ] ... exit Save changes and exit the program. quit Abort changes and exit the program without saving. source Read and execute commands from a file. source filename AUTHOR
Ralph Mor, X Consortium X Version 11 iceauth 1.0.5 ICEAUTH(1)