10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
What do i need to do have the below perl program load 205 million record files into the hash. It currently works on smaller files, but not working on huge files. Any idea what i need to do to modify to make it work with huge files:
#!/usr/bin/perl
$ot1=$ARGV;
$ot2=$ARGV;
open(mfileot1,... (12 Replies)
Discussion started by: mrn6430
12 Replies
2. Shell Programming and Scripting
Hi,
I need to correct line breaks for huge files (more than 1MM records in a file) and then format it properly.
Except the header and trailer, each record starts with 'D'.
Requirement:Scan the whole file except the header and trailer records and see if any of the records start with... (19 Replies)
Discussion started by: kikionline
19 Replies
3. Shell Programming and Scripting
Hi all,
I have two large files and i want a field by field comparison for each record in it.
All fields are tab seperated.
file1:
Email SELVAKUMAR RAMACHANDRAN
Email SHILPA SAHU
Web NIYATI SONI
Web NIYATI SONI
Email VIINII DOSHI
Web RAJNISH KUMAR
Web ... (4 Replies)
Discussion started by: Suman Singh
4 Replies
4. Shell Programming and Scripting
Hi All,
I have two files of the following formats
file 1 - this is a big file
>AB_1 gi|229194403|ref|ZP_04321208.1| group II intron reverse transcriptase/maturase
gdfjafhlkhlnlklaklskckcfhhahgfahajfkkallalfafafa
>AB_2 gi|229194404|ref|ZP_04321209.1|
gfksjgfkjsfjslfslfslhf
>AB_3... (1 Reply)
Discussion started by: Lucky Ali
1 Replies
5. UNIX for Advanced & Expert Users
I have the following situation:
a text file with 50000 string patterns:
abc2344536
gvk6575556
klo6575556
....
and 3 text files each with more than 1 million lines:
...
000000 abc2344536 46575 0000
000000 abc2344536 46575 4444
000000 abc2344555 46575 1234
...
I... (8 Replies)
Discussion started by: andy2000
8 Replies
6. Shell Programming and Scripting
Hi,
I have two files file A and File B. File A is a error file and File B is source file. In the error file. First line is the actual error and second line gives the information about the record (client ID) that throws error. I need to compare the first field (which doesnt start with '//') of... (11 Replies)
Discussion started by: kmkbuddy_1983
11 Replies
7. UNIX for Dummies Questions & Answers
Hi All,
Can you please help me in resolving the following problem?
My requirement is like this:
1) I have two files YESTERDAY_FILE and TODAY_FILE. Each one is having nearly two million data.
2) I need to check each record of TODAY_FILE in YESTERDAY_FILE. If exists we can skip that by... (5 Replies)
Discussion started by: madhukalyan
5 Replies
8. AIX
hi!
some looping problem here...
i have a 2-column text file
4835021 20060903FAL0132006
4835021 20060904FAL0132006
4835021 20060905FAL0132006
4835023 20060903FAL0132006
4835023 20061001HAL0132006
4835023 ... (3 Replies)
Discussion started by: d3ck_tm
3 Replies
9. Solaris
Somebody HELP!
I have a huge log file (TEXT) 76298035 bytes.
It's a logfile of IMEIs and IMSIS that I get from my EIR node.
Here is how the contents of the file look like:
000000,
1 33016382000913 652020100423994
1 33016382002353 652020100430743
1 33017035101003 652020100441736... (4 Replies)
Discussion started by: axl
4 Replies
10. UNIX for Dummies Questions & Answers
I am comparing text files where there are number of rows of numbers from window to unix box
Is there any way of checking lets say 4 document of text file
and seeing the difference only (or missing rows of numbers)
with simple commands with lets say a batch file
FROM ABSOULTE... (2 Replies)
Discussion started by: sjumma
2 Replies