Efficient way of extracting data from file


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Efficient way of extracting data from file
# 1  
Old 07-14-2011
Efficient way of extracting data from file

I am having a file, around 500 lines. which contains one letter words, two letters words,...and so on(up to 15 letter words and words are not seprated by line). I need to compare all 1 letter words with 3,4,5 and 6 letters word, all 2 letters words with 2,3,4 and 5 letters words and all 3 letters word with 3 and 4 letters words. For this i wrote a program in C and shell script, my logic is

*)use awk and shell script to create six different files. file1 for 1 letter words, file2 for 2 letters words ..so on and file6 for six letters words.

*) In every file first line contains number of words in that file.

*)read each file line by line and since i already know the number of words in the file assign dynamic memory to store them in 2D char arrays.

*)For each word in 2d arrays compare as mentioned above.

part of my code:
Code:
/*for 3*/
for(i=0;i<length[2];i++) /*length[2] contains number of 3 letter words
{
 
  /*3x3*/
 for(j=i;j<length[2];j++)
 {
    
     for(k=0;k<4;k++)
     {              
            strcpy(temp1,file3[i]);             /*file3[i] is pointer to ith 3 letter word*/
            strcpy(temp2,file3[j]);
            sprintf(temp3,"%d",2*k);
            if(strcmp(crypt(temp4=strcat(temp1,strcat(temp3,temp2)),salt),encrypt)!=0)
             {
               if( strcmp(crypt(temp4=strcat(temp2,strcat(temp3,temp1)),salt),encrypt)==0)
                 {
                          printf("%s\n",temp4);
                          exit(0);
    }
             }
      else 
              { 
                printf("%s\n",temp4);
                exit(0);
       }   
       }
  }/*3x3 end*/
/*3x4*/
for(j=i;j<length[3];j++)
 {.......

/*------------------------------------------------------------------*/
But it is to slow. Can anyone suggest me better way of doing this. Thanks in advance.

Last edited by Franklin52; 07-14-2011 at 05:36 PM.. Reason: Please use code tags for data and code samples, thank you
# 2  
Old 07-14-2011
brute-forcing crypt() isn't meant to be fast, why are you doing this?
# 3  
Old 07-14-2011
Iam having a encrypted password and a file containing set of words.combination of those words give password.
# 4  
Old 07-14-2011
Don't know any way to make crypt() faster. It was designed to be resource intensive precisely to make what you're doing more difficult.

If your CPU has two cores, you could run two instances of the program over different ranges of j and they'd compute their results simultaneously.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need Help in extracting data from XML File

Hi All My input file is an XML and it has some tags and data rows at end. Starting of data rows is <rs:data> and ending of data rows is </rs:data>. Within sample data rows (2 rows) shown below, I want to extract data value after equal to sign (until space or "/" sign). So if XML data... (7 Replies)
Discussion started by: vx04
7 Replies

2. Shell Programming and Scripting

Extracting data blocks from file

Hi all, I want to extract blocks of data from a file depending on the contents of that block. The input file(table) has several blocks each starting with 'gene' in the first column. I want to extract only those blocks which do not have the expression '_T02' in the second column. Input file ... (3 Replies)
Discussion started by: newbie83
3 Replies

3. UNIX for Dummies Questions & Answers

Extracting data from file

I am trying to compare the data in lines 3 & 5 to see if they match up to the '-S570' (see first code set, all proprietary information has been removed from code set) spawn telnet Trying ... Connected to CA-LOS1234-ASE-S570.cl . Escape character is '^]'. CA-LOS1234-ASE-S570 Username: ... (1 Reply)
Discussion started by: slipshft
1 Replies

4. Shell Programming and Scripting

Need help in extracting data from xml file

Hello, This is my first post in here, so excuse me if I sound too noob here! I need to extract the path "/apps/mp/installedApps/V61/HRO/hrms_01698_A_qa.ear" from the below xml extract. The path will always appear with the key "binariesURL" <deployedObject... (6 Replies)
Discussion started by: abhishek2386
6 Replies

5. Shell Programming and Scripting

Extracting specific lines of data from a file and related lines of data based on a grep value range?

Hi, I have one file, say file 1, that has data like below where 19900107 is the date, 19900107 12 144 129 0.7380047 19900108 12 168 129 0.3149017 19900109 12 192 129 3.2766666E-02 ... (3 Replies)
Discussion started by: Wynner
3 Replies

6. UNIX for Dummies Questions & Answers

Extracting data from an xml file

Hello, Please can someone assist. I have the following xml file: <?xml version="1.0" encoding="utf-8" ?> - <PUTTRIGGER xmlns:xsd="http://www.test.org/2001/XMLSchema" xmlns:xsi="http://www.test.org/2001/XMLSchema-instance" APPLICATIONNUMBER="0501160" ACCOUNTNAME="Mrs S Test"... (15 Replies)
Discussion started by: Dolph
15 Replies

7. Programming

Help in extracting data with command from file in C

Hi, I have a file which stores the following array :- 1,2,3,4,5.........16,17,18,19,20 This file has few hundreds of inputs of these lines. I would like to read this file one line at a time; and assign to an array which is separated by ",". I tried to do fgets command however,... (10 Replies)
Discussion started by: ahjiefreak
10 Replies

8. UNIX for Dummies Questions & Answers

Extracting Data from a File

Hi I need to calculate the number of occurrences of a item in a number of files using Perl. The item appears continually throughout the files but in each case I only want to calculate it in certain blocks of the file. Example - Calculalte the number of occurrences of a 'pass' in a block of... (0 Replies)
Discussion started by: oop
0 Replies

9. Shell Programming and Scripting

Extracting Data from xml file

Hi ppl out there... Can anyone help me with the shell script to extract data from an xml file. My xml file looks like : - <servlet> <servlet-name>FrontServlet</servlet-name> <display-name>FrontServlet</display-name> ... (3 Replies)
Discussion started by: nishana
3 Replies

10. UNIX for Advanced & Expert Users

Extracting data from an AFP file

Hello Anybody any idea how to extract data from an AFP file using UNIX commands? I could make the AFP to PDF or if there is any other to change it to to make the extraction simplar. I'm open to ideas. Cheers (4 Replies)
Discussion started by: Dolph
4 Replies
Login or Register to Ask a Question