Need help for faster file read and grep in big files Post: 303018522

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to grep faster ?

Hi I have to grep for 2000 strings in a file one after the other.Say the file name is Snxx.out which has these strings. I have to search for all the strings in the file Snxx.out one after the other. What is the fastest way to do it ?? Note:The current grep process is taking lot of time per...

2. Shell Programming and Scripting

Big data file - sed/grep/awk?

Morning guys. Another day another question. :rolleyes: I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution: for results in `grep "^\ ... works, but takes ages (we're talking minutes) to run. The data is held...

3. UNIX for Advanced & Expert Users

Split a big file into two others files

Hello, i have a very big file that has more then 80 MBytes (100MBytes). So with my CVS Application I cannot commit this file (too Big) because it must have < 80 MBytes. How can I split this file into two others files, i think the AIX Unix command : split -b can do that, buit how is the right...

4. UNIX for Dummies Questions & Answers

Faster than nested while read loops?

Hi experts, I just want to know if there is a better solution to my nested while read loops below: while read line; do while read line2; do while read line3; do echo "$line $line2 $line3" done < file3.txt done < file2.txt done < file1.txt >...

5. Shell Programming and Scripting

Read a file with n records as one big string using linux

Hello! Is there a way i can read a file with n records as one big string using linux shell script? I have a file in the below format - REC1 REC2 REC3 . . . REC4 Record length is 3000 bytes per record and with a newline char at the end. What i need to do is - read this file as one...

6. Shell Programming and Scripting

Grep -v -f and sort|diff which way is faster

Hi Gurus, I have two big files. I need to compare the different. currently, I am using sort file1 > file1_temp; sort file2 > file2_tmp diff file1_tmp file2_tmp I can use command grep -v -f file1 file2 just wondering which way is fast to compare two big files. Thanks...

7. UNIX for Dummies Questions & Answers

What is the faster way to grep from huge file?

Hi All, I am new to this forum and this is my first post. My requirement is like to optimize the time taken to grep the file with 40000 lines. There are two files FILEA(40000 lines) FILEB(40000 lines). The requirement is like this, both the file will be in the format below...

8. Shell Programming and Scripting

A faster way to read and search

I have a simple script that reads in data from fileA.txt and searches line by line for that data in multiple files (*multfiles.txt). It only prints the data when there is more than 1 instance of it. The problem is that its really slow (3+ hours) to complete the entire process. There are nearly 1500...

9. UNIX for Beginners Questions & Answers

Grep -f for big files

ok guys. this isnt homework or anything. i have been using grep -f all my life but i am trying this for a huge file and it doesnt work. can someone give me a replacement for grep -f pattern file for big files? thanks

10. Solaris

Split a big file system to several files

Gents Actually I have question and i need your support. I have this NAS file system mounted as /coresys has size of 7 TB I need to Split this file system into several file systems as mount points I mean how to can I Split it professionally to different NAS mount points how to can I decide...

LEARN ABOUT DEBIAN

gtkdoc-mktmpl

gtkdoc-mktmpl(1)					      General Commands Manual						  gtkdoc-mktmpl(1)

NAME

       gtkdoc-mktmpl --  GTK DocBook documentation generator.

SYNOPSIS

       gtkdoc-mktmpl [ See below ]

DESCRIPTION

       gtkdoc-mktmpl This creates or updates the template files which contain the manually-edited documentation. (A template is a simple text form
       which is filled in with the description of a function, macro, enum, or struct.  For functions  and  macros  it  also  contains  fields  for
       describing the parameters.)

       This script reads in the existing templates, found in tmpl/*.sgml, moves these files to tmpl/*.sgml.bak, and then recreates the .sgml files
       according to the structure given in the file MODULE-sections.txt.

       Any new templates added, or new function parameters, are marked with FIXME so you can do a grep to see which parts need updating.

       Any templates which are no longer used (i.e. they are remove from MODULE-sections.txt) are placed in the  file  tmpl/MODULE-unused.txt.	If
       they are included again later they are automatically copied back into position.	If you are certain that these templates will never be used
       again you can delete them from MODULE-unused.txt.

       Any parameters to functions which are no longer used are separated from the rest of the parameters with the line <!-- # Unused Parameters #
       -->.  It  may  be  that	the parameter name has just been changed, in which case you can copy the description to the parameter with the new
       name. You can delete the unused parameter descriptions when no longer needed.

EXAMPLE

       See /usr/share/doc/gtk-doc-tools/examples, for a makefile.am and a configure.in example file.

AUTHOR

       This manual page was written by Christian Marillat marillat@debian.org for the Debian GNU/Linux system (but may be used by others).

																  gtkdoc-mktmpl(1)

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to grep faster ?

Discussion started by: preethgideon

2. Shell Programming and Scripting

Big data file - sed/grep/awk?

Discussion started by: dlam

3. UNIX for Advanced & Expert Users

Split a big file into two others files

Discussion started by: steiner

4. UNIX for Dummies Questions & Answers

Faster than nested while read loops?

Discussion started by: chstr_14