/tmp/file.txt is a very big file. it ranges from 400MB to 4GB in size. i want to know if line 2065696 exist. hence the reason for the above. but the problem is, this command is very slow. i have tried awk and grep and both take a while to come back to the prompt.
Are all of the file records the same length? (the file has a fixed record length).
if so:
1. get the file size from ls -l (solaris) or stat command (Linux)
2. divide the file size by the fixed record size.
# if the result is >= 2065696 then then record exists.
If not you have to push the file pointer past 2065695
Code:
\n
, not have reached EOF. i.e., read that far into the file.
What are you trying to do? Look for something on line 2065696?
Are all of the file records the same length? (the file has a fixed record length).
if so:
1. get the file size from ls -l (solaris) or stat command (Linux)
2. divide the file size by the fixed record size.
# if the result is >= 2065696 then then record exists.
If not you have to push the file pointer past 2065695
Code:
\n
, not have reached EOF. i.e., read that far into the file.
What are you trying to do? Look for something on line 2065696?
yes i'm looking for something on line 2065696.
and i dont understand the second part of what you said. can you please elaborate
also, each line in the file is not the same length.
Because each line ends with \n, the newline character, you have to read from the start of the file, reading line by line, until you have read 2065696 lines. Or found that many newlines minus to be on line 2065696.
The fastest way to do that is to use something that is compiled to do just exactly that:
Code:
// findln.c
// usage:
// ./findln file_to_check
// ./findln < file_to_check
// command some_file | ./findln
// compile [g]cc findln.c -o findln
#include <stdlib.h>
#include <stdio.h>
int main(int argc, char **argv)
{
FILE *in=NULL;
int i=0;
if (argc==1)
in=stdin;
else
in=fopen(argv[1], "r");
if(in==NULL) {perror(""); exit(1);}
char tmp[4096]={0x0};
while(fgets(tmp, sizeof(tmp), in)!=NULL )
{
i++;
if(i==2065696)
{
printf("%s", tmp);
exit(0); // no error because we found it
}
}
return 1; // error because we did not get the line
}
One of the things you do in UNIX and windows is to write quick and dirty code for things like this. Does one thing: It just reads a file about as fast as possible, line by line.
If you want a faster solution this is how you do it. C, C++, or some other compiled language you know. awk is interpreted, sed is meant to do a lot of stuff, so they all are going to be somewhat slower than stupid code like the above.
In the bash below the out put of a process is written to input. What I am trying to do is read each line in the input and verify/check it for specific text (there are always 6 lines for each file and the specific text for each line is in the description). There will always be 6 lines in each... (5 Replies)
I'm writing a script that has the need to verify the current user's username and password. I'm not entirely sure how to do this. I've read some things on "dscl" but am not sure that's the correct route for me to go.
The one condition i have is that i really need to have the verification happen... (4 Replies)
Hello everyone,
I don't really know anything about scripting, but I have to manage to make this script, out of necessity.
#!/bin/bash
while read -r line; do #I'm reading from a big wordlist
instructions using $line
done
Is there a way to automatically write the $line number the script... (4 Replies)
I'm trying to count the number of times each word in the file exist
for example if the file has:
today I have a lot to write, but I will not go for it. The main thing is that today I am looking for a way to get each word in this file with a word count after it specifying that this word has... (4 Replies)
Guy's
I have file system called /appspft has millions of files and I want to know exactly how many file under it
Pls advice with that command to verify number of files .. (3 Replies)
Hello Everyone.
I am trying to display contains of a file from a specific line to a specific line(let say, from line number 3 to line number 5). For this I got the shell script as shown below:
if ; then
if ; then
tail +$1 $3 | head -n $2
else
... (5 Replies)
hi guys,
i have close bracket ")" accross the file
but i want to take the line number where only once close bracket exist in the line.
Please help me in SED command
i should loop through the file. (4 Replies)
Hi Everybody,
I am trying to write a script that will get some perticuler data from a file and redirect to a file.
My Question is,
I have a Very huge file,In that file I have my required data is started from 25th line and it will ends in 100th line.
I know the line numbers, I need to get all... (9 Replies)
Hi,
I have a huge file & I want to add a specific text in column. But I want to add this text from a specific line number to a specific line number & another text in to another range of line numbers.
To be more specific: lets say my file has 1000 lines & 4 Columns. I want to add text "Hello"... (2 Replies)
Hello, I need help in appending the line number of each line to the file and also to get the total number of lines. Can somebody please help me.
I have a file say:
abc
def
ccc
ddd
ffff
The output should be:
Instance1=abc
Instance2=def
Instance3=ccc
Instance4=ddd
Instance5=ffff
... (2 Replies)
