05-18-2008
Check valid records in really big file with one commend..
Hi,
I have a 5 gig file, no record terminators, field terminators are newline. The record length is 768 and I would like to check that every 768th byte is a newline and print out the byte position if it isn't. I would like to do this going either forward or backwards with one command if possible. I read that awk has a 3000 byte limit for a record so maybe a complex grep?
Thanks,
Victor
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi All,
I have two files say file1 and file2.
I want to check the number of records in file1 and if its atleast 2 (i.e., 2 or greater than 2 ) then I have to check records in file2 .If records in file2 is atleast 1 (i.e. if its not empty ) i have to set some conditions .
Could you pls... (3 Replies)
Discussion started by: mavesum
3 Replies
2. Shell Programming and Scripting
I want to do conditional logic on whether a file has 0 bytes or more than 0 bytes.
what is the easiest way to do this? (2 Replies)
Discussion started by: guessingo
2 Replies
3. Shell Programming and Scripting
I need to check if an account has a valid password.
Would something like this work?
read ACCNAME
if grep -q "^$ACCNAME:\$6:" /etc/shadow; thenI noticed every entry in my shadow file that has a password starts with $6 ... it works for my current setup, but would it always work? I can't test... (4 Replies)
Discussion started by: ADay2Long
4 Replies
4. Shell Programming and Scripting
Hello!
Is there a way i can read a file with n records as one big string using linux shell script? I have a file in the below format -
REC1
REC2
REC3
.
.
.
REC4
Record length is 3000 bytes per record and with a newline char at the end. What i need to do is
- read this file as one... (5 Replies)
Discussion started by: mailme0205
5 Replies
5. Shell Programming and Scripting
Hi all
I have a big file which I have attached here.
And, I have to fetch certain entries and arrange in 5 columns
Name Drug DAP ID disease approved or notIn the attached file data is arranged with tab separated columns in this way:
and other data is... (2 Replies)
Discussion started by: manigrover
2 Replies
6. UNIX for Dummies Questions & Answers
Hi,
To load a big file in a table,I have a make sure that all rows in the file has same number of the columns .
So in my file if I am getting any rows which have columns not equal to 6 , I need to delete it . Delimiter is space and columns are optionally enclosed by "".
This can be ... (1 Reply)
Discussion started by: hemantraijain
1 Replies
7. Shell Programming and Scripting
I need a script that will run in unix to:
1) Read and input file with 1 column that contains for ex:
0123456789
1234567890
...etc
2) Checks the first column if it is:
a. Numeric from 0 - 9
b. if it is not less... (4 Replies)
Discussion started by: mrn6430
4 Replies
8. UNIX for Dummies Questions & Answers
Hi All,
I am a newbie...I would like to have a function which ll check if a file contains valid strings before "=" operator. Just to give you my requirement:
assume my file has content:
hello= gsdgsd sfdsg sgdsg sgdgdg
world= gggg hhhh iiiii
xxxx= pppp ppppp pppp
my... (5 Replies)
Discussion started by: rtagarra
5 Replies
9. Shell Programming and Scripting
Hello,
I am trying to develop a script to check for valid hostnames. Below are the prerequisites for a valid hostname which I got from wiki :
Hostnames are composed of series of labels concatenated with dots, as are all domain names. For example, "en.wikipedia.org" is a hostname. Each label... (8 Replies)
Discussion started by: rahul2662
8 Replies
10. Shell Programming and Scripting
I need a script to check the records in a file , if any value match transfer the record in error.txt file.
1- If any of the any field value is NULL(nothing in this field)
Record1|Record2|Record3|Record4|Record5|DATE1|DATE2
Example:
11111111|22222222|NULL|12|444|27042018|27042018... (8 Replies)
Discussion started by: vivekn
8 Replies
LEARN ABOUT DEBIAN
px_put_recordn
PX_PUT_RECORDN(3) Library Functions Manual PX_PUT_RECORDN(3)
NAME
PX_put_recordn -- Stores record in Paradox file at certain position
SYNOPSIS
#include <paradox.h>
int PX_put_recordn(pxdoc_t *pxdoc, char *data, int recpos)
DESCRIPTION
Stores a record in the buffer data into a Paradox file at the given position recpos. The first position has number 0. The function will
determine the data block for this record. If the position is after the last data block, then as many as needed empty data blocks will be
added. If the position is in the middle of a data block and there is no record right before the position, then the position will be recal-
culated to make sure the new record will be stored in the first free slot of the datablock. For example, if a datablock contains H records
and the first call of PX_put_recordn wants to store a record at postion 11, then this will be corrected to position H. PX_put_recordn will
also add an empty data block and store the record as the first record of the second data block. Storing a second record at position 11
again, will be executed without any position change.
data must be constructed with PX_put_data_xxx(3) functions before. It is of the same structure as the record returned by PX_get_record(3)
and PX_get_record2(3).
RETURN VALUE
Returns the record position on success and -1 on failure. The first position has number 0.
SEE ALSO
PX_get_record(3), PX_get_record2(3), PX_put_record(3), PX_put_data_byte(3), PX_put_data_short(3), PX_put_data_long(3), PX_put_data_dou-
ble(3), PX_put_data_alpha(3)
AUTHOR
This manual page was written by Uwe Steinmann uwe@steinmann.cx.
PX_PUT_RECORDN(3)