Strange Phenomena with records filed in variable Post: 302918736

Sponsored Content

Top Forums Shell Programming and Scripting Strange Phenomena with records filed in variable Post 302918736 by Cochise on Thursday 25th of September 2014 08:40:48 AM

09-25-2014

Registered User

Strange Phenomena with records filed in variable

Trying to find out whether there is a limit for the number of records that can be stored in a variable I set up this small script:

Code:

#!/usr/bin/ksh 
for ((i = 1; i < 21; i++)) 
do 
  n=$(($i*100)) 
  echo "Trying $n records:" 
  recs=$(head -$n error.log) 
  echo "$recs" | wc 
done

Strangely somewhere beyond 1500 records some bytes/words/records are added to the data. The output looks like this:

Code:

Trying 100 records: 
     100    1701   14803 
Trying 200 records: 
     200    3405   29497 
Trying 300 records: 
     300    5105   44207 
Trying 400 records: 
     400    6802   58874 
Trying 500 records: 
     500    8654   74208 
Trying 600 records: 
     600   10464   89113 
Trying 700 records: 
     700   12309  104241 
Trying 800 records: 
     800   14067  119066 
Trying 900 records: 
     900   15913  134357 
Trying 1000 records: 
    1000   17700  149270 
Trying 1100 records: 
    1100   19556  164703 
Trying 1200 records: 
    1200   21441  180414 
Trying 1300 records: 
    1300   23329  195869 
Trying 1400 records: 
    1400   25225  211358 
Trying 1500 records: 
    1500   27204  227203 
Trying 1600 records: 
    1603   29132  243107 
Trying 1700 records: 
    1703   31039  258401 
Trying 1800 records: 
    1815   32952  274627 
Trying 1900 records: 
    1915   34816  289880 
Trying 2000 records: 
    2015   36687  305311

What is going on here?

Cochise

View Public Profile for Cochise

Find all posts by Cochise

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Using awk to search variable length records

New to awk and need some help. I have a script that I would like to make more compact. I want to read a file and grab every field, from every record, except the last field. The records are variable length and have varying number of fields. A record will have at least two fields, but can have...

2. Shell Programming and Scripting

Using a variable to select records with awk

As part of a bigger task, I had to read thru a file and separate records into various batches based on a field. Specifically, separate records based on the value in the batch field as defined below. The batch field left-justified numbers. The datafile is here > cat infile 12345 1 John Smith ...

3. Shell Programming and Scripting

filter out all the records which are having space in the 8th filed of my file

I have a file which is having fileds separtaed by delimiter. Ex: C;4498;qwa;cghy;;;;40;;222122 C;4498;sample;city;;;;34 2;;222123 C;4498;qwe;xcbv;;;;34-2;;222124 C;4498;jj;sffz;;;;41;;222120 C;4498;eert;qwq;;;;34 A;;222125 C;4498;jj;szxzzd;;;;34;;222127 out of these records I...

4. Shell Programming and Scripting

Strange variable comparison result in awk

So, I'm making a little awk script that generates a range-based histogram of a set of numbers. I've stumbled onto a strange thing. Toward the end of the process, I have this test: if ( bindex < s ) "bindex" is the "index" of my "bin" (the array element that gets incremented whenever a...

5. Shell Programming and Scripting

Prefix a variable in the first column of all the records of the files with and without header

In a bash shell, I have to prefix a variable to two .CSV files File1.CSV and File2.CSV. One of the files has a header and the other one is with no header in the below format: "value11","value12","value13","value14","value15","value16" "value21","value22","value23","value24","value25","value26"...

6. Programming

Strange value of the double type variable: -nan(0x8000000000000)

I am confused by the value of "currdisk->currangle" after adding operation. Initially the value of "currdisk->currangle" is 0.77500000000000013, but after adding operation, it's changed to "-nan(0x8000000000000)", Can anyone explain ? Thanks! The following is the occasion of gdb debugging. 3338 ...

7. Shell Programming and Scripting

Bash - concatenate string - strange variable scoping

Hello, I am trying to concatenate a string in a bash script like this: runCmd="docker run -e \"IMAGE_NAME=$IMAGE_NAME\" " env | grep "$ENV_SUFFIX" | while read line; do envCmd="-e \"${line}\" " runCmd=$runCmd$envCmd echo $runCmd # here concatenation works fine done echo...

8. Shell Programming and Scripting

Assign number of records to a variable

How does one assign a variable, x to equal the number of records in a different file. I have a simple command such as below: awk -F "\t" '(NR>5) { if(($x == "0/0")) { print $0} }' a.txt > a1.txt but I want x to equal the number of records in a different file, b.txt

9. Shell Programming and Scripting

Replace variable value in first file based on records in second

Hello , I have below files a) File A <?xml version="1.0" encoding="UTF-8" standalone="no"?> <root xmlns="http://aaa/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema" version="2.0"> <project name="source"> <mapping name="m_Source"> <parameter...

LEARN ABOUT CENTOS

ldns-compare-zones

ldns-compare-zones(1)					      General Commands Manual					     ldns-compare-zones(1)

NAME

       ldns-compare-zones - read and compare two zonefiles and print differences

SYNOPSIS

       ldns-compare-zones [-c] [-i] [-d] [-z] [-s] ZONEFILE1 ZONEFILE2

DESCRIPTION

       ldns-compare-zones reads two DNS zone files and prints number of differences.
       Output is formated to:
	       +NUM_INS        -NUM_DEL        ~NUM_CHG

       The  major  comparison  is  based on the owner name. If an owner name is present in zonefile 1, but not in zonefile 2, the resource records
       with this owner name are considered deleted, and counted as NUM_DEL. If an owner name is present in zonefile 2, but not in zonefile 1,  the
       resource  records with this owner name are considered inserted, and counted as NUM_INS. If an owner name is present in both, but there is a
       difference in the amount or content of the records, these are considered changed, and counted as NUM_CHG.

OPTIONS

       -c     Print resource records whose owner names are in both zone files, but with different resource records. (a.k.a. changed)

       -i     Print resource records whose owner names are present only in ZONEFILE2 (a.k.a. inserted)

       -d     Print resource records whose owner names are present only in ZONEFILE1 (a.k.a. deleted)

       -a     Print all changes. Specifying this option is the same as specifying -c -i amd -d.

       -z     Suppress zone sorting; this option is not recommended; it can cause records to be incorrectly marked as changed,	depending  of  the
	      nature of the changes.

       -s     Do  not  exclude the SOA record from the comparison.  The SOA record may then show up as changed due to a new serial number.  Off by
	      default since you may be interested to know if (other zone apex elements) have changed.

       -h     Show usage and exit

       -v     Show the version and exit

AUTHOR

       Written by Ondej Sury <ondrej@sury.org> for CZ.NIC, z.s.p.o. (czech domain registry)

REPORTING BUGS

       Report bugs to <ondrej@sury.org>.

COPYRIGHT

       Copyright (C) 2005 CZ.NIC, z.s.p.o.. This is free software. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A	PARTICULAR
       PURPOSE.

								    17 Oct 2007 					     ldns-compare-zones(1)