Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: AWK Memory Limit ?
Top Forums Shell Programming and Scripting AWK Memory Limit ? Post 302432888 by vgersh99 on Sunday 27th of June 2010 08:49:09 PM
Old 06-27-2010
Quote:
Originally Posted by cold_Que
Is there an input file memory limit for awk?

I have a 38Mb text file that I am trying to print out certatin lines and add a string to the end of that line.

When I excute the script on the 38Mb file the string I am adding is put on a new line. If I do the same with a smaller file the string is put on to the end of the line like I requested.

Any suggestions on how to address this issue?

The code excerpt is below;

Code:
if(NR == spcline+1 && FNR != 1 && $0 !~ /101106/) {printf "%1$s%2$s\n", $0 , "  101106"}

Thanks

---------- Post updated at 07:21 PM ---------- Previous update was at 04:35 PM ----------

I figured this out. It has nothing to do with memory

The problem is the new line character "\n" in the printf statement. If I remove it then the string remains on the same line.

Any one know how to print out newline characters in a file?
You just answered your own question - '\n' is your friend.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

upper limit of accessible memory space for a single process in Unix/Linux

Hellp all, if there is 3G memory in my Unix server I want to know if all the 3G space can be used by ong sigle process. As i know, in Windows, one process can only access at most 1G memory despite there is probably more than 1G memory is equipped. (1 Reply)
Discussion started by: cy163
1 Replies

2. Ubuntu

Redhat 2.1 AS Memory Limit?

I have a customer with an HP DL380 G4 server running Redhat 2.1 AS that has 4GB memory installed. They want to upgrade in the server to the maximum of 12GB using (6) 2GB DIMMs. I can do this for them, but I read somewhere that Redhat 2.1 has an upper memory limit. Or you need a kernel patch to use... (2 Replies)
Discussion started by: Cbish68
2 Replies

3. Shell Programming and Scripting

awk file size limit

My code is awk '{ out=split(FILENAME,a,"/") sub(/\./,"_",a) sub(/\-/,"_",a) NEWSTRING="main_"a"_"a"(" # The word we want to insert gsub(/main\(/,NEWSTRING); # the word to be replaced print "Main becomes ",NEWSTRING")","in file ",FILENAME >> "/home/ds2/test/NEW2.txt" ... (4 Replies)
Discussion started by: senior_ahmed
4 Replies

4. Shell Programming and Scripting

Limit output in awk

Hi All, I want to delimit the output using awk. For eg:: a,b,c,d,e,f abc,def,ghi should change to a|b|c|d|e|f abc|def|ghi Or to put in another way.. OFS will work in the following code if I seperate the values with comma (eg. $1,$2,$3,$4,$5,$6 ). But since the no. of... (3 Replies)
Discussion started by: PRKS
3 Replies

5. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

6. Shell Programming and Scripting

Memory limit on php in .sh script

Hi, I have .sh script running php script with "php". When I run php script from web browser, it is running without errors. When I run it from .sh script, I am getting "memory exhausted". It seems to me that running php from .sh does not respect php.ini or have its own setting. So, how can I set... (0 Replies)
Discussion started by: LukasB
0 Replies

7. AIX

Memory limit for C program

Greetings - I'm porting a C application to an AIX (6.1) system, and have bumped into the limits AIX imposes on memory allocation, namely the default limit of 256MB for a process. I'm aware of the compilation flag that allows an application to gain access to up to 8 memory segments (each 256MB,... (4 Replies)
Discussion started by: traviswheeler
4 Replies

8. UNIX for Dummies Questions & Answers

character limit via awk

I'm using a command that outputs the total size of the files that I've specified. I'd like to introduce a character limit that appends an ellipsis to the lines that go beyond the specified amount. du -chs {query} | sed 's!.*/!!' | awk '{print substr($0,0,25)""}' That's what I have so far.... (4 Replies)
Discussion started by: Light_
4 Replies

9. Red Hat

PAE kernel memory limit

What is the limit of LowMem and HighMem in PAE enable kernel. (2 Replies)
Discussion started by: hiten.r.chauhan
2 Replies

10. Red Hat

Cpu, memory - limit by user

Hi all ! I'm new in this site, so sorry if this question is into wrong place. How can I limit cpu/core and memory usage by user? System: RedHat Ent. Linux. 6.4 Tks, (4 Replies)
Discussion started by: Tiago
4 Replies

LEARN ABOUT REDHAT

gets

gets(n) 						       Tcl Built-In Commands							   gets(n)

__________________________________________________________________________________________________________________________________________________

NAME

       gets - Read a line from a channel

SYNOPSIS

       gets channelId ?varName?
_________________________________________________________________

DESCRIPTION

       This command reads the next line from channelId, returns everything in the line up to (but not including) the end-of-line character(s), and
       discards the end-of-line character(s).  If varName is omitted the line is returned as the result of the command.  If varName  is  specified
       then the line is placed in the variable by that name and the return value is a count of the number of characters returned.

       If  end	of file occurs while scanning for an end of line, the command returns whatever input is available up to the end of file.  If chan-
       nelId is in nonblocking mode and there is not a full line of input available, the command returns an empty string and does not consume  any
       input.	If  varName is specified and an empty string is returned in varName because of end-of-file or because of insufficient data in non-
       blocking mode, then the return count is -1.  Note that if varName is not specified then the end-of-file	and  no-full-line-available  cases
       can produce the same results as if there were an input line consisting only of the end-of-line character(s).  The eof and fblocked commands
       can be used to distinguish these three cases.

SEE ALSO

       file(n), eof(n), fblocked(n)

KEYWORDS

       blocking, channel, end of file, end of line, line, nonblocking, read

Tcl									7.5								   gets(n)
All times are GMT -4. The time now is 10:51 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy