awk command input string too long, limit


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers awk command input string too long, limit
# 1  
Old 01-30-2020
awk command input string too long, limit

Code:
cat filename| awk '{ $1=""; print $0}'

in my file there are few lines that has more than 3000 characters per line and as soon as I run the above command it cores, strings core reveals that the awk is failing because input string too long, limit. can i get some help from the experts to find an alternative command for what I am trying to do.
# 2  
Old 01-30-2020
Looks like your fields are space separated...
Code:
sed 's/^[^ ][^ ]*//' myFile

# 3  
Old 01-30-2020
Hi,

What OS and version are you using?
What does your file look like?
What is the exact message?
# 4  
Old 01-31-2020
Try if a bash/ksh/zsh shell can handle longer lines:
Code:
while read -r junk other; do printf "%s\n" "$other"; done < filename

# 5  
Old 02-01-2020
Error Message shown below I used strings core >> coredumpfile and in that file I see the following error
Quote:
System = SunOS
Release = 5.10
KernelID = Generic_150400-14
Machine = sun4v
BusType = <unknown>
Serial = <unknown>
Users = <unknown>
OEM# = 0
Origin# = 1
NumCPU = 32
Code:
#ch/
$  3
# h#
wbad switch yylook %d
Input string too long, limit %d
Input string too long, limit %d
Input string too long, limit %d
Input string too long, limit %d
cgotofn: notin; state = %d, n = %d
field %d: |%ws|
awk: %s near line %lld
awk:
 record number %g
SUNW_OST_OSCMD
awk: Usage: awk [-Fc] [-f source | 'cmds'] [files]
substr: m=%d, n=%d, s=%ws
split: s=|%ws|, a=%ws, sep=|%wc|
%.20g
@!e)f
,+f$h
/,f0f
C1f+p-f<
G(l/fh
A2f4}
O4}mf8
G.tnfj
@SS-sqf1xSS1y
M1z6
TTTTTT8
lfgf<
^^^^^^
"f^`of"
"fsftfv
{fxf
#f#f#f
#f#f#f#f#f#f#g#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f
#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#f#ff
yacc stack overflow
syntax error
bailing out
illegal statement
newline in regular expression
newline in string
string too long
newline in character class
string too long
 <=
 >=
 ==
 !=
 !~
 +=
 -=
 *=
 /=
 %=
print
printf


Last edited by vbe; 02-01-2020 at 01:19 PM..
# 6  
Old 02-01-2020
Any luck with the alternate suggested solutions to try?
I see you're on SunOS and trying to use awk. Any better luck with nawk or /usr/xpg4/bin/awk?
# 7  
Old 02-01-2020
Thank you so much, can you please explain me what exactly you are doing. by the way it did work and thank you so much. I would like to understand your code.
Code:
while read -r junk other; do printf "%s\n" "$other"; done < filename

Thank you once again.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Limit on number of pipes after long-running command?

I'm trying to create a minimal, crude keylogger for X using only a shell script. I was quickly stumped: Why do these two commands entered in a terminal emulator produce output when I type... $ xinput test 6 | grep press $ xinput test 6 | awk '{print $3}' ...but this command produces no... (13 Replies)
Discussion started by: DevuanFan
13 Replies

2. UNIX for Beginners Questions & Answers

How to put a 80 character limit on a long topic line in markdown?

I have a topic line in markdown that spans more than 80 characters that i need to add a line break. Markdown is simply treating the line break as a brand new line instead of continuing as a topic line. Eg: # This is a very long line Markdown interprets it as This is a very long line (4 Replies)
Discussion started by: dragonpoint
4 Replies

3. Shell Programming and Scripting

How to avoid "Too many arguments" error, when passing a long String literal as input to a command?

Hi, I am using awk here. Inside an awk script, I have a variable which contains a very long XML data in string format (500kb). I want to pass this data (as argument) to curl command using system function. But getting Too many arguments error due to length of string data(payloadBlock). I... (4 Replies)
Discussion started by: cool.aquarian
4 Replies

4. UNIX for Dummies Questions & Answers

Multiple string input in a awk

Hi everybody, I just start my learning about Linux. So, if you can help me, it would be very good ! I have already find the possibility to find the position of a character regular expression in a line with the help of awk : test.txt is : AAAAAGHIJKLAjKMEFJKLjklABCDJkLEFGHIJKL My script is... (2 Replies)
Discussion started by: thewizarde6
2 Replies

5. Shell Programming and Scripting

sed or awk command to replace a string pattern with another string based on position of this string

here is what i want to achieve... consider a file contains below contents. the file size is large about 60mb cat dump.sql INSERT INTO `table1` (`id`, `action`, `date`, `descrip`, `lastModified`) VALUES (1,'Change','2011-05-05 00:00:00','Account Updated','2012-02-10... (10 Replies)
Discussion started by: vivek d r
10 Replies

6. Shell Programming and Scripting

Variable as input to awk command

Hi Gurus, I need a suggestion, please help. I have a input file as below : abc.txt : * xxxx: 00000 xxxxx: 00000 xxxx: RANDOM xxx: RANDOM **************************xxxxxxx*** * abc ****************************** abc: abc: ... (3 Replies)
Discussion started by: arunshankar.c
3 Replies

7. Shell Programming and Scripting

Awk command without input file

i have a requirement to compare two time stamps in IF condition and return true whenever the second timestamp is greater than first, i will also be checking, if the timestamp in HHMMSS format( 6 digit time stamp ).Im able to achieve it using awk, however i dont want to give any input file to awk... (3 Replies)
Discussion started by: saikiran_1984
3 Replies

8. Shell Programming and Scripting

redirect an awk string output to a script input with pipes

Hi, I have a function in a bash script that returns a string after some operations using awk. The following code returns 555 $VARIABLE="EXAMPLE" get_number $VARIABLE this value I'd like to pass it as a second argument of another script with the following usage myscript.sh <param1>... (7 Replies)
Discussion started by: rid
7 Replies

9. Programming

How i can read a long integer from standar input and a string with as many characters as specified..

how i can read a long integer from standar input and a string with as many characters as specified in the number? i thing that i must use the read command ofcourse.... (6 Replies)
Discussion started by: aintour
6 Replies

10. UNIX for Dummies Questions & Answers

Number of long limit

Hi Hi! I'm currently using AIX 5.2 and would like to know where can i find to see that there's a restriction on the number of login times a user can have. Example, I want give a 2 login per user but some one to give 3 login and some one have to give unlit login time (without logging off the... (2 Replies)
Discussion started by: herath
2 Replies
Login or Register to Ask a Question