Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk throws makes too many open files
Top Forums Shell Programming and Scripting awk throws makes too many open files Post 302913624 by Krrishv on Tuesday 19th of August 2014 02:18:45 AM
Old 08-19-2014
awk throws makes too many open files
Hi,

I have a below awk script.
Code:
BEGIN {
        FS=",";
}
{

system("curl -v -H \"Authorization: SSWS test"  -H \"Accept: application/json\"  -H \"Content-Type: application/json\"  -X POST \"https://tes.test.com/api/v1/users?activate=false\"  -d  \'{  \"profile\": { \"firstName\": \"" $1 " \",  \"lastName\": \"" $2" \",  \"email\": \"" $3 "\", \"login\": \"" $4 "\" } }\'"| getline response);

  #Printing the create user response
  system("echo " response);

#get the UID from the response for adding to the group
system("echo " response "| cut -d' ' -f1 | cut -d':' -f2" | getline id);


#Add the created user to group from csv file
        system("curl -H \"Authorization: SSWS test" -H \"Accept: application/json\" -H \"Content-Type: application/json\" -X PUT \"https://test.test.com/api/v1/groups/00g2msc01fEYNMEAXNMZ/users/" id "\"");

}

when i execute the command in my mac os
Code:
awk -f Finaluser.awk test1.csv

it creates 8 users fine in the 9th user i get a below error.
Code:
awk: echo {"id":"00u2mut1cf","status":"STAGED","created":"2014-08-19T06:03:52.000Z","activated":null,"statusChanged":null,"lastLogin":null,"lastUpdated":"2014-08-19T06:03:52.000Z","passwordChanged":null,"profile":{"firstName":"Adam ","lastName":"test ","email":"test.adam@2l.test","login":"test.adam@2l.test","mobilePhone":null},"credentials":{"provider":{"type":"TEST","name":"TEST"}},"_links":{"activate":{"href":"https://test.test.com/api/v1/users/00u2mut1cf/lifecycle/activate","method":"POST"},"deactivate":{"href":"https://test.test.com/api/v1/users/00u2mut1cf/lifecycle/deactivate","method":"POST"}}}| cut -d' ' -f1 | cut -d':' -f2 makes too many open files
 input record number 9, file test1.csv

Please throw some light on this.
Last edited by Franklin52; 08-19-2014 at 03:28 AM.. Reason: Please use code tags
 

7 More Discussions You Might Find Interesting

1. Forum Support Area for Unregistered Users & Account Problems

Search throws a wobbly

Dear Administrator, Rule No.5 for unregistered users is impossible to comply with because Google search thinks that any Unix command that I search for is an attack from a virus and blocks the search. I managed to find this site from an external search, and it looks really useful. Do you... (2 Replies)
Discussion started by: Ken N
2 Replies

2. UNIX for Dummies Questions & Answers

scp throws error

My script is like STAMP=$(perl -e '($ss, $mm, $hh, $DD, $MM, $YY) = localtime(time() - 100); printf "%04d%02d%02d%02d%02d", $YY + 1900, $MM + 1, $DD, $hh, $mm') touch $STAMP /sasdata/copydata/ find /sasdata/copydata -type f ! -newer /sasdata/copydata/ -print > output3.txt awk '{print "scp ... (6 Replies)
Discussion started by: tushar_spatil
6 Replies

3. Shell Programming and Scripting

awk script throws invalid char expression

Hello there, I am new to the awk scripting and getting the following error while running the script. Please can you advise me how to resolve this . Thanks ./sub_del_awk_lat.sh awk: cmd. line:5: warning: escape sequence `\/' treated as plain `/' awk: cmd. line:5: sed -n... (6 Replies)
Discussion started by: Sudhakar333
6 Replies

4. Shell Programming and Scripting

Calling shell script within awk script throws error

I am getting the following error while passing parameter to a shell script called within awk script. Any idea what's causing this issue and how to ix it ? Thanks sh: -c: line 0: syntax error near unexpected token `newline' sh: -c: line 0: `./billdatecalc.sh ... (10 Replies)
Discussion started by: Sudhakar333
10 Replies

5. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

6. Shell Programming and Scripting

awk date too many open files

Dear Community; I have a csv file with msb and lsb in $3 and $5 fields which provides the epochtime (factor 65536). Further I need to convert epochtime to readable datetime. But am getting an error. File Sample: 5000a,1000,20671,0,16421,0,1,NULL,0 5000b,1000,20974,0,-16284,0,1,NULL,0... (4 Replies)
Discussion started by: mystition
4 Replies

7. Shell Programming and Scripting

awk (Too many open files)

Hi Team, This is my first post, hope I am doing it right. I have a large file, like 6 GB. Its a proxy file so vendor requested to change username from logs for saving the confidentiality of the user. This is the script I created (With the help of Google): awk '{ tmp="echo " $5 " |... (12 Replies)
Discussion started by: tealc
12 Replies

LEARN ABOUT NETBSD

atf

ATF(7)						       BSD Miscellaneous Information Manual						    ATF(7)

NAME

     ATF -- introduction to the Automated Testing Framework

DESCRIPTION

     IMPORTANT: If you are here because you want to know how to run the tests in /usr/tests, you most likely want to read the tests(7) manual page
     instead.

     The Automated Testing Framework (ATF) is a collection of libraries and utilities designed to ease unattended application testing in the hands
     of developers and end users of a specific piece of software.

     As regards developers, ATF provides the necessary means to easily create test suites composed of multiple test programs, which in turn are a
     collection of test cases.	It also attempts to simplify the debugging of problems when these test cases detect an error by providing as much
     information as possible about the failure.

     As regards users, it simplifies the process of running the test suites and, in special, encourages end users to run them often: they do not
     need to have source trees around nor any other development tools installed to be able to certify that a given piece of software works on
     their machine as advertised.

     If your operating systems distributes ATF, it is possible that it provides an introductory tests(7) manual page.  You are encouraged to read
     it now.

   License
     ATF is distributed under the terms of the TNF License, a 2-clause BSD license.  For more details please see:

	   /usr/share/doc/atf/COPYING

   Components
     ATF is a highly modular piece of software.  It provides a couple of libraries to ease the implementation of test programs: one for the C and
     C++ languages and another one for shell scripts.  It also includes multiple small utilities that follow the principle of doing a single thing
     but doing it right.  This section outlines which these components are.

     Public utilities:

     atf-check(1)	    Executes a command and checks that its exit code, its standard output and its standard error output match pre-speci-
			    fied expected values.

     atf-config(1)	    Queries static configuration information.

     atf-report(1)	    Converts the output of atf-run to user-friendly and/or machine-parseable reports.

     atf-run(1) 	    Automates the execution of a series of test programs and collects their results in a unified report.

     atf-sh(1)		    Shell interpreter for shell-based test programs.

     Programming interfaces:

     atf-c-api(3)	    C programming interface for test programs.

     atf-c++-api(3)	    C++ programming interface for test programs.

     atf-sh-api(3)	    POSIX shell programming interface for test programs.

     Other:

     atf-formats(5)	    Description of the machine-parseable data formats used by the tools.

     atf-test-case(4)	    Generic description of test cases, independent of the language they are implemented in.

     atf-test-program(1)    Common interface provided by the test programs written using the ATF libraries.

   Recommended reading order
     For end users wishing to run tests:
     1.   tests(7) (only if provided by your operating system).
     2.   atf-test-program(1)
     3.   atf-run(1)
     4.   atf-report(1)
     5.   atf-config(1)

     For developers wanting to write their own tests:
     1.   Everything recommended to users.
     2.   atf-test-case(4)
     3.   atf-c-api(3)
     4.   atf-c++-api(3)
     5.   atf-sh-api(3)
     6.   atf-sh(1)
     7.   atf-check(1)

     For those interested in ATF internals:
     1.   Everything recommended to users.
     2.   Everything recommended to developers.
     3.   atf-formats(5)

SEE ALSO

     tests(7)

HISTORY

     ATF started as a Google Summer of Code 2007 project mentored by The NetBSD Foundation.  Its original goal was to provide a testing framework
     for The NetBSD Operating System, but it grew as an independent project because the framework itself did not need to be tied to a specific
     operating system.

     For more details on this subject, please see:

	   /usr/share/doc/atf/NEWS
	   /usr/share/doc/atf/ROADMAP

AUTHORS

     For more details on the people that made ATF possible, please see:

	   /usr/share/doc/atf/AUTHORS

BSD
								  August 28, 2010							       BSD
All times are GMT -4. The time now is 06:31 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy