Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Completey new to scripting, question/help?
Top Forums Shell Programming and Scripting Completey new to scripting, question/help? Post 302945391 by Don Cragun on Thursday 28th of May 2015 08:06:10 PM
Old 05-28-2015
Quote:
Originally Posted by xdawg
Thanks RudiC, the output was mostly correct, however some lines of output were just blank space after the date (I added the commas so later I can output into csv easily):

Code:
 3, 05-22 ,

Hmm, I'm learning a lot as we go along. I've been breaking down what DonC wrote (RudiC's will be next probably tonight when I get home), and I think I just need to be able to tell it not to output any line that returns a 0 (no match found) when this is run:

Code:
match($0, /"username":"[^"]*"/)

I just haven't figured out how to tell it that, maybe I am thinking about this the wrong way.
You're learning quickly. I also submitted something that did it slightly differently, but RudiC posted his before I posted mine, so I deleted it. I am reposting mine here (with changes for CSV format output without the spaces around the commas) hoping that something in your log data contains the string username but does not match the pattern "username":"user@host" (which the code below would treat differently than RudiC's suggestion does):
Code:
awk '
match($0, /"username":"[^"]*"/) {
	split($3, d, "@")
	user = substr($0, RSTART + 12, RLENGTH - 13)
	c[d[1] "," user]++
}
END {	for(i in c)
		printf("%d,%s\n", c[i], i)
}' logs/mycompany.log | sort -t, -k3,3 -k2,2

This can still produce output like you've shown above, if a log entry contains the literal string "username":"" (and maybe also if the second quoted string contains blanks). So, let us know if the above code still produces unwanted output and we can try to track down the log entries causing the problem and eliminate them from consideration.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

another scripting question

I am writing a script that will identify the oldest file in a directory. Here's the syntax: #!/bin/ksh cd directory chmod 777 * ls -r -1t > file1 sed -n -e "1P" < file1 > file2 So my problem is, now I have file2, which contains the name of the oldest file in the directory. How do I use,... (1 Reply)
Discussion started by: kristy
1 Replies

2. Shell Programming and Scripting

Scripting Question

This script searches for core files and if it finds one, it emails me to let me know.I DONT want it to email me if it doesn't find one but I can't figure out what I need to change or add. Any thoughts? Script below: /bin/find / -name core -type f -ls -exec file {} \;|/usr/bin/mailx -s... (1 Reply)
Discussion started by: damielle
1 Replies

3. Shell Programming and Scripting

another scripting question

Hello I am working on cleaning up permissions on Oracle mountpoints and datafiles in unix. I am looking for a script or a scripting idea to 1st. 1. grep for owner oracle 2. ensure its a directory owned for oracle 3. chmod 750 on the oracle owned directory. 4. grep for oracle files, etc... (3 Replies)
Discussion started by: jigarlakhani
3 Replies

4. Shell Programming and Scripting

scripting question

I'm new to shell scripting and am having a problem trying to do something in C shell. I want to write a script that will input something instead of a user doing it. For example, using the command 'write' the user is supposed to type something to be sent to another user. I want a script to be able... (3 Replies)
Discussion started by: batmike
3 Replies

5. Shell Programming and Scripting

scripting question?

I am writing a backup script for AIX 5 and running into a problem where the output isn't being shown in the output log that is being created. Any ideas on how this would be corrected? I have included the script below. The only thing showing up in the file is listed below. I was hoping to capture... (2 Replies)
Discussion started by: justinburbridge
2 Replies

6. Solaris

Scripting question

I'm writing a small script that will run an executable program (sort of like TOP). To exit the executable, you have to enter control C (^c). I'm trying to use a redirect input file to send the ^c but I'm not having any luck. My short script looks like this - /mydirectory/abc.script < abc.in >... (1 Reply)
Discussion started by: gonzotonka
1 Replies

7. Shell Programming and Scripting

Scripting question

Folks; I'm writing a shell script to extract some fields out of a log file & it will run periodically, how can i make it runs starting from where it left of. for example; if the script will do the extract every 2 days, let's say the first run will extract fields until July 25, 2007 @ 11:15:22... (1 Reply)
Discussion started by: moe2266
1 Replies

8. UNIX for Dummies Questions & Answers

Scripting question

folks; I have a script to remove any files that older than 14 days then move any files that younger than 7 days to another directory. but for some reason it doesn't move the files, when i do it manually it works but not through the script. i tried 2 different ways in writing the move part but it... (6 Replies)
Discussion started by: Katkota
6 Replies

9. Shell Programming and Scripting

Scripting question

Preview of command prompt f ---> to start ferret q----> to stop ferret asp@nex:~$ f NOAA/PMEL TMAP FERRET v6.82 Linux 2.6.18-308.8.2.el5PAE 32-bit - 08/03/12 3-Dec-12 16:44 yes? go my.jnl yes?column=4/skip=1/type=num,text ............filename.txt ---... (4 Replies)
Discussion started by: nex_asp
4 Replies

10. Shell Programming and Scripting

Scripting question

hi all, I am writing a script and beginner in shell scripting. I have tried the below script. could you please check and let me know whether the below scirpt is correct. Unix details : HP Unix Input file. cat input.txt | tail -4 HTS40002.W1978.PROM HTS40003.W1978.PROM... (17 Replies)
Discussion started by: arun888
17 Replies

LEARN ABOUT CENTOS

ftphosts

ftphosts(4)							   File Formats 						       ftphosts(4)

NAME

       ftphosts - FTP Server individual user host access file

SYNOPSIS

       /etc/ftpd/ftphosts

DESCRIPTION

       The ftphosts file is used to allow or deny access to accounts from specified hosts. The following access capabilities are supported:

       allow username addrglob [addrglob...]

	   Only allow users to login as username from host(s) that match addrglob.

       deny username addrglob [addrglob...]

	   Do not allow users to login as username from host(s) that match addrglob.

       A username of * matches all users. A username of anonymous or ftp specifies the anonymous user.

       addrglob  is  a	regular  expression that is matched against hostnames or IP addresses. addrglob may also be in the form address:netmask or
       address/CIDR, or be the name of a file that starts with a slash ('/') and contains additional address  globs.  An  exclamation  mark  (`!')
       placed before the addrglob negates the test.

       The first allow or deny entry in the ftphosts file that matches a username and host is used. If no entry exists for a username, then access
       is allowed. Otherwise, a matching allow entry is required to permit access.

EXAMPLES

       You can use the following ftphosts file to allow anonymous access from any host except those on the class A network 10, with the  exception
       of 10.0.0.* IP addresses, which are allowed access:

       allow   ftp   10.0.0.*
       deny    ftp   10.*.*.*
       allow   ftp   *

       10.0.0.* can be written as 10.0.0.0:255.255.255.0 or 10.0.0.0/24.

FILES

       /etc/ftpd/ftphosts

ATTRIBUTES

       See attributes(5)  for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWftpr			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |External			   |
       +-----------------------------+-----------------------------+

SEE ALSO

	in.ftpd(1M), ftpaccess(4), attributes(5)

SunOS 5.10							    1 May 2003							       ftphosts(4)
All times are GMT -4. The time now is 03:57 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy