1. The problem statement, all variables and given/known data:
Here is my assignment.
Parse the /home/access_log and /home/access_.xz files
Create a sorted list of ip address with no duplicates
Pass each ip address to ipinfo.io with curl
Create a logfile that has the ip address,lat,long
Save the data file and script to the inclass dir
Submit your script to canvas email_first_part_lab8.txt
I am trying to figure out how to create a loop to cat all the access logs then curl all the ips in that log to the site ive been provided and then redirect that ouput to a text file. I am still rather ignorant to shell scripting.
2. The attempts at a solution (include all code and scripts):
Here are my scripts to cat the files
And my sample curl with a single ip
(cant post urls yet)
4. Modesto junior college, Manetca (CA), US, dale Phillips, and CSCI-210 (Link to Course):
Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).
Aren't there any way to download files as below?
For example, I want to download all .html files under the root directory of unix.com/
curl -O https://www.unix.com/*.html
This won't work, but please tell me the way to do this.
Well, the best way is to get the file list of the directory, but i... (6 Replies)
Hi guys ,
need some help
I have to transfer a file from my aix box to another server using ftps protocol, how can i achieve this using curl preferably or any other utility.
Thanks
Sandeep (0 Replies)
I have to transfer a file from my aix box to another server using ftps protocol, how can i achieve this using curl preferably or any other utility.
Regards
Sandeep (0 Replies)
Hello,
I try to take out of the command curl the info of the time...
time curl --write \"Downloaded %{time total}\" -o ......
but having some problem. (1 Reply)
Hi,
Has anyone installed curl on solaris? I tried installing curl-7.19.4 without any effect.
Here's what i have done so far:
Copied the package curl-7.19.4-sol8-sparc-local under a certain dir.
Tried to add the path in PATH variable.
But when I type curl it says bash: curl: command not found.... (2 Replies)
Hello everyone
I'm currently using a script to upload files (different file names, but same date) to an ftp server (see below)
#!/bin/sh
# Set the variables
HOST=<host>
USER=<user>
PASSWD=<password>
ftp -i -n $HOST <<END_SCRIPT
user ${USER} ${PASSWD}
mput... (0 Replies)
Hi all;
first of all i need to clarify that i am new to apache2 server configuration and for some needs i want to transfer some files using curl to web directory,so please bear with me:
following is the command i m running to transfer file to my web directory:
curl -T "q"... (4 Replies)
I am rather new to shell scripting and currently taking a linux course.
Im having some troubles writing a loop to curl multiple ips in mutiple access logs to the site ipinfo.io and push the output to a text file for easy viewing and removing duplicates.
So far i have these simple lines
cat... (1 Reply)
Hi guys!
Kind of new to bash scripting and now I'm stuck.
I need to curl with these variables:
"{ \"nodename\": \"$1\", \"ipaddress\": \"$2\", \"poolname\": \"$3\", \"port\": \"$4\", \"loadbalancer\" : \"$5\" }"
and my input_file.txt contains
server001 10.10.10.01 serverpool1 80... (4 Replies)
Discussion started by: yort
4 Replies
LEARN ABOUT SUSE
uniq
UNIQ(1) User Commands UNIQ(1)NAME
uniq - report or omit repeated lines
SYNOPSIS
uniq [OPTION]... [INPUT [OUTPUT]]
DESCRIPTION
Discard all but one of successive identical lines from INPUT (or standard input), writing to OUTPUT (or standard output).
Mandatory arguments to long options are mandatory for short options too.
-c, --count
prefix lines by the number of occurrences
-d, --repeated
only print duplicate lines
-D, --all-repeated[=delimit-method]
print all duplicate lines delimit-method={none(default),prepend,separate} Delimiting is done with blank lines.
-f, --skip-fields=N
avoid comparing the first N fields
-i, --ignore-case
ignore differences in case when comparing
-s, --skip-chars=N
avoid comparing the first N characters
-u, --unique
only print unique lines
-z, --zero-terminated
end lines with 0 byte, not newline
-w, --check-chars=N
compare no more than N characters in lines
--help display this help and exit
--version
output version information and exit
A field is a run of blanks (usually spaces and/or TABs), then non-blank characters. Fields are skipped before chars.
Note: 'uniq' does not detect repeated lines unless they are adjacent. You may want to sort the input first, or use `sort -u' without
`uniq'.
AUTHOR
Written by Richard M. Stallman and David MacKenzie.
REPORTING BUGS
Report uniq bugs to bug-coreutils@gnu.org
GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
COPYRIGHT
Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
The full documentation for uniq is maintained as a Texinfo manual. If the info and uniq programs are properly installed at your site, the
command
info coreutils 'uniq invocation'
should give you access to the complete manual.
GNU coreutils 7.1 July 2010 UNIQ(1)