Sponsored Content
Top Forums Web Development Discrepancies Between Our Mobile Detection Code and Google Analytics Regarding Chinese User Agents Post 303040224 by Neo on Friday 25th of October 2019 06:09:01 AM
Old 10-25-2019
Here is a link to a similar discussion about the same Chinese bots, identified as "mobile devices" by our system which have been hammering the site of late:

Blocking aggressive Chinese crawlers/scrapers/bots - John Large - Technology, Hardware,Web Development, Digital Privacy & Ethics

So far, I am just sending many of these UAs to 403, but may come up with some better idea after more logging and analysis.

I am not keen on "mass blocking" but these bots are really extreme and the IP addresses are changing so much that IP address blocking will not work; so I have to block based on UA.
 

5 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

SED Search and Replace Question for Google Analytics

Well, I'm losing my regex ability in sed! Please help. I need to search for this text in multiple html files in a directory: </body> and add the following lines in front of the text above: <script src="http://www.google-analytics.com/urchin.js" type="text/javascript"> </script> ... (11 Replies)
Discussion started by: Neo
11 Replies

2. Google Chrome OS

Google Chrome Mobile?

I know that Google Chrome came out with the Android under a Unix based system, but did it come out yet for Windows Mobile? I have Windows Mobile 6 on my device. (0 Replies)
Discussion started by: Anna Hussie
0 Replies

3. Shell Programming and Scripting

User Agents Identifier

Hi, Can anyone help me write a script tp determine the web browser from a user agent. A user agent is stored in a file and consists of hundreds of lines e.g. 37050 Mozilla/5.0 (Windows NT 6.1; WOW64; Trident/7.0; rv:11.0) like Gecko 29404 Mozilla/5.0 (Windows NT 6.3; WOW64)... (4 Replies)
Discussion started by: cyberfrog
4 Replies

4. Web Development

Quick Fix for Google Search Console "Page is not mobile friendly"

Over the past 10 plus years, we have countless posts where the user did not use CODE tags or they used ICODE tags incorrectly. This has has the results of this site penalized by Google for having pages which are "not mobile friendly". So, working quietly in the background, in the thankless... (0 Replies)
Discussion started by: Neo
0 Replies

5. What is on Your Mind?

Google Search Console - Mobile Usability - No Errors or Issues - New Milestone

For the first time in the history of the site Google Search Console (GSC) has unix.com showing "no mobile viewability errors". This is no small achievement considering the hundreds of thousand of lines of legacy code we run at a site which has been around much longer than Facebook or LinkedIn: ... (0 Replies)
Discussion started by: Neo
0 Replies
POE::Component::IRC::Projects(3pm)			User Contributed Perl Documentation			POE::Component::IRC::Projects(3pm)

NAME
POE::Component::IRC::Projects - A listing of projects that use POE::Component::IRC SYNOPSIS
perldoc POE::Component::IRC::Projects DESCRIPTION
POE::Component::IRC::Projects strives to document projects that are using POE::Component::IRC>. Projects can include subclasses, bot frameworks, bots, etc. The only stipulation for inclusion is that the project utilises POE::Component::IRC>. Inclusion to ( or inversely, exclusion from ) this list does not imply any sort of endorsement ( or disapproval ) of the said project. BOT FRAMEWORKS ( CPAN ) An alphabetically ordered list of bot frameworks, that are available on CPAN. Amethyst Amethyst is a bot core capable of handling parsing and routing of messages between connections and brains. Amethyst can handle an arbitrary number of connections of arbitrary types (given an appropriate module in Amethyst::Connection::*), routing these messages fairly arbitrarily through multiple processing cores (brains, live in Amethyst::Brain::*), and responding to these messages on other arbitrary connections. Bot::BasicBot Basic bot system designed to make it easy to do simple bots, optionally forking longer processes (like searches) concurrently in the background. Bot::Pluggable This is a very small (but important) part of a pluggable IRC bot framework. It provides the developer with a simply framework for writing Bot components as Perl modules. Bot::Infobot Bot::BasicBot::Pluggable based replacement for the venerable infobot. IRC::Bot A complete bot, similar to eggdrop using POE::Component::IRC. Allows access to all channel user management modes. Provides !seen functions, a complete help system, logging, dcc chat interface, and it runs as a daemon process. IRC::Bot utilizes Cache::FileCache for seen functions, and for session handling. ThreatNet::Bot::AmmoBot ThreatNet::Bot::AmmoBot is the basic foot soldier of the ThreatNet bot ecosystem, fetching ammunition and bringing it to the channel. It connects to a single ThreatNet channel, and then tails one or more files scanning for threat messages while following the basic channel rules. EXTENSIONS ( CPAN ) POE::Component::IRC::Plugin::RSS::Headlines A POE::Component::IRC plugin that provides RSS headline retrieval. POE::Component::IRC::Plugin::URI::Find A POE::Component::IRC plugin that finds URIs in channel traffic. POE::Component::IRC::Plugin::POE::Knee A POE::Component::IRC plugin that runs Acme::POE::Knee races. POE::Component::IRC::Plugin::Blowfish A POE::Component::IRC plugin that provides blowfish encryption. POE::Component::IRC::Plugin::YouTube::MovieFindStore A plugin for finding, resolving .FLV, and optionally storing YouTube URIs. POE::Component::IRC::Object A slightly simpler OO interface to PoCoIRC POE::Component::IRC::Onjoin This module implements a class that provides moved message and onjoin services as an IRC bot. Based on the configuration parameters passed to it via its constructor it will connect to a channel on a server and immediately send everyone on that channel a message privately. It will also send the same message to the channel itself publically at the specified interval. All users joining the channel thereafter will also receive the message. PROXIES
/ BOUNCERS ( CPAN ) App::Bondage A featureful easy-to-use IRC bouncer. perl v5.14.2 2011-12-07 POE::Component::IRC::Projects(3pm)
All times are GMT -4. The time now is 11:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy