Purge of Inactive Users with Zero Posts and Other Anti-spam Measures


 
Thread Tools Search this Thread
The Lounge What is on Your Mind? Purge of Inactive Users with Zero Posts and Other Anti-spam Measures
# 1  
Old 09-19-2018
Purge of Inactive Users with Zero Posts and Other Anti-spam Measures

In order to keep the site "clean, safe and warm", I have recently purged all accounts at UNIX.COM which meet the ALL of the following 3 criteria:
  • No user activity in 2018
  • No posts (zero post count)
  • Link in user profile.

In addition, I purged all users who registered but never confirmed their email address.

Also, instead of relying on flawed or inaccurate anti-spam databases or spam classifiers, I am manually inspecting new users in our database and we will actively delete users who are obviously registering on the site only to spam and/or post links to spammy sites.

The reason for this change is that anti-spam databases and anti-spam classifiers sometime block legitimate new users. We do not want any legitimate user with a UNIX/Linux problem (and an emergency need to be solve or helped) to be blocked. "AI' methods (Bayesian classifiers, ANN (artificial neural networks), etc ) are not really 100% reliable for blocking users and spam, and I don't want UNIX.COM to be dominated by "Bad AI" or "AI Gone Mad", so we are going to manage this directly in our database and will delete all new registered users who are obviously spammers.

UNIX.COM is fighting back against "bad AI' and so we will use humans, not machines, to manage user registration and spam until further notice.

Thank you as always for being a UNIX.COM team member.

Resist Bad AI (RBAI)
This User Gave Thanks to Neo For This Post:
# 2  
Old 09-19-2018
Also, just removed "homepage" urls from all users with zero posts who have not been active on the site since 1 March 2018:

Code:
mysql> update user set homepage=''  where homepage!='' and posts=0 and lastactivity < 1519862400;
Query OK, 68 rows affected (0.22 sec)
Rows matched: 68  Changed: 68  Warnings: 0

# 3  
Old 09-19-2018
And on top of that, just deleted all "homepage" links from profile pages of member who have not been active on the site since 1 Sept 2017 (over a year ago) regardless of the number of posts they had:

Code:
mysql> update user set homepage=''  where homepage!=''  and lastactivity < 1504224000;
Query OK, 6337 rows affected (0.24 sec)
Rows matched: 6337  Changed: 6337  Warnings: 0

# 4  
Old 09-19-2018
And just deleted any "homepage" links from all users with zero posts who have not been active since 1 September 2018:

Code:
mysql> update user set homepage=''  where homepage!='' and posts=0 and lastactivity < 1535760000;
Query OK, 153 rows affected (0.21 sec)
Rows matched: 153  Changed: 153  Warnings: 0

So, that should get rid of most of the prior "register and just add a link" spammers.
# 5  
Old 09-19-2018
Haha.

Was going to run this query, but decided not to:

Code:
delete user where posts=0 and post_thanks_thanked_posts < 1 and post_thanks_thanked_times < 1 and lastactivity < 1420070400;

Delete all users who have no posts, never thanked anyone, never received any thanks, and have not been active since 1 Jan 2016.

But that's a big number (67652).

I'll stop and not delete these inactive, thankless, and none contributing 67652 users yet.

Maybe I'll refine the query by country or email address in the future.

Smilie
# 6  
Old 09-19-2018
Would it make sense to check usernames for patterns (like the recent "125" suffix) before updating / deleting?
# 7  
Old 09-19-2018
Quote:
Originally Posted by RudiC
Would it make sense to check usernames for patterns (like the recent "125" suffix) before updating / deleting?
If you want to write many pattern matching SQL queries like that, "please go for it" ...

Most the "recent spammers" have already been purged based on other criteria.

Feel free to suggest any MySQL query you like.

Normally these queries should be "in pairs". One MySQL "select" query to test; and then a delete or update query to "do the deed".

I cannot emphasis this enough, and keep (unsuccessfully) encouraging the technical team here at UNIX.COM (who are all very capable and highly technical) to communicate ideas in the actual code (MySQL query for DB suggestions, CSS/HTML/jQuery/Javascript for web site suggestions, etc.)

Thanks
Login or Register to Ask a Question

Previous Thread | Next Thread

4 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Deleting Inactive Solaris users

Hello, I want to do a search for users on my solaris boxes that have been inactive for a defined number of days and then delete them. Any ideas how to determine or calculate the number of days (possibly using the /var/adm/wtmpx file) from the user's last login to the current date of search. ... (0 Replies)
Discussion started by: prince2010
0 Replies

2. Solaris

List all inactive users who has not logged on since last 90 days

I need actuall script which List all inactive users who has not logged on since last 90 days Thanks in advance. Di! (17 Replies)
Discussion started by: haridham
17 Replies

3. UNIX for Dummies Questions & Answers

List all inactive users who has not logged on since last 90 days

Hi, Can I get a script to list out all the users, who has not logged on since last 90 days. Last command in not working due due to /var/adm/wtmpx is more than 2 GB. Thanks in advance. Regards, Roni (10 Replies)
Discussion started by: manasranjanpand
10 Replies

4. UNIX for Dummies Questions & Answers

How to logout inactive users????

I would like to automatically logout from the system inactive users depending on their functions. For example there are users that I would like to logout after 15 minutes of inactivity, but there are others that I would like to logout after 30 minutes of inactivity. It's possible to do this??? (6 Replies)
Discussion started by: rrivas
6 Replies
Login or Register to Ask a Question