302 Redirects Issues Effected Google Search Console (GSC) Fixed - DBSEO Goto Rewrite Problems Solved


 
Thread Tools Search this Thread
Top Forums Web Development 302 Redirects Issues Effected Google Search Console (GSC) Fixed - DBSEO Goto Rewrite Problems Solved
# 1  
Old 11-09-2019
302 Redirects Issues Effected Google Search Console (GSC) Fixed - DBSEO Goto Rewrite Problems Solved

Finally!

Yesterday I FINALLY figured out why Google Search Console (GSE) was showing so many pages with 302 redirects in our link budget. For over a year, I thought this issue was relate to either Apache2 or DBSEO (our PHP module which rewrites our links to be SEO friendly). However, when I breached this subject with the developer of DBSEO, he chastised me repeatedly and told me that it is not possible that DBSEO was causing these redirects, so loathed by Google. If fact, the DBSEO coder basically implied I (their paid and licensed customer) was an idiot for even thinking it might be DBSEO causing the problem. So, even with my "amazing" debugging skills, this problem remained unsolved for a long time.

So, yesterday, caught up on a few forum coding tasks, I decided to dive into this problem again. Frustrated after searching the entire Apache2 configuration and looking at the DBSEO PHP code base again for the culprit of this 302 redirect bug filling up our link budget with Google, I asked Akshay Hedge to help me troubleshoot, messaging over Whats App. Akshay , bringing an outsider view into this, followed the same steps that I would have (and had been doing). We searched the Apache2 configuration deeply looking for redirect directives. We found none. We search the core PHP files for the same redirect-related directives and keywords. We found nothing. Both Akshay and I, looking at the sample links in GSE, got the same 302 redirects which Google complains about.

Then, having exhausted all possibilities in the realm of this quantum reality we are in, I did what I should have done a year ago and found the core of the problem. I took the link in GSE causing the 302 and compared it to the link after the 302. This seems obvious now and was the most basic thing I should have done first, not last. However, having Akshay on Whats App confirming that there was no Apache2 or PHP error outside of DBSEO, helped "free my mind" from the fact that the DBSEO developers had insulted me repeatedly and when I pointed the finger at their DBSEO code, I found that DBSEO was the problem by simply comparing the links.

The forum software here (a legacy vB PHP system which has been seriously modified over the years and does not really resemble vB anymore) has a "convenience" URL parameter called "goto". This URL parameter is used to direct users to new posts and looks like this, for example:

Code:
https://www.unix.com/your-favorite-discussion.html?goto=newpost.

DBSEO rewrites this URL with URL parameter as:

Code:
https://www.unix.com/your-favorite-discussion-new-post.html

and when this link is indexed by Google, it (as it should) classifies this link with "new-post" embedded in the URL as a 302 redirect.

If I just remove this feature, users will complain that the URLs do not take them to new posts (and some will complain strongly), so I basically rewrote DBSEO to stop rewriting all possible "goto" URL parameters for unregistered (guest, bots, etc.) users.

Problem solved.

I don't think I would have seen this obvious DBSEO URL rewriting issue if it was not for Akshay working with me on Whats App. Akshay helped me confirm that DBSEO was the root cause, despite the strong objections and insulting innuendo when I breeched this issue with DBSEO in 2018 and again in 2019.

Thank you Akshay for spending a few hours with me on Whats App and helping me confirm the obvious now, that DBSEO was the root cause of this 302 issue. Of course, finding the root cause of a problem is the hard part, and I wrote some new code shortly after to fix this problem, forever.

This problem is solved, finally. I am very happy to have this nagging problem "figured out". I am not accustomed to having technical or coding issues been so difficult to debug, but DBSEO was adamant that their software was not the core problem, when if fact, it turns out that 100%, it was the core problem.

DBSEO, rewriting the "goto" URL parameter was the root cause, and I have disabled that (for unregistered users, bots, etc. ... not registered member logged in) with some custom PHP code. I cannot force Google to drop those "excluded 302 links" from their index (there are over 500,000 of them) which is hurting our link budget with Google (and I do not want to force a 301 or 404), but at least the problem will stop getting worse and that is the first step down this road to recover from the damage to our Google search link budget caused by DBSEO.

Reference: GSE "Excluded"
Image
These 4 Users Gave Thanks to Neo For This Post:
# 2  
Old 11-09-2019
I am happy to be part of forums and your leadership team, finally it's solved, once bots reindex sitemap everything should be fine.
These 3 Users Gave Thanks to Akshay Hegde For This Post:
# 3  
Old 11-09-2019
Quote:
Originally Posted by Akshay Hegde
I am happy to be part of forums and your leadership team, finally it's solved, once bots reindex sitemap everything should be fine.
Yes, this problem was more of an "annoyance" that a site-crippling problem.

However, I also would like to note that, you have shown great technical leadership skills at unix.com, as follows:
  • You never complain about any issue at unix.com; and you only offer technical solutions to issues you encounter. This is a hallmark of both excellent leadership and technical skills.
  • You understand web operations well and have a fundamental understanding of how to troubleshoot a complex web-ops issue in a logical, step-by-step manner. This is a trait of someone who understands the technology well and knows how to troubleshoot a "tricky" problem.
  • You always make yourself available to help out unix.com in the rare instances I reach out to you for assistance.
  • You "walk the talk" and do not "talk the walk", as the old staying goes. This is a core trait considered to be a "key leadership skill" by top leaders across all organizations.

Thank you again Akshay.

PS: Just awarded you your "the next level up" "Blue Dev Ops" Badge. Well deserved.

Image
These 2 Users Gave Thanks to Neo For This Post:
# 4  
Old 11-10-2019
This is huge, congrats, great effort guys...
These 2 Users Gave Thanks to Scrutinizer For This Post:
# 5  
Old 12-01-2019
Looks like the site has the following current search position for the "unix" keywords:
  • Google (US): Either #8 or #9 (page 1) and moving up, it seems.
  • Bing: #1 (95+ percent of the time)
  • DuckDuckGo: Either #1 or #2.
# 6  
Old 12-05-2019
Update:

Looks like the site continues to move up in SERP results with Google, staying around the same with Bing and currently down a bit with DuckDuck has the following current search position for the "unix" keywords:
  • Google (US): Between #7 and #9 (page 1) still moving up on page 1.
  • Bing (US): #1 - #2 (competing with Wikipedia for the #1 slot, alternating between 1 and 2.)
  • DuckDuckGo (US): Around #4 (has dropped a bit from before).

Traffic from search referrals continues to rise (not taking into consideration the US Thanksgiving holiday, of course).
This User Gave Thanks to Neo For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

7 More Discussions You Might Find Interesting

1. What is on Your Mind?

YouTube: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search

Getting a bit more comfortable making quick YT videos in 4K, here is: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search Console https://youtu.be/I6b9T2qcqFo (0 Replies)
Discussion started by: Neo
0 Replies

2. What is on Your Mind?

Google Search Console - Mobile Usability - No Errors or Issues - New Milestone

For the first time in the history of the site Google Search Console (GSC) has unix.com showing "no mobile viewability errors". This is no small achievement considering the hundreds of thousand of lines of legacy code we run at a site which has been around much longer than Facebook or LinkedIn: ... (0 Replies)
Discussion started by: Neo
0 Replies

3. Web Development

Quick Fix for Google Search Console "Page is not mobile friendly"

Over the past 10 plus years, we have countless posts where the user did not use CODE tags or they used ICODE tags incorrectly. This has has the results of this site penalized by Google for having pages which are "not mobile friendly". So, working quietly in the background, in the thankless... (0 Replies)
Discussion started by: Neo
0 Replies

4. What is on Your Mind?

Google Site Search in Search Drop Down Menu (Again)

Have just added (after missing for some time), the latest version of Google Site Search for our site in the Navbar Search Menu: https://www.unix.com/members/1-albums215-picture791.png Cheers and Enjoy. Here is the URL for that link in case you need it: https://goo.gl/P8p82c (4 Replies)
Discussion started by: Neo
4 Replies

5. UNIX for Advanced & Expert Users

[SOLVED] htaccess rewrite rule help!

hi there, I need that when user input mysite.com/ponuka/AAA2869 it shows mysite.com/ukaz.php?ponuka=AAA2869 because of facebook likes, and I found out that this is set up as rewrite rule in .htaccess file? how to achieve it? thank you... :confused: ---------- Post updated at 04:47... (0 Replies)
Discussion started by: vogueestylee
0 Replies

6. Shell Programming and Scripting

fixed length text file padding issues in AIX

Hi, I have a fixed length text file that needs to be cut into individual files in aix and facing padding issues. If I have multiple blank spaces in the file it is just making it one while cutting the files.. Eg:- $ - blank space filename:file.txt ... (2 Replies)
Discussion started by: techmoris
2 Replies

7. Shell Programming and Scripting

search and goto next line then take the output

Hi All, I have a file in which the contents are as shown below: Number of Dynamic Addresses Allocated : 107790 Addresses: 10.3.29.202,10.47.1.145,10.2.4.98,190.1.89.95,.. (many ip addresses separated by comma) ----... (3 Replies)
Discussion started by: imas
3 Replies
Login or Register to Ask a Question