Under Consideration: Migrate the Forums to Discourse


 
Thread Tools Search this Thread
The Lounge What is on Your Mind? Under Consideration: Migrate the Forums to Discourse
# 43  
Old 03-11-2020
It's very slow...

Code:
root@localhost-app:/var/www/discourse# rake posts:rebake
Rebaking post markdown for 'default'
     6967 / 1059651 (  0.7%)

No one can speed this up..... I have tried on two servers... including a 16 core 64GB linux server.


It is slow because the app is in Docker... and even though Docker is a lightweight VM... it is SLOW IN THE VM.... lightweight or not.

LOL
# 44  
Old 03-11-2020
Code:
root@localhost-app:/var/www/discourse# rake posts:rebake
Rebaking post markdown for 'default'
    20721 / 1059651 (  2.0%)

15 minutes passed... maybe 13000 or so done...

Code:
1059651 / 14000 = 76 15 minute periods..... = 20 hours.... ?? Ughhh.

Yeah Docker Apps !!! LOL
This User Gave Thanks to Neo For This Post:
# 45  
Old 03-11-2020
Discourse has the slowest back-end of any software I have ever used:

Code:
Rebaking post markdown for 'default'
   153000 / 1059651 ( 14.4%)
   242682 / 1059651 ( 22.9%)
   263850 / 1059651 ( 24.9%)

Now I know why it is so nice in "run time" mode, LOL. It's the slowest backend I have ever worked with in over 40 years in this space.

Of course, all this might be related to the fact that I have to keep redoing the migration because their vbulletin.rb script works poorly on our big vB3 forum, LOL.

This migration is putting me in a foul mood for the first time in years because (1) the migration script is truly buggy, (2) very slow and (3) not supported because it is vB3.

This is not turning out to be a fun experience, at all..... mainly because it is so SOOOOOOOOOOOOOOOOOOOOW.

The UI and forum seem nice for sure. But check out the attitude over there when you report a bug in a script:

vBulletin import_script bug in importing children categories - support - Discourse Meta

I received zero help "useful to our web site" and left with only a headache..... LOL

Now, my motivation of Discourse has gone from 100% "WOW" to 10%... hmmmm.
These 2 Users Gave Thanks to Neo For This Post:
# 46  
Old 03-11-2020
Code:
Rebaking post markdown for 'default'
   153000 / 1059651 ( 14.4%)

   242682 / 1059651 ( 22.9%)
   290000 / 1059651 ( 27.4%)

The raking process has not moved in 10 minutes...... Worse than stuck.. It's dead... LOL
# 47  
Old 03-11-2020
Raking process has totally crashed....

Boy, this is really fun.... LOL


Code:
FAILED
--------------------
Pups::ExecError: su postgres -c 'psql discourse -c "alter schema public owner to discourse;"' failed with return #<Process::Status: pid 80 exit 2>
Location of failure: /pups/lib/pups/exec_command.rb:112:in `spawn'
exec failed with the params "su postgres -c 'psql $db_name -c \"alter schema public owner to $db_user;\"'"
ab7c90203e7e77e4f9d8a1cd79245d144db5608b982822af5bfe9c0a20af2904
** FAILED TO BOOTSTRAP ** please scroll up and look for earlier error messages, there may be more than one.
./discourse-doctor may help diagnose the problem.
root@localhost:/var/discourse#

What a bad day, all around, related to this test migration today!
# 48  
Old 03-11-2020
Never play on a patch day.
Issue is, when you're the one doing the patch.. Smilie
# 49  
Old 03-11-2020
Quote:
Originally Posted by sea
Never play on a patch day.
Issue is, when you're the one doing the patch.. Smilie
LOL.

Yesterday was a migration test disaster.

First of all, the Discourse team seems to attempt to bully me to do an impossible upgrade from vB3 to vB4, an upgrade which does not exist and is not available. LOL.

Then, when I explained that to them, they shut me down, shut down a bug report, and decided to ignore us completely.

It was a very strange day, for sure.

Then, working on trying to fine tune the migration by making manual search and replace changes to the test migration postgres database, raking the db (which means basically cooking a million plus posts from raw format to final format) the postgres db crashed.

The worse part was each search and replace in a docker discourse app took 30 minutes to an hour, and I had to do at around 10 of these search and replace db operations, so that took the whole and and then, afterward, to have the entire discourse rake process crash, well..... it was a very bad day all around.

However, I think I will start from scratch, ground zero today, with test migration 2.

However, this time I will do more intensive modifications to the vbulletin.rb migration script (my original plan) versus manually doing search and replaces in the discourse database (suggested by someone, so I thought I would try it), and start from scratch.

In addition, I will not post any bug reports on the meta discourse site or interact with any "migration experts", as that has not worked out either (trying to be sociable and "collaborative" has not yielded any fruit at all) and just leads to unnecessary social conflicts with "discourse experts", which are totally distracting from the task and have been, at best, unproductive.


Smilie
This User Gave Thanks to Neo For This Post:
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Migrate from FTP to SFTP

Hi,I am using following code for FTP in shell script file and it is working.Now I want to migrate from FTP to SFTP.What code changes/steps I have to perform for SFTP ? ftp -in <<FIN open $SAP_UP_SERVER user $SAP_UP_USER $SAP_UP_PASSWORD asc put... (7 Replies)
Discussion started by: Nitin Varshneya
7 Replies

2. BSD

Migrate a Hard Disk

hi Has anyone already tried to migrate a hard disk with FreeBSD using recoverdisk? (1 Reply)
Discussion started by: ccc
1 Replies

3. Linux

Mysql Migrate

Hi , I would like to (MYSQL) migrate the all the data from solari's to linux box. I have checked whether mysql is installed or not. rpm -qa | grep -i mysql I confirmed !!!! I want to know the following points. 1) How can get to know what are mysql data files and location as well.... (4 Replies)
Discussion started by: Mani_apr08
4 Replies

4. Solaris

Migrate from MPXIO to Powerpath

Here is the issue: I am building a database server using Solaris 10x86 U8. The system is jumpstarted with mpxio enabled and booting from the san. We need to have powerpath 5.3 installed and would like to have powerpath take control of the the boot san as well or have mpxio control the san... (2 Replies)
Discussion started by: nabru72
2 Replies

5. Solaris

Can you migrate UFS to ZFS ?

I have some UFS volumes (non root), that I would like to change into ZFS volumes. Is this possible ? I think the only method is to create a new zfs volume and copy the data accoss, this would take a long time for us. Is there a quicker way ? Regards (5 Replies)
Discussion started by: wjones
5 Replies

6. Solaris

Migrate oracle solaris 5.8 5.9

If I have an oracle 9 database environment on a san running solaris 5.8 as the os. Can I plug the san into a Solaris 5.9 environment and have the database work ? - as long as binaries are on the san (1 Reply)
Discussion started by: tim-carroll@com
1 Replies

7. UNIX for Dummies Questions & Answers

Pipe not taken into consideration

I'm trying to see every file which my group (staff) has in a certain directory, recursively. The pipe ls -l -R | grep staff is not working exactly as I want, as for every directory to which my user does not have access, a line like: ls: ./directory/lost+found: The file access permissions do not... (5 Replies)
Discussion started by: panchopp
5 Replies

8. UNIX for Dummies Questions & Answers

How to migrate ?

Currently, I am planning a migration between machine which under True64UNIX. The new machine will run with higher version O/S. My question is, is there any solution on migrating one machine to another which with different O/S version? My goal is keeping minimum impact to the users. Excuse my... (1 Reply)
Discussion started by: coolmans
1 Replies
Login or Register to Ask a Question