Visit Our UNIX and Linux User Community


VBulletin 3.8 to Discourse on Docker Migration Test Take Two


 
Thread Tools Search this Thread
The Lounge What is on Your Mind? VBulletin 3.8 to Discourse on Docker Migration Test Take Two
# 1  
Old 03-12-2020
VBulletin 3.8 to Discourse on Docker Migration Test Take Two

OK.

Like we all do, we learn a lot from tests, test migrations, and so forth.

Today, I started from scratch on test migration 2, armed with a lot more knowledge,

The main differences are as follows:
  • Installed discourse plugin ruby-bbcode-to-md before starting the install
  • Modified vbulletin.rb to account for many (not all) of our custom bbcode, like our icode and. mods tags
  • Modified vbulletin.rb to compensate for the fact that vb3 does not have a filedata table (like vb4)
  • Modified vbulletin.rb to compensate for an error in converting child forums to categories in discourse.
  • Moved all avatars to the vb3 database from the file system before dumping the DB.

Running again, from scratch, vbulletin_neo.rb:

Code:
root@localhost-app:/var/www/discourse# su discourse -c 'bundle exec ruby script/import_scripts/vbulletin_neo.rb'
root:@localhost wants vb3
Loading existing groups...
Loading existing users...
Loading existing categories...
Loading existing posts...
Loading existing topics...

importing groups..
       20 / 20 (100.0%)  [1542 items/min]  ]  
importing users
      860 / 138144 (  0.6%)  [123 items/min]  in]

Let's see how this goes.... Smilie

PS: As a side note, when migrating like this, do not use the same username for your Discourse admin account as your legacy forum username (the forum you are migrating from) because if you do, there will be an issue importing your posts under your legacy forum username into discourse. In this "round two", I did not make that mistake Smilie
# 2  
Old 03-12-2020
Anyway.... thing are chugging along again in "round two", from all the lessons learned from "round one".......

Code:
root@localhost-app:/var/www/discourse# su discourse -c 'bundle exec ruby script/import_scripts/vbulletin_neo.rb'
root:@localhost wants vb3
Loading existing groups...
Loading existing users...
Loading existing categories...
Loading existing posts...
Loading existing topics...

importing groups..
       20 / 20 (100.0%)  [1542 items/min]  ]  
importing users
     3745 / 138144 (  2.7%)  [117 items/min]  in]

I will be surprised (pleasantly surprised) if this goes without flaws on "round two"....

Let's see how this go-around goes... Smilie
# 3  
Old 03-12-2020
Estimated time to import / migration only the users again: 18 to 19 hours.


Code:
importing users
     8320 / 138144 (  6.0%)  [117 items/min]  in]  
     8431 / 138144 (  6.1%)  [117 items/min]

I'm so glad I purged "inactive users with zero posts and zero likes" a year or so ago now Smilie
# 4  
Old 03-12-2020
Note:

Code:
importing users
    42897 / 138144 ( 31.1%)

# 5  
Old 03-12-2020
Update:

It quit due to a broken ssh connect over the net, so I installed tmux and restarted in a tmux session.

Still chugging along:

Code:
importing users
    54764 / 138144 ( 39.6%)

However, when I check in the admin control panel, the ruby-bbcode-to-md plugin does not appear.

I check the discourse ./plugins directory and ruby-bbcode-to-md is there and there are no errors when I rebuilt the discourse with ./launcher rebuild app

So, I'm a bit worried the ruby-bbcode-to-md plugin is not really installed properly Smilie

Not a good feeling about this plugin since it shows it installed in the plugin directory and there were on install errors in the log:

VBulletin 3.8 to Discourse on Docker Migration Test Take Two-screen-shot-2020-03-12-51938-pmjpg
# 6  
Old 03-12-2020
Also, oddly, I got this error on users migration a number of times:


Code:
  50287 / 138144 ( 36.4%)  [997 items/min]  Failed to create user id: 899992147, username: username1, email: blablah@mailinator.com                                                 
user errors: ["Primary email is not allowed from that email provider. Please use another email address."]

So, I stopped the process and ran this mysql command against the vb3 dump:

Code:
update user set email = replace(email,'mailinator','mailgator') where email like '%mailinator%';

and restarted the migration and those errors went away... LOL

I cannot see any reason for this "email blocking" in the admin settings... which worries me a bit, hidden "rules" and "blocks" and "suspects" which are not identifiable in the admin settings :yikes:
# 7  
Old 03-12-2020
Nine hours after starting this, the user migration is a bit over halfway done:

Code:
importing users
  80286 / 138144 ( 58.1%)

But this will not be the last test run, because I am fairly certain the bbcode to markdown plugin is not working as it should.

Let's see when it is all "baked" again..... what happened.

Previous Thread | Next Thread
Test Your Knowledge in Computers #33
Difficulty: Easy
In HTTPS, the letter 'S' stands for 'safe'.
True or False?

7 More Discussions You Might Find Interesting

1. What is on Your Mind?

Under Consideration: Migrate the Forums to Discourse

Dear All, After being active on the Node-RED forum for the last few weeks, I have been very impressed with Discourse, and my eyes have been opened. https://www.discourse.org/ but not the paid /hosted offering, but using the open distribution: https://github.com/discourse/discourse ... (52 Replies)
Discussion started by: Neo
52 Replies

2. Docker

Docker learning Phase-I

Hello All, I had recently learnt a bit of Docker(which provides containerization process). Here are some of my learning points from it. Let us start first with very basic question: What is Docker: Docker is a platform for sysadmins and developers to DEPLOY, DEVELOP and RUN applications ... (7 Replies)
Discussion started by: RavinderSingh13
7 Replies

3. UNIX for Beginners Questions & Answers

Can't pass a variable representing the output of lsb_release to a docker dontainer

I don't know why, but the rendering of my code mucks up the spacing and indentation, despite being correct in the original file. I'm having issues getting the following script to run (specifically the nested script at the end of the docker command near the end of the script; I think I'm not passing... (2 Replies)
Discussion started by: James Ray
2 Replies

4. Shell Programming and Scripting

Problem in extracting yocto SDK for docker

Actually I was facing the following issue while building my Yocto SDK on Docker container sudo docker build --tag="akash/eclipse-che:6.5.0-1" --tag="akash/eclipse-che:latest" /home/akash/dockerimage.yocto.support/ Sending build context to Docker daemon 26.93MB Step 1/5 : FROM eclipse/cpp_gcc ... (3 Replies)
Discussion started by: Akash BHardwaj
3 Replies

5. AIX

AIX - FC Switch migration, SAN Migration question!

I'm New to AIX / VIOS We're doing a FC switch cutover on an ibm device, connected via SAN. How do I tell if one path to my remote disk is lost? (aix lvm) How do I tell when my link is down on my HBA port? Appreciate your help, very much! (4 Replies)
Discussion started by: BG_JrAdmin
4 Replies

6. Linux

Docker and pipework,ip with other subnet

Recently i found this for give to docker a "personal" ip ip addr del 10.1.1.133/24 dev eth0 ip link add link eth0 dev eth0m type macvlan mode bridge ip link set eth0m up ip addr add 10.1.1.133/24 dev eth0m route add default gw 10.1.1.1On container i did ... (0 Replies)
Discussion started by: Linusolaradm1
0 Replies

7. Web Development

Removing VBSEO for vbulletin Reverting back to vbulletin URLs

Please note, this information was copied from vbseo.com, now showing a database error. This is posted for reference since vbSEO seems to be going out of business: If you ever need to uninstall vBSEO , you can use the following instructions. Make sure you carefully follow each step. Login... (37 Replies)
Discussion started by: Neo
37 Replies

Featured Tech Videos