VBulletin 3.8 to Discourse on Docker Migration Test Take Two


 
Thread Tools Search this Thread
The Lounge What is on Your Mind? VBulletin 3.8 to Discourse on Docker Migration Test Take Two
# 8  
Old 03-12-2020
Those mail issues should have arised when registering a user, not during a migration..
Smells like bad cooking.

Oh, so just 18 hours of user migration alone?
Geez, that sounds like alot of data, meanwhile, it shows 'just 138k' , so that's like...
9 user per hour...
Sounds utterly slow...

If it is just the user data (not including posts) that is.
This User Gave Thanks to sea For This Post:
# 9  
Old 03-12-2020
Code:
importing users
 
   119457 / 138144 ( 86.5%)  [347 items/min]

# 10  
Old 03-12-2020
Still chugg'n along:

Code:
import topics
164667 / 240510 ( 68.5%)

My modification from vbulletin.rb to vbulletin_neo.rb has worked so far and fixed the importing of forums to categories was done correctly this round.... now all forums have been converted to categories.

Still need some tweaking, but making progress...
This User Gave Thanks to Neo For This Post:
# 11  
Old 03-13-2020
Discourse seems to "reject" some user ids based on email address, but it's not clear how to adjust this.

Code:
import topics (final this run)
   236002 / 240510 ( 98.1%)

Now working on:

Code:
importing posts...
    31136 / 651550 (  4.8%)

# 12  
Old 03-13-2020
Ran this against main forum database because of problem porting:

Code:
mysql> update user set email = replace(email,'mailinator','123456789ABCDE') where email like '%mailinator%';
Query OK, 115 rows affected (0.24 sec)
Rows matched: 115  Changed: 115  Warnings: 0

This does not seem to effect one active member only. For that member, please contact me with your new email address::

Code:
mysql> select username, lastactivity, FROM_UNIXTIME(lastactivity) as time, posts  from user where email like '%123456789ABCDE%' order by lastactivity desc;
+-----------------+--------------+---------------------+-------+
| username        | lastactivity | time                | posts |
+-----------------+--------------+---------------------+-------+
| foad            |   1578625700 | 2020-01-09 21:08:20 |    10 |
| Tibetano        |   1557180162 | 2019-05-06 17:02:42 |     0 |
| jenny-hud       |   1556347768 | 2019-04-27 01:49:28 |     0 |
| foobar1234      |   1550774615 | 2019-02-21 12:43:35 |     0 |
| dukiteh125      |   1511264391 | 2017-11-21 05:39:51 |     0 |
| Gregorylek      |   1487379968 | 2017-02-17 19:06:08 |     0 |
| supaflygy       |   1468750696 | 2016-07-17 05:18:16 |     1 |
| AngelikaSh      |   1448173168 | 2015-11-22 00:19:28 |     0 |
| threesixtyfive  |   1441735701 | 2015-09-08 13:08:21 |     2 |
| palmfrond       |   1437107050 | 2015-07-16 23:24:10 |     2 |
| mail1234        |   1433129936 | 2015-05-31 22:38:56 |     1 |
| coolkid         |   1417703668 | 2014-12-04 08:34:28 |    84 |
| jablonski12356  |   1416450564 | 2014-11-19 20:29:24 |     0 |
| ekbaazigar      |   1409003803 | 2014-08-25 16:56:43 |     4 |
| xuro            |   1406927712 | 2014-08-01 16:15:12 |     3 |
| huli_ka         |   1406289056 | 2014-07-25 06:50:56 |     0 |
| DoohanMcGirk    |   1402612539 | 2014-06-12 17:35:39 |     4 |
| ijustneeda      |   1398598080 | 2014-04-27 06:28:00 |    14 |
| CharlieRi       |   1393798942 | 2014-03-02 16:22:22 |     0 |
| catweasel@      |   1387983215 | 2013-12-25 08:53:35 |     0 |
| apackofwankers  |   1386514440 | 2013-12-08 08:54:00 |     0 |
| HarryFish       |   1384424680 | 2013-11-14 04:24:40 |     0 |
| unknownn        |   1374375480 | 2013-07-20 21:58:00 |     3 |
| cseng214        |   1373634453 | 2013-07-12 08:07:33 |     0 |
| snobbycharlton  |   1371472564 | 2013-06-17 07:36:04 |     0 |
| JennaH83        |   1370994551 | 2013-06-11 18:49:11 |     0 |
| DorieUmq        |   1370043948 | 2013-05-31 18:45:48 |     0 |
| LidiaRous       |   1368860327 | 2013-05-18 01:58:47 |     0 |
| CarriUQO        |   1368625281 | 2013-05-15 08:41:21 |     0 |
| HaleyMerr       |   1367576269 | 2013-05-03 05:17:49 |     0 |
| GwenHuggi       |   1367504147 | 2013-05-02 09:15:47 |     0 |
| TomFord1        |   1365528707 | 2013-04-09 12:31:47 |     3 |
| pericopericone  |   1361488097 | 2013-02-21 17:08:17 |     1 |
| oartns          |   1360192834 | 2013-02-06 17:20:34 |     0 |
| MasonJ          |   1360034451 | 2013-02-04 21:20:51 |     2 |
| jagoodwi        |   1359573506 | 2013-01-30 13:18:26 |     0 |
| joenewbie       |   1351617861 | 2012-10-30 12:24:21 |     0 |
| AcidTripz       |   1348337167 | 2012-09-22 13:06:07 |     0 |
| majortomtom     |   1342089610 | 2012-07-12 05:40:10 |     0 |
| koteshwor       |   1341644871 | 2012-07-07 02:07:51 |     0 |
| Tyler Aaron     |   1339530733 | 2012-06-12 14:52:13 |     2 |
| meightr         |   1336902792 | 2012-05-13 04:53:12 |     2 |
| richard78       |   1333452930 | 2012-04-03 06:35:30 |     1 |
| elohssa         |   1330044204 | 2012-02-23 18:43:24 |     3 |
| roby2411        |   1329986033 | 2012-02-23 02:33:53 |    12 |
| bobanite        |   1328802487 | 2012-02-09 09:48:07 |     0 |
| nugmebot        |   1326735854 | 2012-01-16 11:44:14 |     0 |
| chipinmybrain   |   1326602936 | 2012-01-14 22:48:56 |     1 |
| kgtsch          |   1326220373 | 2012-01-10 12:32:53 |     0 |
| justgoogleit    |   1325915800 | 2012-01-06 23:56:40 |     1 |
| chrisperry      |   1325549419 | 2012-01-02 18:10:19 |     8 |
| cdwdc           |   1322450384 | 2011-11-27 21:19:44 |     0 |
| gerdl           |   1317982481 | 2011-10-07 05:14:41 |     0 |
| jstilby         |   1315981589 | 2011-09-14 01:26:29 |     2 |
| hunterm         |   1311067040 | 2011-07-19 04:17:20 |     0 |
| TomTest         |   1309281462 | 2011-06-28 12:17:42 |     0 |
| nena_redbalon   |   1308934248 | 2011-06-24 11:50:48 |     2 |
| ThePistonDoctor |   1308672390 | 2011-06-21 11:06:30 |     6 |
| meuser          |   1308069000 | 2011-06-14 11:30:00 |     5 |
| blahblah123     |   1300283349 | 2011-03-16 08:49:09 |     0 |
| asdasdasdasdada |   1298756171 | 2011-02-26 15:36:11 |     0 |
| _light_         |   1296569679 | 2011-02-01 08:14:39 |     3 |
| maria_florencia |   1295530010 | 2011-01-20 07:26:50 |     1 |
| </kida>   |   1295299434 | 2011-01-17 15:23:54 |     4 |
| linber2880      |   1293468261 | 2010-12-27 10:44:21 |     3 |
| TroubleNow345   |   1293388140 | 2010-12-26 12:29:00 |     2 |
| datinskys       |   1293096529 | 2010-12-23 03:28:49 |     0 |
| sylar           |   1292717118 | 2010-12-18 18:05:18 |     1 |
| xen0n           |   1286993566 | 2010-10-13 13:12:46 |     0 |
| cprogdude       |   1286844464 | 2010-10-11 19:47:44 |     3 |
| pattu           |   1285287958 | 2010-09-23 19:25:58 |     3 |
| scriptfriend    |   1285283121 | 2010-09-23 18:05:21 |     3 |
| andra           |   1281085682 | 2010-08-06 04:08:02 |     0 |
| grandguest      |   1279554122 | 2010-07-19 10:42:02 |     4 |
| nicosarasa      |   1274988382 | 2010-05-27 14:26:22 |     0 |
| joodas          |   1274240403 | 2010-05-18 22:40:03 |     1 |
| castexyz        |   1271154599 | 2010-04-13 05:29:59 |     1 |
| rohitmitra5752  |   1270641508 | 2010-04-07 06:58:28 |     0 |
| ayu             |   1269477686 | 2010-03-24 19:41:26 |     1 |
| fbauto1         |   1268007442 | 2010-03-07 18:17:22 |     1 |
| silk600         |   1265973556 | 2010-02-12 05:19:16 |     1 |
| tester123       |   1264705175 | 2010-01-28 12:59:35 |     0 |
| maneth          |   1259987223 | 2009-12-04 22:27:03 |     1 |
| linuca          |   1259941435 | 2009-12-04 09:43:55 |     3 |
| lnxer           |   1259448014 | 2009-11-28 16:40:14 |     1 |
| zruasotcjpnjxw  |   1258688935 | 2009-11-19 21:48:55 |     0 |
| pru             |   1256045844 | 2009-10-20 08:37:24 |     4 |
| procreator      |   1255618625 | 2009-10-15 09:57:05 |     1 |
| hobbers         |   1245341071 | 2009-06-18 11:04:31 |     2 |
| romantico       |   1236377323 | 2009-03-06 16:08:43 |     0 |
| mathis          |   1234543606 | 2009-02-13 10:46:46 |     2 |
| ackbarr         |   1234026113 | 2009-02-07 11:01:53 |     3 |
| xadamz23        |   1231967591 | 2009-01-14 15:13:11 |    31 |
| d34dh0r53       |   1230662517 | 2008-12-30 12:41:57 |     2 |
| bobknob         |   1228116970 | 2008-12-01 01:36:10 |     2 |
| verno           |   1227952536 | 2008-11-29 03:55:36 |    14 |
| renmaverick     |   1226212425 | 2008-11-09 00:33:45 |     3 |
| user19190989    |   1224347984 | 2008-10-18 11:39:44 |     1 |
| bathtub         |   1222255104 | 2008-09-24 06:18:24 |     4 |
| unniplucka      |   1222153815 | 2008-09-23 02:10:15 |     1 |
| totalfake       |   1214489830 | 2008-06-26 09:17:10 |     0 |
| IT_Dude         |   1210701456 | 2008-05-13 12:57:36 |     1 |
| cbthompson      |   1208207656 | 2008-04-14 16:14:16 |     0 |
| softweyr        |   1200931112 | 2008-01-21 09:58:32 |     2 |
| fuckyou         |   1174862102 | 2007-03-25 17:35:02 |     0 |
| shesatmine      |   1173185058 | 2007-03-06 06:44:18 |     8 |
| 2n00b4j00       |   1167362060 | 2006-12-28 21:14:20 |     2 |
| golfhakker      |   1143651653 | 2006-03-29 11:00:53 |     1 |
| konquistador    |   1141229063 | 2006-03-01 10:04:23 |     3 |
| john413         |   1128569081 | 2005-10-05 22:24:41 |     1 |
| kakra           |   1128167658 | 2005-10-01 06:54:18 |     0 |
| qwert           |   1121653682 | 2005-07-17 21:28:02 |     0 |
| reni            |   1112166778 | 2005-03-30 01:12:58 |     0 |
| pageld          |   1083773770 | 2004-05-05 11:16:10 |     4 |
| HipCracka       |   1070594834 | 2003-12-04 21:27:14 |     1 |
+-----------------+--------------+---------------------+-------+
115 rows in set (0.12 sec)

That (above) will preserve 309 posts during the next run (test):


Code:
mysql> select sum(posts) from user where email like '%123456789ABCDE%' ;
+------------+
| sum(posts) |
+------------+
|        309 |
+------------+
1 row in set (0.11 sec)

# 13  
Old 03-13-2020
OBTW. User avatars have migrated over "OK" in this test round 2.

But the bbcode to markdown plugin did not work...... so need to fix that after this test run.
# 14  
Old 03-13-2020
I check the migration of all vB forums and sub (child) forums to discourse categories.

This works fine; and it will only takes a few hours of time, once done, to reorganize the categories to make certain categories the parent or child category of another.

I think I'll ask one of our mods to volunteer for that task.

Anyone interested to do this, once I get 'final port" done?

Also, confirmed..... bbcode tags to markdown plugin is not working. Will have to fix this before the next test run.


still migrating....

Code:
importing posts...
   114156 / 651550 ( 17.5%)

Login or Register to Ask a Question

Previous Thread | Next Thread

7 More Discussions You Might Find Interesting

1. What is on Your Mind?

Under Consideration: Migrate the Forums to Discourse

Dear All, After being active on the Node-RED forum for the last few weeks, I have been very impressed with Discourse, and my eyes have been opened. https://www.discourse.org/ but not the paid /hosted offering, but using the open distribution: https://github.com/discourse/discourse ... (52 Replies)
Discussion started by: Neo
52 Replies

2. Docker

Docker learning Phase-I

Hello All, I had recently learnt a bit of Docker(which provides containerization process). Here are some of my learning points from it. Let us start first with very basic question: What is Docker: Docker is a platform for sysadmins and developers to DEPLOY, DEVELOP and RUN applications ... (7 Replies)
Discussion started by: RavinderSingh13
7 Replies

3. UNIX for Beginners Questions & Answers

Can't pass a variable representing the output of lsb_release to a docker dontainer

I don't know why, but the rendering of my code mucks up the spacing and indentation, despite being correct in the original file. I'm having issues getting the following script to run (specifically the nested script at the end of the docker command near the end of the script; I think I'm not passing... (2 Replies)
Discussion started by: James Ray
2 Replies

4. Shell Programming and Scripting

Problem in extracting yocto SDK for docker

Actually I was facing the following issue while building my Yocto SDK on Docker container sudo docker build --tag="akash/eclipse-che:6.5.0-1" --tag="akash/eclipse-che:latest" /home/akash/dockerimage.yocto.support/ Sending build context to Docker daemon 26.93MB Step 1/5 : FROM eclipse/cpp_gcc ... (3 Replies)
Discussion started by: Akash BHardwaj
3 Replies

5. AIX

AIX - FC Switch migration, SAN Migration question!

I'm New to AIX / VIOS We're doing a FC switch cutover on an ibm device, connected via SAN. How do I tell if one path to my remote disk is lost? (aix lvm) How do I tell when my link is down on my HBA port? Appreciate your help, very much! (4 Replies)
Discussion started by: BG_JrAdmin
4 Replies

6. Linux

Docker and pipework,ip with other subnet

Recently i found this for give to docker a "personal" ip ip addr del 10.1.1.133/24 dev eth0 ip link add link eth0 dev eth0m type macvlan mode bridge ip link set eth0m up ip addr add 10.1.1.133/24 dev eth0m route add default gw 10.1.1.1On container i did ... (0 Replies)
Discussion started by: Linusolaradm1
0 Replies

7. Web Development

Removing VBSEO for vbulletin – Reverting back to vbulletin URLs

Please note, this information was copied from vbseo.com, now showing a database error. This is posted for reference since vbSEO seems to be going out of business: If you ever need to uninstall vBSEO , you can use the following instructions. Make sure you carefully follow each step. Login... (37 Replies)
Discussion started by: Neo
37 Replies
Login or Register to Ask a Question