Sponsored Content
The Lounge What is on Your Mind? Update on vB3 Migration to Discourse - Issues and Status of BBCode Transformations Post 303045597 by Neo on Thursday 2nd of April 2020 09:50:44 PM
Old 04-02-2020
Update:

Change in direction (too slow to keep doing the migration over and over).

Create / write a Ruby script (done):
  • Retrieve the mappings from the vB posts to the Discourse posts stored the Discourse postgres DB.
  • Use these postid-to-postid mappings to grab the original vB post text from each vB post in the original mysql DB.
  • Preprocess the vB post text
  • Postprocess the vB post text
  • Update the raw post in the Discourse DB
  • Test and redo.

This script above processes about a million posts in 45 minutes (much faster) and when happy with the results can rebake the raw posts into the cooked posts. Rebaking 1M posts takes about 16+ hours, so avoiding this when possible.

Ran this yesterday and found that all the bugs posted my @MadeInGermany before (mangled code, missing left square brackets) and the hard line break error reported by @Scrutinzer (where \n in code fragments were converted to hard line breaks) were fixed.

However, still more gremlins to slay, working on:
  • Fixing missing emoji in the preprocessing. In particular the thumps up emoji that Ravinder loves to use :b: converts to :+1:. DONE
  • Fixing a bug in attachments and other images. DONE

However, the main reported gremlins in code fragments appear to be fixed. Now working on other missing transformations (missing emoji, images, etc).

Making progress... slowly but surely.

All work currently done on test / staging server only.
 

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell Script migration issues

Hi All, We will be doing a Solaris 8 to Solaris 10 migration migration, just wanted to know if there are any known / common issues arise from this migration from Shell script point of view. I tried searching this site but mostly post are related to SA's question and jumpstart, etc. If there's... (4 Replies)
Discussion started by: arvindcgi
4 Replies

2. HP-UX

Migration - Compiler Issues.

All, We are migrating an application from HP-UX B.11.00 to HP-UX B.11.31 and both of them have the same informix version - 7.25se. However the compilers are different on both servers. HP-UX B.11.00 - has B3913DB C.03.33 HP aC++ Compiler (S800) HP-UX B.11.31 - has PHSS_40631 1.0 HP C/aC++... (2 Replies)
Discussion started by: helper
2 Replies

3. Programming

How to track table status delete/update/insert status in DB2 V10 z/os?

Dear Team I am using DB2 v10 z/os database . Need expert guidance to figure out best way to track table activities ( Ex Delete, Insert,Update ) Scenario We have a table which is critical and many developer/testing team access on daily basis . We had instance where some deleted... (1 Reply)
Discussion started by: Perlbaby
1 Replies

4. What is on Your Mind?

Status of Migration of Moderation Systems

First a bit of history .... A number of years ago one of our admins built a number of plugin systems for moderation, including (1) a voting system, (2) a "user feelings" system and (3) a confidential posting system. During this time, I was busy on other projects, not very active in the forums,... (1 Reply)
Discussion started by: Neo
1 Replies

5. What is on Your Mind?

VBulletin 3.8 to Discourse on Docker Migration Test Take Two

OK. Like we all do, we learn a lot from tests, test migrations, and so forth. Today, I started from scratch on test migration 2, armed with a lot more knowledge, The main differences are as follows: Installed discourse plugin ruby-bbcode-to-md before starting the install Modified... (30 Replies)
Discussion started by: Neo
30 Replies

6. What is on Your Mind?

VBulletin 3.8 to Discourse on Docker Migration Test Take Four

Test Build 4 on New Server, with changes identified in discourse test builds 2 and 3, primarily: Insuring ruby-bbcode-to-markdown is enabled. Removing line breaks from ICODE to markdown in migration script. Added vbpostid to posts in discourse to setup migrating vb "thanks" to discourse... (28 Replies)
Discussion started by: Neo
28 Replies
BLAZE-LIST(1)						    BlazeBlogger Documentation						     BLAZE-LIST(1)

NAME
blaze-list - lists blog posts or pages in the BlazeBlogger repository SYNOPSIS
blaze-list [-cpqrsCPSV] [-b directory] [-I id] [-a author] [-t title] [-T tag] [-d day] [-m month] [-y year] [-n number] blaze-list -h|-v DESCRIPTION
blaze-list lists existing blog posts or pages in the BlazeBlogger repository. Additionally, it can also display basic repository statistics. OPTIONS
-b directory, --blogdir directory Allows you to specify a directory in which the BlazeBlogger repository is placed. The default option is a current working directory. -I id, --id id Allows you to display a single blog post or a page with the specified id. -a author, --author author Allows you to list blog posts or pages by the selected author. -t title, --title title Allows you to list blog posts or pages with matching title. -T tag, --tag tag Allows you to list blog posts or pages with matching tag. -d day, --day day Allows you to list blog posts or pages from the specified day of a month. The value has to be in the "DD" form. -m month, --month month Allows you to list blog posts or pages from the specified month. The value has to be in the "MM" form. -y year, --year year Allows you to list blog posts or pages from the specified year. The value has to be in the "YYYY" form. -n number, --number number Allows you to specify a number of blog posts or pages to be listed. -p, --page Tells blaze-list to list pages. -P, --post Tells blaze-list to list blog posts. This is the default option. -S, --stats Tells blaze-list to display statistics. -s, --short Tells blaze-list to display each blog post or page information on a single line. -r, --reverse Tells blaze-list to display blog posts or pages in reverse order. -c, --color Enables colored output. When supplied, this option overrides the relevant configuration option. -C, --no-color Disables colored output. When supplied, this option overrides the relevant configuration option. -q, --quiet Disables displaying of unnecessary messages. -V, --verbose Enables displaying of all messages. This is the default option. -h, --help Displays usage information and exits. -v, --version Displays version information and exits. EXAMPLE USAGE
List all blog post: ~]$ blaze-list ID: 11 | 2010-07-05 | Jaromir Hradilek Title: Join #blazeblogger on IRC Tags: announcement ID: 10 | 2009-12-16 | Jaromir Hradilek Title: Debian and Fedora Packages Tags: announcement etc. List all blog post in reverse order: ~]$ blaze-list -r ID: 1 | 2009-02-10 | Jaromir Hradilek Title: BlazeBlogger 0.7.0 Tags: release ID: 2 | 2009-02-11 | Jaromir Hradilek Title: BlazeBlogger 0.7.1 Tags: release etc. List all pages: ~]$ blaze-list -p ID: 5 | 2009-02-10 | Jaromir Hradilek Title: Downloads ID: 4 | 2009-02-10 | Jaromir Hradilek Title: Themes etc. List each blog post on a single line: ~]$ blaze-list -s ID: 11 | 2010-07-05 | Join #blazeblogger on IRC ID: 10 | 2009-12-16 | Debian and Fedora Packages etc. Display a short version of blog statistics: ~]$ blaze-list -Ss There is a total number of 11 blog posts and 5 pages in the repository. SEE ALSO
blaze-config(1), blaze-add(1) BUGS
To report a bug or to send a patch, please, add a new issue to the bug tracker at <http://code.google.com/p/blazeblogger/issues/>, or visit the discussion group at <http://groups.google.com/group/blazeblogger/>. COPYRIGHT
Copyright (C) 2009-2011 Jaromir Hradilek This program is free software; see the source for copying conditions. It is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. Version 1.2.0 2012-03-05 BLAZE-LIST(1)
All times are GMT -4. The time now is 07:13 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy