Sponsored Content
The Lounge What is on Your Mind? Update on vB3 Migration to Discourse - Issues and Status of BBCode Transformations Post 303045597 by Neo on Thursday 2nd of April 2020 09:50:44 PM
Old 04-02-2020
Update:

Change in direction (too slow to keep doing the migration over and over).

Create / write a Ruby script (done):
  • Retrieve the mappings from the vB posts to the Discourse posts stored the Discourse postgres DB.
  • Use these postid-to-postid mappings to grab the original vB post text from each vB post in the original mysql DB.
  • Preprocess the vB post text
  • Postprocess the vB post text
  • Update the raw post in the Discourse DB
  • Test and redo.

This script above processes about a million posts in 45 minutes (much faster) and when happy with the results can rebake the raw posts into the cooked posts. Rebaking 1M posts takes about 16+ hours, so avoiding this when possible.

Ran this yesterday and found that all the bugs posted my @MadeInGermany before (mangled code, missing left square brackets) and the hard line break error reported by @Scrutinzer (where \n in code fragments were converted to hard line breaks) were fixed.

However, still more gremlins to slay, working on:
  • Fixing missing emoji in the preprocessing. In particular the thumps up emoji that Ravinder loves to use :b: converts to :+1:. DONE
  • Fixing a bug in attachments and other images. DONE

However, the main reported gremlins in code fragments appear to be fixed. Now working on other missing transformations (missing emoji, images, etc).

Making progress... slowly but surely.

All work currently done on test / staging server only.
 

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell Script migration issues

Hi All, We will be doing a Solaris 8 to Solaris 10 migration migration, just wanted to know if there are any known / common issues arise from this migration from Shell script point of view. I tried searching this site but mostly post are related to SA's question and jumpstart, etc. If there's... (4 Replies)
Discussion started by: arvindcgi
4 Replies

2. HP-UX

Migration - Compiler Issues.

All, We are migrating an application from HP-UX B.11.00 to HP-UX B.11.31 and both of them have the same informix version - 7.25se. However the compilers are different on both servers. HP-UX B.11.00 - has B3913DB C.03.33 HP aC++ Compiler (S800) HP-UX B.11.31 - has PHSS_40631 1.0 HP C/aC++... (2 Replies)
Discussion started by: helper
2 Replies

3. Programming

How to track table status delete/update/insert status in DB2 V10 z/os?

Dear Team I am using DB2 v10 z/os database . Need expert guidance to figure out best way to track table activities ( Ex Delete, Insert,Update ) Scenario We have a table which is critical and many developer/testing team access on daily basis . We had instance where some deleted... (1 Reply)
Discussion started by: Perlbaby
1 Replies

4. What is on Your Mind?

Status of Migration of Moderation Systems

First a bit of history .... A number of years ago one of our admins built a number of plugin systems for moderation, including (1) a voting system, (2) a "user feelings" system and (3) a confidential posting system. During this time, I was busy on other projects, not very active in the forums,... (1 Reply)
Discussion started by: Neo
1 Replies

5. What is on Your Mind?

VBulletin 3.8 to Discourse on Docker Migration Test Take Two

OK. Like we all do, we learn a lot from tests, test migrations, and so forth. Today, I started from scratch on test migration 2, armed with a lot more knowledge, The main differences are as follows: Installed discourse plugin ruby-bbcode-to-md before starting the install Modified... (30 Replies)
Discussion started by: Neo
30 Replies

6. What is on Your Mind?

VBulletin 3.8 to Discourse on Docker Migration Test Take Four

Test Build 4 on New Server, with changes identified in discourse test builds 2 and 3, primarily: Insuring ruby-bbcode-to-markdown is enabled. Removing line breaks from ICODE to markdown in migration script. Added vbpostid to posts in discourse to setup migrating vb "thanks" to discourse... (28 Replies)
Discussion started by: Neo
28 Replies
evmpost(1)						      General Commands Manual							evmpost(1)

NAME
evmpost - post events to the EVM daemon SYNOPSIS
msg priority]] | [filename| DESCRIPTION
The command takes a file or stream of text event sources as input and converts them to binary EVM events. By default, the command then posts them to the EVM daemon for distribution. If the option is specified, writes the EVM events to its stream instead of posting them to the daemon. By default, attempts to retrieve event template information from the EVM daemon and merges the template items and environmental items such as and into the output events. If the option is used, the output events contain only the items specified in the source. An event source may contain any number of events. Each event is specified in the manner shown. See the EvmEvent(5) manpage for a more detailed explanation. The command recognizes the following data items in an event source: o o o o o o o o o o All EVM variable types may be specified except for Refer to EvmEvent(5) for details on data items and variables. In the event source, each keyword must be accompanied by a corresponding value. The value must be enclosed in double quotes ("") if it contains white space. The data item keywords that are specified outside the event body are taken as global values. The data item keywords are included in each of the following events which do not have an explicit value defined for that keyword. Comments are indicated by a leading character. Blank lines are ignored. The command builds an EVM event containing the items that are explicitly specified in the source. If the event is posted or if the option is specified without additional environmental items such as the and template items are inserted into the event automatically. The rules for posting an event are more stringent than those for an event simply to exist. Therefore, may display an error when trying to post an an event that cannot be posted, even though the same source is accepted when using the option. For example, do not post an event if it does not contain a name with at least three components because the daemon rejects it. However, such an event can exist, and can create it and pass it to The following example fails because it does not contain a name: The following example is successful, even though it does not display any useful information: The option can verify event source and template files by piping the output into See evmshow(1). Options Does not post the events, but instead passes them directly to as raw EVM events. An error occurs if is directed to a terminal device. When used with the option, causes event template items and environmental values to be merged with the items included in the source. This is the default mode. When used with the option, inhibits the merging of template items and environmental values. Posts an administrator's quick message event with the name and the string msg in a variable data item. If a message contains spaces, the message must be enclosed in quotation marks (""). The event is used to add a message entry in the event log. This option may be used only by privileged users. Posts a user's quick message event with the name and the string msg in a variable data item. If a message contains spaces, the message must be enclosed in quotation marks (""). The event is used to add a message entry in the event log. Assigns priority as the for an administrator's or user's quick message. The priority value must be an integer in the range 0-700. If the priority is not specified, the default of 200 is used. Operands filename Read event sources from filename. If filename is omitted, or is specified as event sources are read from RETURN VALUES
The following exit values are returned: Successful completion. An error occurred. EXAMPLES
o The following example posts an event, provided that a template file containing an event with a matching name has been registered with the EVM daemon. o The following example interprets an event template file, and displays a dump of the contents of each event. Environmental items, such as a timestamp, are not merged into the event. This command checks the syntax and contents of the file. o The following example shows how is used in a shell script to signal completion of some operation: o The following example must be run as to post an administrator's message event. o The following example posts a quick user's message. o This example posts an event that includes a variable. If the template for this event contains the following format data item: then displays this event as: WARNINGS
The command rejects attempts to output raw events to a terminal device. Post only events for which you have posting authorization, and for which a template exists. FILES
Definition of the sockets and protocols used for Internet services Location of the EVM authorization file SEE ALSO
Commands evmget(1), evminfo(1), evmshow(1), evmsort(1), evmwatch(1). Routines EvmEventPost(3). Files evmdaemon.conf(4), evmtemplate(4), services(4). Event Management EVM(5). EVM Events EvmEvent(5). evmpost(1)
All times are GMT -4. The time now is 03:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy