Issue with Keyboard or Char Encoding During Migration Post: 303046220

Sponsored Content

Top Forums Programming Issue with Keyboard or Char Encoding During Migration Post 303046220 by Neo on Tuesday 28th of April 2020 04:01:36 AM

04-28-2020

Administrator

Quote:

Originally Posted by hicksd8

Need to remap ASCII characters to Unicode?

No. It's not that simple. It it was that simple, there would be no issue now. (The migration script already does encoding mapping from day 1. The DB is already UNICODE... the Ruby script already does encoding mapping. it is not so simple as a "general remap" or it would be done already.)

Let's stick with the plan. Find links with problems. I know how to fix these if everyone will follow my original plan and provide specific links with specific issues (original v. migrated posts).

What I need are EXACT examples of the real problem in OUR DB (not theory). Thanks. The links I posted were directly related to the EXACT char problem I am working today (right now). I used that code as a basis to address directly problems you guys found.

We want to work this bottoms up. Bottoms up means to find the exact issues (not theory) and fix the exact coding issue for each encoding issue.

Please. I'm busy and need to get this done the way I know will work. The only way to get this done correctly and surely is bottoms up. Not top down theory and speculation.

Thanks.

What I need from testers, in this thread is ORIGINAL versus MIGRATED posts examples. I can take care of the rest (finding the encoding in the DB, finding the correct transform, writing the code, running it, testing it in the DB, etc). Please keep on track looking for issues. That is the best way to help get this done.

Everything we have identified so far, I already have a solution for, and tested it and it works.

What I need are more examples of any error, anomaly or other data migration integrity issue, in two links (the original post and the migrated post).

This User Gave Thanks to Neo For This Post:

Neo

View Public Profile for Neo

Visit Neo's homepage!

Find all posts by Neo

7 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how2 get single char from keyboard w/o enter

I am writing a bash shell menu and would like to get a char immediately after a key is pressed. This script does not work but should give you an idea of what I am trying to do.... Thanks for the help #! /bin/bash ANSWER="" echo -en "Choose item...\n" until do $ANSWER = $STDIN ...

2. Shell Programming and Scripting

Encoding of a text issue

I created one file on windows system and is visible as : TestTable,INSERT,�večilnin1ईगल受害者是第,2010-02-02 10:10:10.612447,137277,ईगल受害者是第�večilnin!@#$%^&*()_+=-{}] But when send this file to unix system, the file is visible as : TestTable,INSERT,žvečilnin1ई�-ल �-害�...是第,2010-02-02 ...

3. Solaris

Solaris 10 p2v migration issue

Hi All, We need to move Physical Solaris 10 system to Virtual Solaris 10(p2v). Both the servers having Solaris 10(Generic_147440-25) means physical server which we are going to move is having Solaris 10 and this physical server will be converted as a virtualserver on another physical server...

4. UNIX for Dummies Questions & Answers

Strange Keyboard and Mouse Issue

Hello All, PC: CuBox-i (*i.MX6) Mini-PC OS: openSUSE 13.1 (Bottle) (armv7hl) Kernel: 3.14.14-cubox-i # uname -a Linux CuBox-HQ 3.14.14-cubox-i #1 SMP Sat Sep 13 03:48:24 UTC 2014 armv7l armv7l armv7l GNU/LinuxSo I've been having this random issue happen on this PC where a few strange...

5. AIX

AIX Migration issue with EMC ODM sets

Hi Experts , I want to start migrating our AIX 6.1 to AIX 7.1 . I am planning to use alt_disk_migration . Chris gibson has awesome documentation in the internet. However I am running into an issue with EMC odm filesets . So my current OS is AIX 6.1. and I have this : lslpp -l | grep EMC ...

6. Shell Programming and Scripting

AIX to RHEL migration - awk treating 0e[0-9]+ as 0 instead of string issue

Greetings Experts, We are migrating from AIX to RHEL Linux. I have created a script to verify and report the NULLs and SPACEs in the key columns and duplicates on key combination of "|" delimited set of big files. Following is the code that was successfully running in AIX. awk -F "|" 'BEGIN {...

7. Solaris

View file encoding then change encoding.

Hi all!! I�m using command file -i myfile.xml to validate XML file encoding, but it is just saying regular file . I�m expecting / looking an output as UTF8 or ANSI / ASCII Is there command to display the files encoding? Thank you!

LEARN ABOUT DEBIAN

mdb-schema

MDBTools(1)															       MDBTools(1)

NAME

       mdb-schema - Generate schema creation DDL

SYNOPSIS

       mdb-schema [options] database [backend]

DESCRIPTION

       mdb-schema is a utility program distributed with MDB Tools.

       It produces DDL (data definition language) output for the given database. This can be passed to another database to create a replica of the
       original access table format.

OPTIONS

       -T <table>, --table <table>
	      Single table option.  Create schema for this table only. Default is to export all tables.

       -N namespace
	      Prefix identifiers with namespace.

       --drop-table
	      Issue DROP TABLE statement.

       --no-drop-table
	      Don't issue DROP TABLE statement. This is the default.

       --not-null
	      Issue NOT NULL constraints. This is the default.

       --no-not-null
	      Don't issue NOT NULL constraints.

       --default-values
	      Issue DEFAULT values.

       --no-default-values
	      Don't issue DEFAULT values. This is the default.

       --not-empty
	      Issue CHECK <> '' constraints.

       --no-not-empty
	      Don't issue CHECK <> '' constraints. This is the default.

       --indexes
	      Export INDEXes. This is the default.

       --no-indexes
	      Don't export INDEXes.

       --relations
	      Export foreign keys constraints. This is the default.

       --no-relations
	      Don't export foreign keys constraints.

       backend
	      Specifies target DDL dialect. Supported values are access, sybase, oracle, postgres, and mysql. If not specified the  generated  DDL
	      will be in access format.

ENVIRONMENT

       MDB_JET3_CHARSET
	      Defines the charset of the input JET3 (access 97) file. Default is CP1252. See iconv(1).

       MDBICONV
	      Defines the output charset to use for the SQL file. Default is UTF-8. mdbtools must have been compiled with iconv.

       MDBOPTS
	      semi-column separated list of options:

	      o  use_index

	      o  no_memo

	      o  debug_like

	      o  debug_write

	      o  debug_usage

	      o  debug_ole

	      o  debug_row

	      o  debug_props

	      o  debug_all is a shortcut for all debug_* options

NOTES

HISTORY

       mdb-schema first appeared in MDB Tools 0.1.

SEE ALSO

       gmdb2(1) mdb-export(1) mdb-hexdump(1) mdb-prop(1) mdb-sql(1) mdb-ver(1) mdb-array(1) mdb-header(1) mdb-parsecsv(1) mdb-tables(1)

AUTHORS

       The mdb-schema utility was written by Brian Bruns and others.

BUGS

       Relationships  and  other features may not be supported by all databases.  Access datatypes are mapped to their closest counterparts in the
       target backend. This may not always yield an exact fit.

0.7								   13 July 2013 						       MDBTools(1)