Database cleaning software

Tags

beginners

Top Forums UNIX for Dummies Questions & Answers Database cleaning software

03-15-2005

Registered User

447, 3

Join Date: Nov 2003

Last Activity: 25 January 2012, 5:08 PM EST

Location: Minnesota

Posts: 447

Thanks Given: 0

Thanked 3 Times in 3 Posts

Database cleaning software

Hi everybody,

I have been given a task to find the names of some products that can clean up databases by removing confidential information. The situation is that a client imports data from public sources (government websites, etc.) but that this data sometimes includes things like Social Security Numbers or other confidential data that must not be kept in the database for privacy reasons.

I've checked google, CNet reviews, and Oracle's website looking for suggestions but haven't turned up too much. Does anybody here work with or know of such software packages that can be used to clean up your database to prevent privacy compliance issues?

Thanks,
Ralph

rhfrommn

View Public Profile for rhfrommn

Find all posts by rhfrommn

Previous Thread | Next Thread

6 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

cleaning the file

Hi, I have a file with multiple rows. each row has 8 columns. Column 8 has entries separated by commas. I want to exclude all the rows in which column 8 has more than 3 commas. 1234#0/1 - ABC_1234 3 ATGCATGCATGC HHHIIIGIHVF 1 49:T>C,60:T>C,78:C>A,76:G>T,65:T>G Thanks, Diya

2. Shell Programming and Scripting

File cleaning

HI , I am getting the source data as below. Source Data CDR_Data,,,,, F1,F2,F3,F4,F5,F6 5,5,6,7,8,7 6,6,g,,, 7,7,76,,, 8,8,gt,,, 9,9,df ,d,d,d ,,,,,

3. UNIX for Dummies Questions & Answers

AWK Data Cleaning

Hello, I am trying to analyze data I recently ran, and the only way to efficiently clean up the data is by using an awk file. I am very new to awk and am having great difficulty with it. In $8 and $9, for example, I am trying to delete numbers that contain 1. I cannot find any tutorials that...

4. SCO

Tape drive cleaning

Hello everyone, First, thank you anyone who might be able to help : ) !! here it is, I am using SCO at my business, and I back up everything to a tape drive. I want to do my cleaning of the drive, and i put in the cartridge to the drive, it recognizes it yet it will not engage the...

5. UNIX for Dummies Questions & Answers

Cleaning file system

Hello all, I have a crontab entry to clean up a file system once a week that is used as tmp directory. 00 12 * * 0 find /mytmp -mtime +2 -exec rm {} \; The job starts ok but I always get an error message in mails because it is a file system and there is a directory lost+found that should...

6. AIX

doing some spring cleaning....

USERS="me you jim joe sue" for user in ${USERS}; do rmuser -p $user usrdir=`cat /etc/passwd|grep $user|awk -F":" '{ print $6 }'` rm -fr `cat /etc/passwd|grep $user|awk -F":" '{ print $6 }'` echo Deleting: $user '\t' REMOVING: $usrdir done This is for AIX ONLY!!! but easily ported to...

LEARN ABOUT DEBIAN

tmx2tmx

TMX2TMX(1p)						User Contributed Perl Documentation					       TMX2TMX(1p)

NAME

       tmx2tmx - utility to convert and filter TMX files

SYNOPSYS

	 tmx2tmx -cat file1.tmx ... filen.tmx > file.tmx

	 tmx2tmx -toTrados file1.tmx > file2.tmx

	 tmx2tmx -clean file1.tmx > file2.tmx

	 tmx2tmx -select=PT,EN multilingual.tmx > pt-en.tmx

DESCRIPTION

       This utility processes TMX documents and return TMX documents. Tasks done with this utility include conversion between TMX versions and TMX
       cleaning.

   TRADOS conversion
       As you maybe know, TRADOS is a company producing computer software for translators. It includes WorkBench which imports TMX files.
       Unfortunately, the version I used do not import TMX version 1.4.

       This process is done using the switch "-toTrados":

	 tmx2tmx -toTrados file.tmx > trados.tmx

   TMX Cleaning
       Specially when translation memories are created from anotated text, or extracted directly from the Internet using any automatic method.
       This switch is used to remove junk in translation units.

       This option tries to remove junk from TMX files, like empty pairs where one of the sides is empty, or removing other junk type.

       Use it this way:

	  tmx2tmx -clean file.tmx > file2.tmx

   Concatenating TMX
	  tmx2tmx -cat file1.tmx ... filen.tmx > file.tmx
	  ls | grep '.tmx$' | tmx2tmx -cat > file.tmx

   Select languages
       Select a bunch of languages:

	   tmx2tmx -select=PT,EN,FR huge.tmx > pt-en-fr.tmx

SEE ALSO

       tmx2html, po2tmx, XML::TMX

AUTHOR

       Alberto Simo~es, <albie@alfarrabio.di.uminho.pt>

COPYRIGHT AND LICENSE

       Copyright 2004 by Projecto Natura

       This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

perl v5.14.2							    2012-06-05							       TMX2TMX(1p)

UNIX for Dummies Questions & Answers