Tonic Structural release information

Learn about what’s in the latest Tonic.ai product releases.
v264
August 19, 2021

Features

Added support for incremental table mode on PostgreSQL.

Enable TimeStamp Shift generator for text columns.

Updates to the Privacy Hub for MongoDB

Add support for object, variant types in Snowflake.

HIPAA Address generator now handles extended zip codes that don't contain a hyphen.

Inactivity timeout and authorization/refresh token timeout can now be configured.

MySQL now copies over routines and events (if permissions are set) to the destination database.

Bug Fixes

Empty schemas in Db2 output database are now handled properly.

Http now forwards to https on the health check endpoint of the PII Scanner container.

Resolved issue in the subset preview when the estimated row count of the source is unavailable.

v258
August 11, 2021

Features

New UI to view all workspaces.

Updates to Privacy Hub to track progress in protecting sensitive fields.

Db2 support for triggers and stored procedures.

Prevent Db2 summary tables and views from showing in the UI.

Support for Regex Mask, JSON Mask, and XML Mask generators on Snowflake and Amazon Redshift.

Allow Content-Type Header in webhook requests.

Ability to cancel data generation jobs from the job details page.

Schema differences can now be detected on a MongoDB collection.

Bug Fixes

Memory usage reduction on MySQL and Oracle.

ErrorOnOverwrite for Databricks table mode.

Usability improvements with MongoDB workspaces.

v251
July 29, 2021

Features

User information has been added to the Privacy Hub Audit Trail.

Bug Fixes

Improve usability when working with Db2.

Refactor queries to restore indexes and add timeout logic in MySQL.

Add batch size logic for subsetter when handling larger rows of data.

v254
August 2, 2021

Features

Added ability to process Amazon Redshift and Snowflake using AWS Lambda.

Update Databricks assets in parallel.

Updated Sandbox Terms, analytics, licensed features.

Bug Fixes

Updated connection to Google Cloud PostgreSQL databases.

v233
June 21, 2021

Features

Preserve N bytes for MAC address generation

Modeling panel in table view can now be resized

Repartition and coalescing added for Databricks

Subset preview on small screen improved

Speed up PII scan for MySQL

Updated subsetting logs

Increment default fingerprint schema version

Bug Fixes

Disable Generate Data during page load

Fix constant generator timestamp issue

Handle case when Spark not installed on EMR cluster

Increase BigQuery limit of 10GB

Memory optimized tables fixed when tearing down SQL Server

Shift + Select in Bulk in MySQL fixed

v246
July 22, 2021

Features

Users can now download job logs directly through the Tonic application.

Integer primary key generator allows more control.

Add index restoration parallelism for PostgreSQL.

Add name case consistency.

Bug Fixes

Prevent Safari from crashing.

No longer print environment variables when launching the PII detection or machine learning containers.

Improve API performance for endpoint api/schemadiff.

Mongo RegexMaskEditor now gets column values.

v243
July 15, 2021

Features

Smart Linking generators added - train neural networks to mimic the implicit relationships across columns.

Webhooks now support sending JSON object literals.

MongoDB expanded generators on allowed data types and consistency for multiple types of paths.

Clarified error messages in the UI.

Constant generator will now show a true/false drop down when added to a boolean field.

Bug Fixes

Improved performance of schema change detection on large workspaces.

Handle long generator names in the UI.

Allow notifications container to start up without TONIC_URL env variable.

Updated TLS cipher negotiation between Tonic and AWS Aurora MysQL.

Full name will now be consistent with first and last name.

Null values in SQL Server xml fields are now handled properly.

Optimized memory usage on very large SQL Server rows.

Reduced the number of times statistics have to be calculated for JSON Mask generator, XML Mask generator, and Regex Mask generator.

Fixed issue where Amazon S3 + Spark jobs would not start.

v228
June 11, 2021

Features

Webhooks can now be created to alert external systems when a job has finished.

Magnifying glass now appears in Collection View in Mongo to show additional values for a given path.

Post-job scripts can now be put in a specific order by user.

MongoDB expanded to support comments, notifications, current date generator, collection search.

Generators can be found by metadata now as well as name.

Copy workspace action limited to owner only.

Remove tutorial video.

Show UI warnings for Oracle when rows are rejected by sqlldr.

Bug Fixes

Data in identity columns is now properly inserted into Amazon Redshift databases.

User defined types are now dropped in the correct order when tearing down a SQL Server database.

Job status API no longer returns information about other jobs.

Make the polling for jobs resilient to failed checks.

Even better upstream null handling.

v207
April 29, 2021

Features

Added support for MongoDB

Added support for Amazon Redshift

Delta Table support on Databricks

Upgrades the subset preview with UI improvements

Bug Fixes

Better handling of adding foreign keys pointing to non-primary keys

Checks for PostgreSQL version mismatch

Remove generator button now works in synthesis mode and on key columns

Added support to break subsetting cycle when both Foreign Key and Primary Key are nullable

v199
April 8, 2021

Features

Add environment variable for altering MySQL batch size during CopyRows

Ability to search label on Foreign Key viewer

CSV generator support for tab/multi delimiters

Better performance tracking in the UI for upstream and downstream tables

Sunset Classic Subsetting in favor of the now default Full algorithm

Bug Fixes

Fix auto_increment issue on bigint columns

Don't fail if foreign key column has been removed

Fix Auto Increment on MySQL when dropping indexes

Better support for JSON during MySQL generation

v202
April 20, 2021

Features

Subset Preview

Support for Google SSO, including ability to read group membership

Java UDFs on Spark for Character Scramble and MAC Address generators

Added custom value processor extension framework

Bug Fixes

Auto-increment on MySQL bug fix

No longer remote auto-increment on primary keys or on preserved tables

Fixes composite foreign key issue with one nullable column in key

Incremental mode now works when a rowversion or timestamp column is on the table

Fixed collation issue for MySQL 8

v196
March 31, 2021

Features

Support added for non-primary key auto-incrementing columns

MySQL no longer requires locks on the source database during generations

Generators are now easier to remove in the UI

Reference tables can now be defined in subsetting configurations

Enhancements to the Foreign Key UI

Added a clickable link to the Job Start notification

New Character Separated Value generator added

Bug Fixes

Performance optimizations for the Address generator

Improved UI experience for workspaces with thousands of tables

Optimized memory usage for large workspaces during data generation jobs

v185
March 3, 2021

Features

Password reset functionality added

Search and Sort columns when adding Foreign keys in Tonic

Nullable Foreign keys are now an option when adding them in Tonic

New Date Shift generator added

Foreign Keys are now sorted alphabetically by default

Ability to set a starting point in the sequential integer generator

Bug Fixes

Fix in how we handle multi-column primary keys in subsetting

@ mentioning style improvements for commenting

UI fixes for Foreign Keys section

Enhancements to statistics generation with conditional + categorical generators

Copying Databricks workspace works as expected

v189
March 12, 2021

Features

Subsetting upstream has better handling for table relations with multiple constraint groups where one of the constraint groups is often null

Differential Privacy is now available for Continuous generator

Added new Tonic logos

Generators are not allowed on foreign key columns that are also primary keys

Subsetting is now functional when Primary Key Generators are applied to primary keys

Bug Fixes

Resolved data upload for MySQL

Oracle 19 helper improvements

HIPAA address generator fix for zip codes

Refresh data table after Foreign Keys update

v178
February 17, 2021

Features

Support for Db2 LUW added

New option to set strictness for schema changes

Added support for pg_repack extension

Added support for more Key generators in Spark

Added support for tinyint and smallint data types in subsetting

Bug Fixes

Better cache handling for subsetting

Improvements for NULL checking in Consistency On

Fixed issues in subsetting preview

Reduced collisions in Unique Email generator

Workers no longer crash when unable to obtain a queued job

Empty post-job scripts now throw a warning rather than failing the job

Better log messages with primary key generators fail

Fixed arithmetic overflow error when calculating SQL Server database size

Fixed upstream exhaustion in subsetting

v159
January 22, 2021

Features

New UUID Key generator

Support for PostgreSQL Client keys

Options to preserve OUIs and Uniqueness in MAC address generator

New HIPAA Address generator

Email generator can be used on synthesized tables

Custom Categorical generators can now be linked

Workspace ID copy button added

Column output data can now be made consistent on other column's data

Spark filtering of tables in Databricks

Improved logging

Bug Fixes

Better handling of times without timezone values in PostgreSQL

UI fixes

Subscriptions and Publications no longer copied in PostgreSQL

v165
February 3, 2021

Features

Protection Audit Trail now logs enable/disable of Differential Privacy toggle

Support for Memory Optimized tables in SQL Server

Ability to add new relationships in the Foreign Keys section

NULL generator can now be used on columns with uniqueness constraints

New subsetting option: Full Algorithm (default is still Classic Algorithm)

Bug Fixes

Fixed issue with retrieving column names when adding FK in Foreign Keys section

resolved conflict when setting generator to consistent on a column with a Constant generator

Switching between email generator and unique email generator now clears state as expected

MySQL point columns no longer halt generation

v154
December 23, 2020

Features

Improved performance of synthesized tables

Added new Foreign Key Viewer + Remover

Bug Fixes

Fixed issue with display of password reset errors

Fixed rendering issue with boundary of some popovers

v152
December 11, 2020

Features

API endpoint test_destination_db_connection added

User can now filter tables by schema in the Database View

Support for Hive + Spark datasource added

Support for synthesis on datetime primary keys

Improvements/Bug Fixes

Improved error messages displayed in the UI

Logging improvements

Synthesis mode improvements

Fixed UI issue with First connection wizard

v142
November 11, 2020

Features

Undo/Redo capabilities for workspace changes

More information in Job Details

New Strict Mode available when generating data via the API

Now supports for AVRO files

Now supports EMR Steps API

Bug Fixes

Error logging enhancements for Spark

Various UI improvements

v145
November 25, 2020

Better logging during job execution

Support for Spark + AVRO files

Various Spark improvements

v123
September 29, 2020

Features

Support for PingID SSO

Option to download foreign key file

Social Insurance generator added

Bug Fixes

Test Connection errors now show why the connection failed

v129
October 14, 2020

Features

Find and Replace generator introduced

Tonic saves a copy of the workspace configuration to job history every time a generation is started

You can now share workspaces with your SSO defined groups

Bug Fixes

Corrected rending issue for column sort option in Database View.

v132
October 28, 2020

Features

Added support for Spark/Amazon S3 as a data source and destination

Improved Company Name generator

Added support for text and ntext types in SQL Server

Added support for Google Big Query as a data source and destination

Workspace ownership can now be transferred from user to user

Bug Fixes

AWS Commons extension no longer breaks data generations

JSON and XML Mask generator configuration fixes

Minor display fixes

V119
September 17, 2020

Features

Added the ability to create post job scripts that will be executed against the destination server at the end of the generation

Added Cross Table Sum generator. Allows summing of rows from another table by partition

Added single sign-on support

Added Enterprise license key support

Added a check to validate the foreign key file before a generation executes

Allow maximum for Integer Key generator

Removed dependency on RabbitMQ

Added ability to have SQL Server and PostgreSQL trust server certificates in workspace editor

Additional logging was added around relationship integrity during subsetting

Added adjustable batch sizes for Oracle

Bug Fixes

Fixed several rendering issues in the table view

Tries multiple connection methods for Oracle

Supports Extended VarChar2s for Oracle

No longer hides foreign key column headings for synthesize mode

Job descriptions for jobs cancelled before they started running are more accurate

Testing the source database connection now works for viewers and auditors

Workspaces are now sorted alphabetically in the workspace drop down

Changing a linked generator now properly breaks the link

Foreign key columns now show up properly without needing a refresh after setting the primary key table to synthesized mode

Expand long column names on hover in the Privacy Hubs audit trail

Workspaces with broken connections to their database can once again be edited

Views no longer show in the list of tables for Oracle databases.