Tonic Structural release information

Features

The Workspaces view now supports bulk actions. Share, transfer, delete, and leave multiple workspaces by checking the boxes at the right end of each row, and choosing the desired action from the Actions menu.

Bugs

Fixed an issue where Safari would fail to load the application

Fixes to constraint application parallelism

Breaking Changes

The response for the workspace deletion endpoint (/api/workspace/{workspaceId}) has been modified slightly

Features

Enable Timestamp generator to work without statistics for Spark object masks

When a MongoDB foreign key field has a primary key with a generator applied, replace the example data with a link to the collection with the primary key

Bugs

Fix for MySQL generation hanging with empty password

Features

Add the version of the worker that ran a job to the job details

On the MongoDB Collection View for foreign/primary keys: Added a hover tooltip for key icons, replaced the generator with a label

Refresh the last collection visited when a new foreign key file is uploaded and optimize single_doc foreign key

Bugs

Disable date truncation generator as a sub-generator for Spark

Fixes Notification service consuming all disk space when crashing

Show the appropriate Conditional sub-generator label instead of Passthrough

Fixed in memory table query for SQL Server

Features

Adds support for events (dependent rows) to AI Synthesizer (formerly known as Smart Linking)

Allow wildcard (%) in schema name for Dremio

Bugs

Support Date Truncation and Timestamp Shift on Snowflake TIMESTAMP_TZ and Amazon Redshift TIMESTAMPTZ columns

Disable the generator dropdown in the UI for columns with both primary and foreign keys

MongoDB - Fix errors when linking Categorical generators

Bug fixes for synthesis report

Fix data type mappings for Dremio Integer and Varchar

Features

Display whether webhooks were used in job details

Terminology changes

• Masked is changing to De-identify
• Synthesized is changing to Scale
• Truncated is changing to Truncate
• Generator name change: Smart Linking is changing to AI Synthesizer

Bugs

Fixes to SQL script beautifier

Features

Move single connections on connection pools behind a feature flag

Do not drop indexes on auto increment columns in MySQL to improve performance

Add type filter to JSON Mask generator

Remove unique constraint on workspace names and change default workspace name to "Untitled Workspace"

Display key icons for user uploaded foreign/primary key fields in MongoDB single document view

Bugs

Fix issue where 0 results in Workspaces table sometimes let you navigate to a negative page number

Fix issue where workspace permissions didn't update in the UI until a refresh

Fixes authentication error on PostgreSQL when username has special characters

Fixed reopening open connections when TONIC_ENABLE_SINGLE_CONNECTION is false

Remove owner section from exported workspace body

Improve readability of workspace tags in small-width window sizes

Features

Apply foreign key constraints serially on a different thread to avoid deadlocks and improve performance

Bugs

Clear bulk column search query on filters reset

Memory improvements to MongoDB schema serialization

Better handling of schema name in Java SDK

Features

Improves performance of Email generator on EMR and Databricks

Add support from Dremio with Spark

Bugs

Allowing Kubernetes ImagePullBackOff for up to 5 minutes before throwing error when updating through UI

Fixes inability to run a data generator on Spark with default database as the source

Features

Allow changes to order of JSON Mask sub-generators

Running a job is now disabled when the license expiration date has passed

Separate Workspace Sharing and Workspace Role-based Workspace access into different license features

Improve SQL Server performance by prefetching all tables & views

Bugs

When using Java SDK only show Java supported generators

Features

Display estimated time remaining on row-based tasks in job details page

Display key icons for user uploaded foreign/primary key fields in MongoDB hybrid documents

Bugs

Copy Generator in MongoDB: Fix bug where if generator was copying a field that wasn't in the document it would throw exception

Add exception handling for SQL Server datetime columns to drop invalid records, better SQL Server XML type exception handling

Create source pool just before processing tables to avoid any timeouts in SQL Server

Display row based progress on jobs whenever possible

Statistics jobs for the Java Spark SDK now appear in Jobs table/Job Details page

Skip pre-job health check for PyML service when not needed

Added database metric sharing for AWS users

Don't null self-referential foreign keys on reference tables when subsetting

Add exception handling for invalid SSH Tunnel private key format and list valid formats in tooltip

Features

Apply constraints in parallel to data generation in PostgreSQL

Bugs

Ensure workspace tag input closes when focus is lost from outside click

Remove foreign key checks when applying constraints in MySQL

Features

Improves performance of Email generator on Amazon EMR and Databricks

b>Bugs

Better small-width responsiveness of tables in UI

Features

Add synthesis report

Support for update via UI with Docker

Bugs

Prevent unexpected behavior of progress tracker when the system clock shifts

Fixes error when creating partition function with null range on SQL Server

Fix issues with loading screen showing when not needed

Features

Add Remove Whitespace Transformer to Copy generator

Add ability to generate JSONPath expression for JSON Mask generator by clicking on preview JSON

Bugs

Improved support for large decimal numeric types in PostgreSQL

Features

Invalidate refresh tokens on logout, log in or out all open sessions (tabs) on login or logout, cross-tab inactivity timeout support

Improve load times on workspace pages

Bugs

Fix linking of non-consistent generators in Spark

API update

Deprecated the GET /api/workspace endpoint in favor of GET /api/workspace/search

Features

Improve MySQL generation performance by applying constraints in parallel

Bugs

Fix issue where indexes fail to be applied to converted columns on SQL Server

Fix issue with SSO account creation failing

Features

Include workspace ID in URLs

Parallelize writes on MySQL passthrough tables

Allow decimals in subsetting percentages

Bugs

Don't allow duplicate entries of tables in table mode settings for workspace

Handle null values with Copy generator on MongoDB

Database query performance improvements

Features

Change password requirements

• Length >= 12 characters
• Must include number
• Must include lowercase letter
• Must include uppercase letter
• Must include non-alphanumeric character

Bugs

Fixes to transfer workspace text

Allow opening Admin Panel when user has no workspaces

Features

Improve constraint restoration performance on MySQL

Allow incremental tables in MySQL where all columns are keys

Bugs

Prevent app from crashing when admin status of user is unknown

Features

Support Copy generator on MongoDB

Support parallelism of MongoDB schema scan

Support truncation mode on MongoDB

Bugs

Set Command Timeout in PostgreSQL to prevent timeouts

Features

Add login rate limiting

Bugs

Fix issue with functions and procedures not being created in the destination on Oracle databases

Features

Relax unique index constraint on username

Added tonic version in containers as an environment variable

Adding logic to bypass fallback generators for Spark databases

Support case insensitive name consistency

Disable dropping replacements on missing columns for MongoDB

Update Oracle driver

Enable additive noise generation for strings in MongoDB

Add support for unsigned 64-bit integer columns in integer key generator

Add random timestamp and timestamp shift generators as options for integer columns (for unix timestamp columns)

Add checks for min/maxTime on timestamp and min/maxDate on dates

Adding null ref check for fallback generation option check during preview

Revamped workspace configuration screen

Support for Decimal on Spark (when using C# UDFs)

Allow Regex generator on PKs

Added new environment variable to filter tables ingested by UI for Oracle

Miscellaneous perf improvements

Bug fixes

Fix mongo view more values issues

Disable dropping replacements on missing columns for MongoDB

Fix workspace specified via API without databases can be modified in UI

Fixing Random Timestamp generator on Java

Date truncation generator bug fixes