Tonic Structural release information

File connector - Fixed an issue where file connector group prefixes would overlap if one prefix was a substring of another except for a trailing delimiter.

MySQL - MySQL now supports the Data Pipeline V2 flow.

Structural sensitivity detection for dates now ignores updated_at columns.

Bug fixes and other internal updates.

Fixed an issue that sometimes caused OutOfMemory exceptions in the web server when a worker that was generating data produced a large volume of logs very quickly.

Amazon DynamoDB data connector - The beta version of the DynamoDB data connector is now available.

The new environment setting TONIC_FILE_SAMPLE_PARALLELISM allows Structural to sample multiple files concurrently at the expense of memory usage by the scan. The default value is 4.

Databricks - Fixed statistics error when applying and viewing Categorical and Continuous generators.

When Azure SSO is configured incorrectly, Structural now logs a warning instead of exiting.

File connector - For Parquet files, fixed the support for applying generators to Decimal128 and Decimal256 columns.

Bug fixes and other internal updates.

Bug fixes and other internal updates.

Bug fixes and other internal updates.

MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.

Custom generator presets and sensitivity rules on Structural Cloud - On Structural Cloud, you can now configure custom generator presets and custom sensitivity rules. The presets and rules that you configure are only available to your organization. The Account Admin permission set is now granted permission to configure custom generator presets and custom sensitivity rules.

Salesforce - Added logic to set BusinessHours reference field values to valid destination values for scratch orgs.

Salesforce - Added additional destination constraint lifting logic to prevent FIELD_FILTER_VALIDATION_EXCEPTION and DUPLICATES_DETECTED errors.

MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.

Updates to Table View - On Table View, the column headings now display icons to identify the protection status and the detection confidence level for each column. It also indicates when there is a recommended generator, and allows you to apply the recommendation to the column.

Bug fixes and other internal updates.

The UUID Key generator now supports UUIDs that are stored in strings without hyphens. When the input value contains hyphens, the output contain hyphens. When the input value does not contain hyphens, the output does not contain hyphens.

MySQL - Improved resilience to certain issues while processing tables.

Salesforce - Added additional destination constraint lifting logic to prevent FIELD_FILTER_VALIDATION_EXCEPTION and DUPLICATES_DETECTED errors.

MySQL - Fixed an issue where data generation would hang after the destination database crashed.

Bug fixes and other internal updates.

Google BigQuery - Added basic support for the BigQuery RECORD type.

Structural no longer supports Docker engines that are older than 20.10.9.

Added an optional parameter, preserveExistingTags, to the workspace import API endpoint. When true, the tags in the imported workspace file do not overwrite the existing tags in the target workspace for the import. The default behavior is to overwrite the existing tags with the tags from the imported file.

Before an upsert job, Structural now performs constraint validation on the destination table. This avoids potential upsert failures because of missing uniqueness or primary key constraints as well as violations of foreign key constraints for downstream tables.

Fixed an issue where some columns found by custom sensitivity rules could not be marked as not sensitive.

Sharing Structural logs with Tonic.ai is changed from opt-in to opt-out. Log sharing is now enabled by default. To disable log sharing, set the environment setting ENABLE_LOG_COLLECTION to false on all Structural containers.

Bug fixes and other internal updates.

MySQL - Improved resilience to certain issues during constraint application and processing tables.

MySQL - Fixed an issue with long-lived destination database connections.

Using secrets managers for database passwords - With the new secrets manager feature, Enterprise users can now opt to retrieve database passwords from AWS Secrets Manager. On Structural Settings view, you configure the available secrets managers. On the workspace details, to use a secrets manager for the database password, you select an available secrets manager and the secret to use from that secrets manager.