Tonic Structural release information

Learn about what’s in the latest Tonic.ai product releases.
v1167 - v1171
May 3, 2024

Sending telemetry to Tonic.ai is now required and enforced. After 5 days of failed telemetry connections, a warning displays. If the connection issue persists for 15 days, data generation is restricted.

Structural Cloud users can now reset their passwords from the login page. To reset your password, click Forgot your password?.

You can now set the TONIC_POSTGRES_REFRESH_MATERIALIZED_VIEWS environment setting from the Environment Settings tab on Tonic Settings.

File connector

  • Added support for AWS C2S Secret Regions.

SQL Server

  • Improved the upsert logic to prevent jobs from hanging.
v1172 - v1177
May 10, 2024

From the recommended generators panel on Privacy Hub, you can now enable or disable self-consistency for each column.

When you create a virtual foreign key, the nullability of the foreign key is now determined by the nullability of the foreign key column.

On Privacy Hub and the job details view, changed the label on the Download option to Reports and Logs.

Db2 for LUW

  • Subsetting is now supported.

MySQL

  • Fixed an issue where data generation failed when object identifiers included symbol characters.

PostgreSQL

  • Workspaces with PostgreSQL 16 databases can now write output to a container repository.
v1162 - v1166
April 26, 2024

Added a new API endpoint to resolve all schema changes in a workspace. You can choose whether to resolve only conflicting changes, only notifications, or all of the schema changes.

Fixed an issue that caused the Tonic Structural PyML Service to be unreachable in IPV4-only containers.

Added a new conflicting schema change when a column that has an assigned generator becomes a foreign key. Foreign key columns must inherit the generator from the primary key.

Structural can now generate data with subsetting when a primary key table is truncated, as long as the foreign keys that reference the primary key are nullable.

Amazon Redshift

  • Added support to pass through varbyte, geometry, and hllsketch types.

File connector

  • For CSV, XML, and JSON files, fixed issues with the data preview in Database View and Table View. The preview no longer includes extra rows, and the preview now correctly reflects the Skip first N rows setting.
  • Fixed the validation of file groups that only contained compressed files.

Snowflake

  • For subsetting, added support for virtual foreign keys.

SQL Server

  • Fixed an issue that caused data generations to fail for versions of SQL Server older than SQL Server 2016.
v1154 - v1161
April 19, 2024

For the notifications image, replaced alpine with ubuntu.

File connector

  • For a local files workspace, the job details view for a successful data generation now includes an option to download the transformed files that were produced by that job.
  • For workspaces that use files from cloud storage, you can now include prefix patterns in the file group definition. You can also provide file extension filters. The file group then includes all of the files that match a prefix pattern and the file extension filters. The file group details now include the content type, file extension filter, and prefix patterns.
  • For cloud storage workspaces, users who do not have permission to view all buckets can once again specify the bucket to view.
  • For cloud storage workspaces, added a configuration option to only process new files during data generation. For existing file groups, the new configuration is off by default. For new file groups, the configuration is enabled by default.

MongoDB

  • Fixed an issue where environment setting updates from the UI required a restart to take effect.

MySQL

  • For a workspace that is configured to write output to Ephemeral, you can now provide a custom configuration file.

Snowflake

  • Fixed an issue where the Subsetting tab disappeared after you edited a workspace.

SQL Server

  • For versions 2017, 2019, and 2022, you can now configure workspaces to write output to a container repository.
v1149 - v1153
April 12, 2024

During the free trial, Structural now displays next step highlights to indicate the next recommended action. When you hover over the recommended action, Structural displays an explanatory tooltip.

A new environment setting, TONIC_DB_MAX_POOL_SIZE, sets the connection pool size for the Structural application database. The default value is 3.

Fixed an issue where the preview data in the JSON Mask generator editor did not respect the applied table filter.

File connector

  • For workspaces that connect to Amazon S3, you can now specify different credentials for the source and output locations.
  • For cloud storage workspaces, fixed a regression in Tonic v1146 where the file explorer sometimes displayed incorrect results and files could not be added.
  • You can now add Parquet files to a file connector file group, either from cloud storage or a local file system. You cannot select the following Parquet file types: HalfFloat, Struct, Union, Dictionary, Map, List, FixedSizeList, or arrays of any type. There also is no file preview for Parquet files.

MongoDB

  • Fixed an issue that prevented the use of regex conditions in the conditional generator.
  • You can now select the UUID Key generator as a sub-generator when configuring a composite generator.

PostgreSQL

  • Fixed an issue where Preserve Destination tables sometimes were not preserved when data generation failed.
v1134 - v1139
March 29, 2024

Writing output to a Tonic Ephemeral snapshot - For database types that Tonic Ephemeral supports (currently PostgreSQL and MySQL), you can now write the output to an Ephemeral user snapshot. This replaces the option to write the output to an Ephemeral database, except for workspaces in the Structural free trial. In Ephemeral, you can use the user snapshot to start new Ephemeral databases.

Other updates

For the UUID Key generator, added a new configuration option, Preserve Version and Variant. By default, the setting is turned off. When turned on, the version and variant bits from the source UUID are preserved in the output value. For the API, the new setting is preserveVersionAndVariant.

In the Tonic Structural free trial, the sample workspace now by default writes the output to a Tonic Ephemeral database.

Fixed an issue where vertical scrolling was sometimes blocked.

You can now configure the allowed SSL/TLS protocols and ciphers on the Tonic Web Server. To configure the protocols and ciphers, use the environment settings TONIC_WEB_SERVER_TLS_PROTOCOLS and TONIC_WEB_SERVER_TLS_CIPHERS.

File Connector

  • Data generation jobs no longer fail when they encounter a configured file group file that no longer exists in the source cloud storage location.
  • For local file workspaces, fixed a regression from Tonic v1136 where users could not upload additional local files into a file group.

MongoDB

  • Fixed an issue that caused generations to fail when documents contained empty arrays or document fields.

MySQL

  • Improved job warnings around missing tablespaces in the destination database.
v1140 - v1148
April 5, 2024

Fixed an issue in Table View where characters were sometimes represented inaccurately. For example, a lowercase x would become a multiplication symbol.

Fixed an issue where data generation to Tonic Ephemeral Cloud failed with the error "Ephemeral URL not found".

For a schema change that adds a new column, both the Schema Changes view and the API response now include the data type for the new column.

For the Structural free trial, Structural now displays a checklist for each workspace. There are slightly different checklists for database-based and file connector workspaces.

Added support to run Structural in dual-stack networks and IPv6-only network environments.

On the workspace details view, fixed an issue where an Ephemeral API key appeared to be populated when no value was provided.

Fixed an issue that caused data generation to Ephemeral to fail with "Ephemeral output must be configured".

Fixed an issue where data generation to Ephemeral failed after a first successful run.

Amazon Redshift

  • You can now enable TLS for workspace data connections.

MySQL

  • Fixed an authentication issue that prevented output from being written to an Ephemeral snapshot.

SQL Server

  • You can now configure a SQL Server workspace to write output to an Ephemeral snapshot.
v1127 - v1133
March 22, 2024

The Structural API now includes endpoints to get and set the assigned table modes and table filters for a workspace.

Fixed an issue where the workspace audit trail displayed generator preset events that occurred before the workspace was created.

Fixed an issue where an error was returned when users tried to export selected files from a file group.

Improved error message when Structural cannot write output to Ephemeral because Ephemeral does not have a compatible base image for the database.

Databricks

  • When a workspace is configured with an unsupported version of Databricks, the error message now suggests the supported Databricks versions.
  • Updated the default spark_version to 14.3.

Google BigQuery

  • Fixed an issue with applying some generators to numeric columns on large tables.

Oracle

  • Fixed an issue where rows that contained NULL values in a VARCHAR2(1) column were dropped during data generation.
v1120 - v1126
March 15, 2024

Output to a Tonic Ephemeral database - Tonic Ephemeral is a separate Tonic.ai product that allows you to create temporary databases. On Tonic Cloud, for data connectors that Ephemeral supports (currently PostgreSQL and MySQL), you can configure the workspace to write the destination data to an Ephemeral database. This is the default option for data connectors that Ephemeral supports.

The database belongs to your Ephemeral account. If you do not already have an Ephemeral account, then Tonic automatically creates a two-week Ephemeral free trial account for you. The Tonic data generation job details provide access to the database connection details.

Free trial checklist - During the free trial, the sample workspace now includes a checklist to help users get through the required steps to complete their first data generation.

Other updates

Free trial users can no longer use a public email address to create an account.

Fixed an issue where password reset links lead to a blank page.

Fixed an issue where pay-as-you-go users would see the countdown for a free trial.

In the sample workspace, fixed an issue where a faulty destination database template caused an error when a user tried to update it.

Google BigQuery

  • Tonic can now de-identify snapshot tables.

Oracle

  • For databases that use non-default database character sets, fixed an issue where rows that contained character data sometimes failed to be written to the destination database.
  • For databases that use non-default database character sets, fixed an issue where passthrough CLOB data types had extra bytes inserted when they were copied to the destination database.

PostgreSQL

  • If you do not use extensions, then the destination database no longer requires a super user.

Snowflake

  • Subsetting is now supported on Snowflake workspaces. The table filtering option is still available.
v1114 - v1119
March 8, 2024

You can now manually add selected environment settings to the Environment Settings list on Tonic Settings.

Improved the performance of data previews in the Tonic application.

For workspaces that write output data to a container repository, fixed an issue that prevented GAR credentials from being saved.

Google BigQuery

  • Improved performance for data preview.

Snowflake

  • The workspace configuration now includes a Trust Server Certificate option for the source and destination connections. When enabled, it indicates to bypass certificate revocation checks.
  • Data generation jobs are now more resilient when they encounter views that have dependencies that Tonic does not have permissions for.
  • Destination privileges can now exclude schema creation. If the user does not have schema creation permissions, then the schemas must already exist in the destination database.

SQL Server

  • The upsert function now supports tables that have identity columns but do not have primary keys.
v1104 - v1106
February 23, 2024

Privacy Report PDF file

We added a new Privacy Report PDF that you can download from Privacy Hub and the job details view. The Privacy Report PDF contains a summary of the privacy ranking values, visualizations to summarize the workspace column privacy rankings based on the applied generators, and a summary table that contains the .csv Privacy Report data.

To accommodate the new file, on Privacy Hub and the job details page, the available downloads are combined into a Download menu.

Assigning recommended generators from Database View

On Database View, when an unprotected column has a recommended generator, the generator name tag now displays the type of sensitive data that was detected.

When you click the generator name tag, Tonic displays a panel that displays the sensitivity type, the recommended generator, and sample source and output data based on the recommended generator. The panel provides options to either apply or ignore the recommendation.

Other updates

Fixed an issue where changing the configuration of a generator preset did not accurately update the count of occurrences of the preset.

Oracle

  • Fixed an issue with Oracle 12.1 and 12.2 where constraints that had an index creation statement failed to apply.
  • Tonic can now de-identify external tables. External tables display in the Tonic application and can be assigned table modes and generators. During data generation, external tables are created as relational tables in the destination schema.
v1107 - v1113
March 1, 2024

New Db2 for LUW data connector - Tonic now has a data connector for IBM Db2 for Linux, Unix, and Windows (Db2 for LUW). Tonic supports Db2 for LUW version 11.5.

Other updates

When the AI Synthesizer is used in a workspace, Tonic now verifies before data generation that the AI Synthesizer does not use more than the maximum allowed categories.

Amazon EMR

  • Improved data generation performance when using Spark 2.4.0-3.2.x.Databricks

    • Fixed an issue in Databricks 11.3+ where a generator that was consistent on another column received modified input values if a generator was applied to the consistency column. Generators that are consistent on another column now correctly receive unmodified input values.
    • Improved data generation performance when using Spark 2.4.0-3.2.x.
    Google BigQuery

    • You can now de-identify views, except for views that are written in Google Legacy SQL. On the workspace settings view, to enable de-identification of views, toggle De-identify Views to the on position. You can then assign table modes and generators to the views. In the table lists, views are identified by (view) after the view name.

      For each view, Tonic:

      • Writes the de-identified data to a table called <view name>_tonic_table.
      • Creates a view that has the same name and metadata as the view in the source data, but is populated from the destination table.
    • Fixed an issue where Passthrough tables that had table constraints failed to copy to the destination database.
    • Fixed an issue where cloned tables did not appear in the Tonic application, but caused job failures. Cloned tables now display within Tonic and can be managed in the same way as any other table.
    Oracle

    • For Oracle 12, improved the schema remapping across multiple object types and configurations.
    • Fixed an issue where Tonic failed to copy database link objects that were configured using passwords. Tonic no longer processes database links. If required, users must manually create database links in the destination schema.
    • Fixed an issue where tables that contained computed columns dropped rows during data generation.
    Snowflake

    • You can now assign the JSON Mask generator to Snowflake variant columns.
v1098 - v1103
February 16, 2024

Fixed an issue with the Name generator where capitalization was not preserved if consistency was disabled.

For Table View, fixed an issue where the delete button to remove the generator assignment was sometimes hidden.

Oracle

  • Tonic now supports Oracle Advanced Queues. Queue tables and queues are created in the destination database. Messages are not copied from the source database to the destination database. Queue subscribers are not currently supported. You must add them to the destination database manually.

PostgreSQL

  • Tonic can now de-identify the ltree data type.

SQL Server

  • Fixed an issue where indexes were not created on schema bound views.
v1090 - v1097
February 9, 2024

Redesigned Database View

We redesigned Database View to improve the display and the filtering.

In the updated columns list, the Column column contains the schema, table, and column name, and the column data type. It provides access to the data preview option.

The Applied Generator column shows the applied generator. Applied Generator indicates when a column is unprotected, when the column is a primary or foreign key, and when the configuration overrides the parent workspace. If the table mode is not De-Identify, it shows the table mode. It provides access to the commenting option.

Filters other than the column name filter are moved under the Filters option. There are also new filters for the sensitivity type (the type of sensitive data that Tonic detected in the column) and whether the column has a recommended generator.

Privacy Report updates

In the Privacy Report, new column, Column Privacy Rank, indicates the privacy ranking for a column based on the assigned generator and generator configuration. The generator summary and generator reference include the possible privacy ranking values for each generator.

Added a new column, Tonic Detected Sensitivity, that indicates whether the Tonic sensitivity scan identified the column as sensitive. Renamed the Is Sensitive column to Current Sensitivity. Current Sensitivity indicates whether the column is currently marked as sensitive.

Also corrected an earlier issue with the order of the columns.

Other updates

Fixed an issue that caused all subset runs to record the percentage of rows in the subset as 100%. Subset runs that occur after updating to this version display the correct percentage.

The option to write output data to a container repository is out of beta.

Databricks

  • For Databricks 13+, writing output to delta tables now uses the table’s liquid clustering configuration to cluster the insertion.
  • Fixed an issue with loading tables into the Tonic application.

Google BigQuery

  • Improved batch size calculations to reduce memory pressure during data generation jobs.
  • Fixed an issue with applying the Timestamp Shift and Date Truncation generators on datetime or timestamp data when TONIC_GRPC_ENABLED was false.
  • For the Timestamp Shift and Date Truncation generators, improved support for time values that include fractional seconds.
  • Fixed an issue where the Character Substitution generator failed when assigned to a NUMERIC or BIGNUMERIC column.

Oracle

  • Tonic now supports IDENTITY columns. Before this change, IDENTITYM columns caused errors during destination database creation.
v1082 - v1089
February 2, 2024

For the Custom Categorical generator, you can now add a NULL value to the available custom category values. To indicate a NULL value, use the keyword {NULL}.

Made the following API updates to better accommodate users of the previous version of the API:

  • jobs/{id}/workspace_snapshot now returns the WorkspaceDataModel object.
  • Fixed an issue where workspace_snapshot could return empty replacements.
  • Added a new endpoint, GET jobs/{id}/workspace_snapshot?api-version=v2023_07_00, that returns V17WorkspaceDataModel

Databricks

  • When writing output to delta tables, the destination tables should now retain the TBLPROPERTIES from the source delta table, including 'delta.feature.allowColumnDefaults'.
v1076 - v1081
January 26, 2024

Redesigned data model for generator assignments - The new version of the Tonic API includes a redesign of the data model for generator assignments. To use the previous version of the generator assignment data model, make sure that your API calls specify version 2023.07.0.

The generator assignment data model redesign includes the following changes:

  • For all generators, moved the following fields to the metadata object in the link object:
    • presetId
    • generatorId
    • customValueProcessor
    • encryptionProcessor
  • For the <value type>: Mask composite generators:
    • Moved pathExpression to the metadata object in the link object.
    • Removed the following fields from the link object:
      • subPresetId
      • subGeneratorId
      • customSubGeneratorValueProcessor
    • Added the following fields to the subGeneratorMetadata object under metadata:
      • presetId
      • generatorId
      • customValueProcessor
    Other updates

    Updated the sensitivity scan to better identify company and organization names and suggest the appropriate generator.

    Databricks

    • The Conditional Generator is now supported on version 11.3+.
    Google BigQuery

    • Fixed some cases where a copied View did not have its definition updated to reference resources within the destination dataset. This could result in failures when attempting to copy the View into the destination dataset.
    • Added support for Preserve Destination table mode.
    • Fixed an issue where sub-queries in table filter clauses did not work if TONIC_GRPC_ENABLED was set to true.
    MySQL

    • You can now enable diagnostic logging for a MySQL data generation job.
    PostgreSQL

    • Improved the destination database permissions check on Google Cloud SQL to handle additional superuser authentication setups.
    SQL Server

    • Data generation now preserves hidden properties of columns.
v1072 - v1075
January 19, 2024

NOTE: v1074 was removed.

If your instance of Tonic is deployed on Docker, you can now use an external Kubernetes cluster to enable the option to write destination data to container artifacts.

You can now assign the Integer Key generator to a column with a decimal data type. The actual column values must still be integers.

Fixed an issue in Table View where an error displayed if you changed the selected table while the data was loading.

Databricks

  • For cluster versions 11.3 and above, Tonic now displays accurate lists of available and suggested generators.

File connector

  • Fixed an issue that prevented users from adding files to existing local file groups.

SQL Server

  • Fixed an issue that caused errors when creating inline functions in the destination database.
v1046 - v1053
December 15, 2023

NOTE: v1051 through v1053 were removed.

Enable administration functions in Tonic Cloud - For Tonic Cloud customers, the new Account Admin permission set provides access to Tonic administration functions for their organization. The Account Admin can reset passwords, delete users, copy and share all workspaces, and download the usage report. The Account Admin permission set is initially granted to the first user in the organization.

Databricks

  • For the Test Cluster Connection option, added an error message when the specified cluster cannot describe all the tables in the specified catalog + database.
  • Improved error messaging for the Test Cluster Connection option.

File connector

  • When you use the API to add files to a file group, Tonic now validates that the file exists and does not duplicate a file that is already in the group.

MySQL

  • Added a new environment setting, TONIC_MYSQL_MAX_CONCURRENT_INDEX_CREATION, to limit the number of concurrent indexes that are created. The default value is 0, which indicates that there is no limit.

SQL Server

  • External tables are no longer displayed on the application or carried over to the destination database.
v1069 - v1071
January 12, 2024

The Enable Diagnostic Logging global permission is now granted to the built-in Account Admin permission set.

Databricks

  • CREATE CATALOG or CREATE SCHEMA permissions are no longer required if the destination catalog or schema already exists.
  • For Databricks 11.3 and higher, added support for the Random Double generator.
  • For Databricks 11.3 and higher, added support for the IP Address generator.
v1063 - v1068
January 5, 2024

Diagnostic logging for data generation - By default, Tonic now redacts sensitive data in data generation log files.

When users start a data generation or upsert job, if they have the new global permission Enable diagnostic logging, they can choose to enable diagnostic logging, which does not redact the logs. The Enable diagnostic logging permission is also required to download the diagnostic logs. By default, the permission is only granted to the Admin and Admin (Environment) global permission sets.

In addition to the option for individual jobs, there are environment settings that enable diagnostic logging for specific data connectors.

Other updates

In the Release Candidate version of the API, the response model for the GET /api/workspace/minimal endpoint has been updated for more straightforward de-serialization.

Fixed an issue where a non-unique composite primary key column could only be assigned unique generators.

Users can now press Enter to finish copying a workspace or a generator preset, instead of having to click Copy.

File connector

  • Added support for the Conditional generator for file groups that contain CSV files.

Google BigQuery

  • Post-job scripts now support DDL and EXPORT.

Oracle

  • Fixed an issue with the permissions check that prevented connecting to Amazon RDS for Oracle databases.

SQL Server

  • In Data Definition Language (DDL) that applies to the destination database, Tonic now strips WITH INLINE clauses from definitions of user-defined functions (UDF). Inlining does not require these clauses. WITH_INLINE clauses in UDF definitions that do not meet the requirements for inlining can prevent the UDF from being restored properly in the destination database.
  • Fixed an issue where the order of XML columns was changed in the destination database.
v1062
December 29, 2023

For the OpenID Connect (OIDC) SSO integration, Tonic now supports authentication by client secret that uses HTTP basic authentication (client_secret_basic). To provide the client secret, configure the TONIC_SSO_CLIENT_SECRET environment setting.

SQL Server

  • A new environment setting, TONIC_SQL_SERVER_SKIP_CREATE_DB, indicates whether to skip schema creation for the destination database. If true, then Tonic does not create the schema. It uses the existing schema to populate the destination database. The default is false. You can configure this environment setting from the Environment Settings tab on Tonic Settings.
v1054 - v1061
December 22, 2023

NOTE: These releases were removed.

During free trial signup, the data connector options now include an option to use local files for the source data. This creates a file connector workspace for local files, and displays the File Groups view to allow the free trial user to start to add file groups to the workspace.

Added an environment setting, Tonic Test Connection Timeout In Seconds (TONIC_TEST_CONNECTION_TIMEOUT_IN_SECONDS), that you can set from the Environment Settings tab on Tonic Settings. This setting configures the timeout for testing a database connection. Previously, connection test attempts timed out after 5 seconds. The new default is 15 seconds.

When you configure a workspace to write the output to container artifacts, you can now specify custom resources for the Kubernetes pod, including the ephemeral storage, memory, and CPU millicores.

Improved performance when marking a large number of columns as not sensitive.

Fixed an issue that caused Tonic workers that are deployed on Docker to crash unexpectedly.

For numeric columns that support arbitrary precision and scale, when the scale is 0 (for example, NUMERIC(N,0)), or when the underlying values are all integers, these columns are now supported as primary keys for the purpose of subsetting.

Amazon EMR

  • You can now use the Timestamp Shift generator as a sub-generator within the Struct Mask generator.

Amazon EMR and Databricks

  • When files are saved to non-job-specific file destinations, the new environment setting TONIC_WORKSPACE_DEFAULT_SAVE_MODE indicates the mode to use. If set to a value other than null (Ignore, Append, Overwrite), this setting takes precedence over TONIC_WORKSPACE_DEFAULT_ERROR_ON_OVERRIDE.

Google BigQuery

  • Fixed an issue introduced in v982 where data generation failed with an HTTP 404 Not Found error for the destination table when the source and destination are in different BigQuery projects.

MongoDB

  • Added an environment setting, TONIC_DOCUMENT_MAX_DEPTH, to configure the maximum depth of JSON document that can be handled. The default value, which is also the recommended minimum value, is 32.
  • For bulk apply, fields with the same selection path but different data types no longer share a selection state.

SQL Server

  • Fixed an issue to properly restore schema-bound views in dependency order.
v1039 - v1045
December 8, 2023

When you select the option to write destination data to container artifacts, you can now use Google Artifact Registry (GAR) authorization using Google Cloud Platform (GCP) service account keys.

For the JSON Mask and XML Mask generators, fixed the data preview for JSON or XML field samples that are larger than 120MB by generating a smaller subset of the field.

The Name generator now supports consistency with other columns.

Added new API endpoints to retrieve and set table replacements. These new endpoints are compatible with workspaces for data connectors that do not have schemas, such as Spark-based databases and the file connector. The existing endpoints, which require you to provide a schema, eventually will be deprecated.

Amazon EMR

  • You can now write data generation output either to a single, static location or to a job-specific folder. Previously, all data generation output was exported to a job-specific folder.

File connector

  • You can now use the Continuous generator in file connector workspaces.

MySQL

  • When writing destination data to a container repository, you can now provide the content of a my.cnf file that contains custom configuration.
  • Fixed an issue where indexes that use expressions in their definition caused an error during data generation.

Oracle

  • To fix an issue where turning off database links caused triggers to break, we now run the ALTER TRIGGER statements after the TRIGGERS are validated.

PostgreSQL

  • For Azure PostgreSQL, fixed an issue with the destination database connection test.
  • For Azure PostgreSQL, fixed the connection test check for schemas that are not admin owned.

SQL Server

  • Data generation jobs that are canceled during the schema gathering phase now cancel more promptly.

Snowflake

  • On Tonic Cloud, the Snowflake with Azure option is now enabled correctly.
  • Free trial users can now use Snowflake on AWS and Snowflake on Azure.
v1034 - v1038
December 1, 2023

Added an environment setting TONIC_DELETE_COLUMN_SCHEMA_ON_WORKSPACE_DELETE. If the setting is true, then when a workspace is deleted, Tonic also deletes the associated rows from the ColumnSchemas table in the Tonic application database.

The new environment setting TONIC_NOTIFICATION_SMTP_TRUST_CERTIFICATE indicates whether to allow the SMTP server certificate to be trusted.

Improved the performance of previewing data in Privacy Hub.

Fixed an issue where SSO groups were not removed when the value of TONIC_SSO_GROUP_FILTER_REGEX changed in a way that excluded previously imported groups. The removed groups are removed from any workspaces that they were granted access to.

For the Timestamp Shift Generator, added Month and Year as options for the date part to use to set the allowed range.

When writing data to container artifacts, Tonic now first shuts down the temporary database before it begins to write data to the container.

Amazon EMR

  • Fixed an issue where, when the Athena workgroup used engine version 3, you could not preview data for tables that contained struct data types. Tonic now supports both Athena engine versions 2 and 3.
  • Fixed an issue where Professional plan customers could not save workspaces.
  • Fixed an issue where the Struct Mask generator editor did not display a preview of the value.
  • Enabled support for the Email generator as a sub-generator within the Struct Mask generator.

Databricks

  • Fixed an issue where the Struct Mask generator editor did not display a preview of the value.
  • The FNR generator is now supported.
  • Enabled support for the Email generator as a sub-generator within the Struct Mask generator.

MongoDB

  • Fixed an issue where erroneous schema change items were reported when the frequency of a field changed.

Oracle

  • Fixed an issue where when Oracle database links were not enabled (TONIC_ORACLE_DBLINK_ENABLED is false), privileges were not copied from the source to the destination.
v1031 - v1033
November 22, 2023

Amazon EMR

  • Fixed an issue where jobs failed if Tonic could not retrieve the tracking link for the EMR Step logs. To ensure maximum compatibility with all AWS regions, tracking links are now valid for 7 days instead of 14 days.
  • Fixed an issue with assigning the Passthrough generator as a sub-generator for the Regex Mask generator.

Databricks

  • Fixed an issue with assigning the Passthrough generator as a sub-generator for the Regex Mask generator.

MySQL

  • On destination databases, Tonic no longer checks for REPLICATION CLIENT and REPLICATION SLAVE grants.

Spark SDK

  • Fixed an issue with assigning the Passthrough generator as a sub-generator for the Regex Mask generator.

Spark with Livy

  • Fixed an issue with assigning the Passthrough generator as a sub-generator for the Regex Mask generator.