New Document View option to configure file connector JSON columns - For JSON file connector columns, instead of the JSON Mask generator, you can use the new Document View option to view the JSON structure and to assign generators to each combination of path and data type within the JSON. On the column configuration panel for a file connector JSON column, toggle Use Document View to the on position. Document View displays as a new tab on the workspace management view.
On the recommended generator panel for columns, fixed an issue where the preview data was not generated.
SQL Server - The TONIC_SQL_SERVER_SCRIPT_NO_FILE_GROUPS configuration setting is now respected when creating constraints in the destination database.
SQL Server - Improved column length mismatch handling for SQL Server bulk copy.
File connector - On self-hosted instances, you can now configure a file mount as the source for file connector workspace files. After you set up the file mount, to enable the file mount option, you configure the file mount path as the value of the environment setting TONIC_FILE_MOUNT_POINT. For a file mount workspace, you can write the output to Amazon S3 or back to the file mount. Similar to cloud storage workspaces, you can select files or folders, and filter the file types to include.
PostgreSQL - Fixed a regression in v1391 where Postgis extension types were not processed properly.
Oracle - Enhanced performance and memory usage while working with Oracle CLOB data.
Databricks - For a Databricks workspace, you can now specify a list of source schemas to include. When you specify multiple source schemas, Structural automatically creates the same schemas in the destination database.
Databricks - Fixed issues to allow Databricks workspaces to function when the user does not have access to all of the tables in the source schema.
Okta SSO on Structural Cloud - Structural Cloud organizations can now use Okta single sign-on (SSO) to manage their Structural users. On Admin Settings view, administrators complete the Structural configuration from the new Single Sign-On tab on the Access Management tab. Note that this initial release does not include support for group filtering.
File connector - Fixed an issue handling NullArray in Parquet files.
Amazon DynamoDB - Changed the default connection type from local to AWS. Removed the seeded localhost value from the local server field.
Workspace overrides of environment settings - On the workspace details view, the new Advanced Workspace Overrides section allows you to override environment setting values for that workspace. It includes the existing statistics seed setting, as well as settings for data generation performance and, where supported, whether to have Structural create the destination database schema.
Custom generator presets and sensitivity rules are now available with the Professional license plan. They no longer require the Enterprise license plan.
File connector - Addressed several user interface performance issues by caching and sharing schema information across API calls.
MySQL - The Data Pipeline V2 generation process is now enabled for MySQL. On the Confirm Generation panel, you can now choose whether to use the new process.
MySQL - The Data Pipeline V2 flow now supports subsetting.
MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.
Custom generator presets and sensitivity rules on Structural Cloud - On Structural Cloud, you can now configure custom generator presets and custom sensitivity rules. The presets and rules that you configure are only available to your organization. The Account Admin permission set is now granted permission to configure custom generator presets and custom sensitivity rules.
Salesforce - Added logic to set BusinessHours reference field values to valid destination values for scratch orgs.
MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.
Updates to Table View - On Table View, the column headings now display icons to identify the protection status and the detection confidence level for each column. It also indicates when there is a recommended generator, and allows you to apply the recommendation to the column.
The UUID Key generator now supports UUIDs that are stored in strings without hyphens. When the input value contains hyphens, the output contain hyphens. When the input value does not contain hyphens, the output does not contain hyphens.
MySQL - Improved resilience to certain issues while processing tables.
Salesforce - Added additional destination constraint lifting logic to prevent FIELD_FILTER_VALIDATION_EXCEPTION and DUPLICATES_DETECTED errors.
Added an optional parameter, preserveExistingTags, to the workspace import API endpoint. When true, the tags in the imported workspace file do not overwrite the existing tags in the target workspace for the import. The default behavior is to overwrite the existing tags with the tags from the imported file.
Before an upsert job, Structural now performs constraint validation on the destination table. This avoids potential upsert failures because of missing uniqueness or primary key constraints as well as violations of foreign key constraints for downstream tables.
Fixed an issue where some columns found by custom sensitivity rules could not be marked as not sensitive.
MySQL - Improved resilience to certain issues during constraint application and processing tables.
MySQL - Fixed an issue with long-lived destination database connections.
Using secrets managers for database passwords - With the new secrets manager feature, Enterprise users can now opt to retrieve database passwords from AWS Secrets Manager. On Structural Settings view, you configure the available secrets managers. On the workspace details, to use a secrets manager for the database password, you select an available secrets manager and the secret to use from that secrets manager.
Fixed an issue introduced in v1332 where the dropdown for selecting a user when transferring a workspace or assigning a global permission set would not close upon selection.
Added a new environment setting TONIC_ENABLE_JAVA_SDK_DOWNLOAD that controls whether to allow downloads of the Java SDK. The default value is true.
MongoDB - Fixed an issue where specifying an unscanned collection as a subset target caused data generation to fail.
Salesforce - The Date Truncation generator now works correctly.
PostgreSQL - Fixed an issue where upsert operations failed on tables that contained custom types and unique constraints.
For Data Pipeline V2, fixed a rare issue where a job was not marked as failed after a fatal error, and the worker would not process other jobs.
Sensitivity confidence information in Privacy Hub - On Privacy Hub, the column boxes in the At-Risk Columns panel now reflect the confidence level in the sensitivity detection for each column. The sensitivity confidence is also displayed for the columns on the Recommended Generators by Sensitivity Type panel.