PostgreSQL - Fixed a regression in v1391 where Postgis extension types were not processed properly.
Oracle - Enhanced performance and memory usage while working with Oracle CLOB data.
Databricks - For a Databricks workspace, you can now specify a list of source schemas to include. When you specify multiple source schemas, Structural automatically creates the same schemas in the destination database.
Databricks - Fixed issues to allow Databricks workspaces to function when the user does not have access to all of the tables in the source schema.
Okta SSO on Structural Cloud - Structural Cloud organizations can now use Okta single sign-on (SSO) to manage their Structural users. On Admin Settings view, administrators complete the Structural configuration from the new Single Sign-On tab on the Access Management tab. Note that this initial release does not include support for group filtering.
File connector - Fixed an issue handling NullArray in Parquet files.
Amazon DynamoDB - Changed the default connection type from local to AWS. Removed the seeded localhost value from the local server field.
Workspace overrides of environment settings - On the workspace details view, the new Advanced Workspace Overrides section allows you to override environment setting values for that workspace. It includes the existing statistics seed setting, as well as settings for data generation performance and, where supported, whether to have Structural create the destination database schema.
Custom generator presets and sensitivity rules are now available with the Professional license plan. They no longer require the Enterprise license plan.
File connector - Addressed several user interface performance issues by caching and sharing schema information across API calls.
MySQL - The Data Pipeline V2 generation process is now enabled for MySQL. On the Confirm Generation panel, you can now choose whether to use the new process.
MySQL - The Data Pipeline V2 flow now supports subsetting.
MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.
Custom generator presets and sensitivity rules on Structural Cloud - On Structural Cloud, you can now configure custom generator presets and custom sensitivity rules. The presets and rules that you configure are only available to your organization. The Account Admin permission set is now granted permission to configure custom generator presets and custom sensitivity rules.
Salesforce - Added logic to set BusinessHours reference field values to valid destination values for scratch orgs.
MongoDB - Fixed an issue where applying the Categorical generator to a document database column could result in an error.
Updates to Table View - On Table View, the column headings now display icons to identify the protection status and the detection confidence level for each column. It also indicates when there is a recommended generator, and allows you to apply the recommendation to the column.
The UUID Key generator now supports UUIDs that are stored in strings without hyphens. When the input value contains hyphens, the output contain hyphens. When the input value does not contain hyphens, the output does not contain hyphens.
MySQL - Improved resilience to certain issues while processing tables.
Salesforce - Added additional destination constraint lifting logic to prevent FIELD_FILTER_VALIDATION_EXCEPTION and DUPLICATES_DETECTED errors.
Added an optional parameter, preserveExistingTags, to the workspace import API endpoint. When true, the tags in the imported workspace file do not overwrite the existing tags in the target workspace for the import. The default behavior is to overwrite the existing tags with the tags from the imported file.
Before an upsert job, Structural now performs constraint validation on the destination table. This avoids potential upsert failures because of missing uniqueness or primary key constraints as well as violations of foreign key constraints for downstream tables.
Fixed an issue where some columns found by custom sensitivity rules could not be marked as not sensitive.
MySQL - Improved resilience to certain issues during constraint application and processing tables.
MySQL - Fixed an issue with long-lived destination database connections.
Using secrets managers for database passwords - With the new secrets manager feature, Enterprise users can now opt to retrieve database passwords from AWS Secrets Manager. On Structural Settings view, you configure the available secrets managers. On the workspace details, to use a secrets manager for the database password, you select an available secrets manager and the secret to use from that secrets manager.
Fixed an issue introduced in v1332 where the dropdown for selecting a user when transferring a workspace or assigning a global permission set would not close upon selection.
Added a new environment setting TONIC_ENABLE_JAVA_SDK_DOWNLOAD that controls whether to allow downloads of the Java SDK. The default value is true.
MongoDB - Fixed an issue where specifying an unscanned collection as a subset target caused data generation to fail.
Salesforce - The Date Truncation generator now works correctly.
PostgreSQL - Fixed an issue where upsert operations failed on tables that contained custom types and unique constraints.
For Data Pipeline V2, fixed a rare issue where a job was not marked as failed after a fatal error, and the worker would not process other jobs.
Sensitivity confidence information in Privacy Hub - On Privacy Hub, the column boxes in the At-Risk Columns panel now reflect the confidence level in the sensitivity detection for each column. The sensitivity confidence is also displayed for the columns on the Recommended Generators by Sensitivity Type panel.
You can now specify the port that dotnet-monitor listens on within a worker. To set the port, use the environment setting TONIC_WORKER_DOTNET_MONITOR_PORT. Workers that are colocated on the same instance should be assigned different port bindings.
File connector - For custom Amazon S3 URLs, you can now indicate to trust the server certificate. To configure this, use the TONIC_AWS_S3_TRUST_SERVER_CERT environment setting.
MongoDB - Fixed an issue that caused layout problems for Privacy Hub.
Database View redesign and sensitivity confidence - On Database View, the Applied Generator column is now split into two columns. The Status column shows the current sensitivity status (Not Sensitive, At Risk, or Protected). From the Status column, you can display information about the detected sensitivity type and configure whether the column is sensitive. For at risk columns, the Status column also indicates the confidence level in the sensitivity detection. The Applied Generator column indicates the current generator assignment and allows you update the generator configuration.
Improved the detection accuracy for values in defined categories, such as gender.
Added the option to collect performance metrics when starting a data generation job that uses the Data Pipeline V2 processing.
