Upsert data generation (beta feature)
Previously, the data generation process always replaced the entire destination database. The new upsert data generation option (currently in beta) allows you to add new records and update existing records without touching any of the other records in the destination database. For example, you might have a regular set of records that you use for testing that you want to maintain.
Upsert requires a connection to an intermediate database. When you run data generation with upsert, the initial data generation writes the transformed data to the intermediate database. It replaces the intermediate database, similar to regular data generation. After the generation to the intermediate database, the upsert process identifies the records to add to or update in the destination database. It ignores other records in the destination database.
Upsert requires a Professional or Enterprise license, and is only supported for the following data connectors:
- MySQL
- Oracle
- PostgreSQL
- SQL Server
New AI-enhanced documentation search option
The Tonic documentation now provides access to Lens, an AI-based search option. Instead of searching for specific words, you can ask questions such as "How do I create a workspace?". Lens searches the documentation for the answer. It generates a response that includes links to the topics that contain the information it used.
To use the Lens search, click the search field. At the top right of the search panel, click Lens. Then ask your question.
Other updates
The Custom Categorical generator now supports consistency with other columns. Previously, the generator only supported self-consistency.
Tonic now prevents you from starting data generation for a workspace that does not have a destination database specified.
Fixed a display issue where the generator preset details panel briefly showed the occurrences for the previously selected generator preset.
Tonic now suggests the Name generator for columns that Tonic detects as containing names, when the detection is based on the sampled data in the column. By default, the Name generator uses the First Last format.
A new configuration option allows webhooks to bypass SSL certificate validation and trust the server certificate.
File connector
- You cannot start data generation for a file connector workspace that has no source files specified.
- The Table View data preview for file groups that contain JSON or XML files no longer displays above the real data records an extra row that contains the value 0.
- Fixed an issue where generators such as the Categorical generator unexpectedly could not be used as sub-generators.
- Improved error handling when a file group is incorrectly configured as having a header row.
- Fixed an issue that caused data generation to fail for XML files because of missing metadata.
- Fixed an issue where Database View displayed duplicate columns.
- Table View no longer displays an extra data row.
MongoDB
- Fixed an issue that caused unscanned collections to not display on Collection View.
- The sensitivity scan no longer marks Null fields as sensitive.
PostgreSQL
- Improved performance when refreshing materialized views in PostgreSQL v11, v12 and v13.
