Features
Allow changes to order of JSON Mask sub-generators
Running a job is now disabled when the license expiration date has passed
Separate Workspace Sharing and Workspace Role-based Workspace access into different license features
Improve SQL Server performance by prefetching all tables & views
Bugs
When using Java SDK only show Java supported generators
Features
Improves performance of Email generator on EMR and Databricks
Add support from Dremio with Spark
Bugs
Allowing Kubernetes ImagePullBackOff for up to 5 minutes before throwing error when updating through UI
Fixes inability to run a data generator on Spark with default database as the source
Features
Display estimated time remaining on row-based tasks in job details page
Display key icons for user uploaded foreign/primary key fields in MongoDB hybrid documents
Bugs
Copy Generator in MongoDB: Fix bug where if generator was copying a field that wasn't in the document it would throw exception
Add exception handling for SQL Server datetime columns to drop invalid records, better SQL Server XML type exception handling
Create source pool just before processing tables to avoid any timeouts in SQL Server
Features
Invalidate refresh tokens on logout, log in or out all open sessions (tabs) on login or logout, cross-tab inactivity timeout support
Improve load times on workspace pages
Bugs
Fix linking of non-consistent generators in Spark
API update
Deprecated the GET /api/workspace endpoint in favor of GET /api/workspace/search
Features
Include workspace ID in URLs
Parallelize writes on MySQL passthrough tables
Allow decimals in subsetting percentages
Bugs
Don't allow duplicate entries of tables in table mode settings for workspace
Handle null values with Copy generator on MongoDB
Database query performance improvements
Features
On Amazon EMR and Databricks, write JSON files to JSON instead of Parquet
Improved handling of Latitude/Longitude with Smart Linking generator
Add support for enum arrays columns in PostgreSQL
Bugs
Fix issue with Amazon EMR cross account data generation failing to resolve the Glue database
Features
Admin users can now view all workspaces in Tonic. They can copy, share, and transfer any workspace, regardless of whether they have a role in the workspace.
Multiple enhancements for workspaces. Users can now leave a workspace. Improved the workspace share and transfer functions. Added the ability to filter workspaces by owner.
Parse as bigint if decimal fails
Oracle Whitelist support in BuildDb
Initialize after log sink reset
Replace slashes with underscores in build versioning
Add 'No generators' filter for bulk table view
Add progress tracker for SQL Server post-data script generation
Allow support for views without fully qualified tables in Amazon Redshift
Improve performance of listing workspaces
Improve performance of the Constant generator on Amazon EMR and Databricks
Sensitive columns now appear in the privacy hub for MongoDB workspaces
Allow processing of decimals with a scale of 1 up to 9223372036854775807 in Postgres
Check for cloudsqlsuperuser permission on GCP Cloud SQL destination PostgreSQL databases
Bugs
Address Lambda function setup bug
Improve Regex Mask display of empty matches and values with new lines
Do not fail completely when SSO groups do not resolve
Miscellaneous Amazon Redshift View fixes
Fix issue where column can't be in schema changes and show as sensitive
Fix issue where some downstream tables are missing their foreign keys in the destination database when using subsetting
Fix issue with shifting table size on data preview in database view
Prevent error from occurring when MongoDB collection size is too large
Features
Added support for user defined enum types as keys in subsetting
Simplify schema diff changes error toast on generation
Show more unprotected columns button MongoDB Privacy Hub
Added filtering on custom value generator dropdown
Add ConsistentOn to Additive Noise generator
Enabling Timestamp Shift generator on compound primary keys
Regex Mask generator supports matching empty capture groups
Accommodate OFFSET in where clauses in SQL Server subsetting
Miscellaneous workspace configuration improvements
Add support Azure SQL with SqlServerDatabaseCreator
Add progress tracking for mongo schema scans
Add syntax highlighting for where clauses in subsetting
Add support for integer primary keys on smallint
Bugs
Fixed error message for MySQL data type not found
Fix PostgreSQL Test Connection bug
Fix Workspace patches after rename or modify tags
Fix Unix Timestamp empty column bug
Throw OperationCanceledException instead of CancelTonicJobException on cancellation request
Fix Amazon Redshift view replication missing schema
Features
Added the ability to configure Tonic administrators. Admin users have access to the new Admin Panel. The Admin Panel contains Tonic usage metrics, a table of all Tonic users, and the ability to manage other admin users.
For Kubernetes, admin users can now use the Admin Panel to update Tonic
Oracle performance improvements
Add new range options for Integer Key generator
CNPJ and CPF generator performance improvements
Updates Regex Mask generator to support replacing all matches
Start the progress token for passthrough tables when there are no passthrough tables with references
Add support for Timestamp Shift for Spark
Add warning system to privacy scan
Regex mask generator with Custom Value Processor
Check for cancellation and report progress on text copy in Postgresql
Miscellaneous performance improvements
Bugs
Start the progress token for passthrough tables when there are no passthrough tables with references
Treat non-standard Oracle error code 5 not as an error
Fix grabbing workspace users for comments
Dispose the source connection instead of just closing in PostgreSQL
Fix for test discovery exception
Fix PostgreSQL sequences behavior
Object mask bulk view fix
Miscellaneous typos fixed
Fixed database type for BigQuery test connection
Features
Relax unique index constraint on username
Added tonic version in containers as an environment variable
Adding logic to bypass fallback generators for Spark databases
Support case insensitive name consistency
Disable dropping replacements on missing columns for MongoDB
Update Oracle driver
Enable additive noise generation for strings in MongoDB
Add support for unsigned 64-bit integer columns in integer key generator
Add random timestamp and timestamp shift generators as options for integer columns (for unix timestamp columns)
Add checks for min/maxTime on timestamp and min/maxDate on dates
Adding null ref check for fallback generation option check during preview
Revamped workspace configuration screen
Support for Decimal on Spark (when using C# UDFs)
Allow Regex generator on PKs
Added new environment variable to filter tables ingested by UI for Oracle
Miscellaneous perf improvements
Bug fixes
Fix mongo view more values issues
Disable dropping replacements on missing columns for MongoDB
Fix workspace specified via API without databases can be modified in UI
Fixing Random Timestamp generator on Java
Date truncation generator bug fixes
Features
Better error exception handling for number conversions in MongoDB
Added loading indicator when viewing single MongoDB document
Improved MongoDB performance and logging
Added table filter validation for Amazon EMR
Handling numbers as doubles instead of integers in Snowflake
Added aiven.io system schema to PostgreSQL
Added the Geo generator for latitude and longitude data
Added support for materialized view in Amazon Redshift
Bug fixes
Fixed Array Regex Mask generator with correct sub-generator options
Fixed Conditional generator by adding binding
Features
Updated to dotnet 6
Moved FK import to FK page
Added support for tinyint in MySQL as a primary key
Added table partition filtering for Amazon EMR
Enabled Regex Mask generator on Amazon EMR
Added support decimals with precision and scale for Amazon EMR
Moved Tonic version number to hamburger menu
Added job sorting by start time
Ability to retrieve Kubernetes logs via API
Improved behavior of upstream reference tables for subsetting
Improved logging for subset filtering
Updated sensitivity scan to better reflect job status
Improved privacy scan performance for MongoDB
Introduced automated schema checks (not for MongodD)
Added HTML Mask generator
Added Additive Noise generator
Added CNPJ generator
Added Array Regex Mask generator
Deprecated endpoints
Updates to the foreign key feature impact the API endpoints used to fetch, upload, and delete the Foreign Key file. Two previous API endpoints are now marked as deprecated and will be removed after 2022-06-01. The main change is the switch to using workspaceId instead of datasourceId to fetch the Foreign Key file. The deprecated endpoints are:
DELETE /api/datasource/delete_fkupload has been marked as deprecated and replaced by DELETE /api/workspace/{workspaceId}/foreign-key/GET /api/datasource/download_fkupload/ has been marked as deprecated and replaced by GET /api/workspace/{workspaceId}/foreign-key/
Bug fixes
Fix number parsing issues in JSON Mask generator
Fix MySQL parsing of auto_increment columns
Eliminated re-querying of data type on Amazon EMR Spark
Fixed issue viewing Mongo workspace when there's an empty collection
Fixed for Truncated Date Generator when used as a sub-generator
Fixed data passed to sub-generator in Regex Mask generator
Features
Show tooltip for sidebar menu items when collapsed
Allow clicking of Queue Status and Download Job logs buttons on Jobs page
Added privacy scans to Jobs page
Added quick navigation to Jobs page from Workspaces tables
Added support for random timestamp generator for Amazon EMR
Improved Hstore generation performance
Added job-specific URLs
Webhooks are triggered when jobs are manually cancelled
Added warning for missing use statements in MySQL post-job scripts
Make JSON Mask generator respect ordering with multiple sub-generators
Bug fixes
Fix PostgreSQL binary timeout issues
Improved error handling & logging when applying Foreign Keys on subsetted SQL Server
Filter out constraints with same name as foreign key
