Features
Added UUID primary key support for synthesized mode.
Added support for Duo 2FA SSO.
Updates for Oracle XML, RAW types.
Handle triggers and grants when creating databases for Oracle.
Null generator now supported as Spark UDF.
Handle spatial (geometry/geography) types in SQL Server.
Bug Fixes
Update tracking URL in Databricks.
Leave temp schemas alone.
Fix ConsistentOn in Regex Mask generator.
Security updates for Linux.
Features
Update Database view filter behavior
Added configuration option to disable account creation.
Regex mask generator is now supported on unique columns.
Warnings and errors for Redshift and Snowflake are now displayed on the job details page.
Updated job queued status.
Add CloudWatch Log Filtering by Log Level.
Bug Fixes
Performance improvement for hybrid document creation for MongoDB.
Fixed issue where constraints could be duplicated when using the same Oracle server for source and destination.
Enhanced Oracle log messages when copying data.
Features
PII Scan will continue on error and log all issues.
Added Unique Phone Number generator.
Added support for Integer Key generator on decimal columns where precision is zero.
Rename "output" database to "destination".
Added Table Mode descriptions on hover
Added TLS support for Db2 iSeries connections.
Bug FixesTONIC_MYSQL_USE_COMPRESSION environment variable was removed.
Slow API responses that are still in process when a workspace switch occurs will no longer cause stale data to show in the application.
Properly set last visited collection for MongoDB workspaces.
Fix workspace row alignment.
Disallow applying generators on PostgreSQL generated columns.
Fixed logging issues with PII scan errors.
Leave destination schema alone on Db2.
Fix subsetting of FKs with same name.
Features
Jobs now auto-stop if the worker crashes
Support for ENUM Arrays in PostgreSQL.
Categorical generator can now be used on non-string types in MongoDB.
Allow Conditional Generator on JSON, JSONB, and Boolean columns.
Custom Categorical and Categorical generator support for MongoDB arrays.
Add optional 'use compression' flag for MySQL.
Bug Fixes
Fixed issue when swapping between MongoDB workspaces
Fix Timestamp Shift generator for MongoDB.
Subsetting enhancements
EMR partitioned table UI bug fix.
Fixed an issue where metadata for the conditional generator did not always save correctly
Fix EMR Test Connection issue.
Features
JSON Mask for Spark.
Make bulk applying generators more friendly on columns with disparate types.
Generated columns are now supported for PostgreSQL.
EMR will output CSV files if the input file is a CSV.
Added support for unsigned integer columns to the Integer Key generator.
Performance improvements for MySQL.
Bug Fixes
Improved iSeries UI response time.
Fixed copy workspace issue where some fields were empty until a page refresh was performed.
EMR Hive DDL fix for CSV.
Fixed issue with droping indexes on auto-incrementing composite keys in MySQL
Improve Db2 post data order.
Improved MySQL performance for CopyTable.
Features
Add pagination to ECR Image search.
Workspace tags.
Optimized the privacy scan for Oracle DBs.
Add Custom Categorical generator to Mongo DB.
Support for EMR cross account.
Bug Fixes
Fix issues with resizable panes in Database View and Table View.
Allow non-null self references in a table in subsetting only if the table is a reference table.
Security enhancements
Fixed issues in MongoDB workspaces with dismissing all schema diffs.
Better handling of Check constraints in MySQL
Features
Added TLS support for iSeries Db2.
CloudWatch logs are available inside Tonic for AWS Lambda based jobs.
Support for 'consistent on column' in Regex Mask generator.
Bug Fixes
Fix SIN generator being applied to non-sin columns.
Optimized schema construction for destination database in DB2 LUW.
Truncated tables now handled properly for AWS Lambda based jobs.
Fix rendering of tables with double digit replacements on bulk view.
Consistent On dropdown is now alphabetized.
Features
Added destination database connection summary to job start confirmation.
Subsetting and post-job action indicators have been added to the workspaces view.
Added workspace name as a webhook content option.
Bug Fixes
Fixed issue with PostgreSQL index restoration and error handling.
Fixes for Tonic UI when connected to MongoDB
Features
Added support for incremental table mode on PostgreSQL.
Enable TimeStamp Shift generator for text columns.
Updates to the Privacy Hub for MongoDB
Add support for object, variant types in Snowflake.
HIPAA Address generator now handles extended zip codes that don't contain a hyphen.
Inactivity timeout and authorization/refresh token timeout can now be configured.
MySQL now copies over routines and events (if permissions are set) to the destination database.
Bug Fixes
Empty schemas in Db2 output database are now handled properly.
Http now forwards to https on the health check endpoint of the PII Scanner container.
Resolved issue in the subset preview when the estimated row count of the source is unavailable.
Features
New UI to view all workspaces.
Updates to Privacy Hub to track progress in protecting sensitive fields.
Db2 support for triggers and stored procedures.
Prevent Db2 summary tables and views from showing in the UI.
Support for Regex Mask, JSON Mask, and XML Mask generators on Snowflake and Amazon Redshift.
Allow Content-Type Header in webhook requests.
Ability to cancel data generation jobs from the job details page.
Schema differences can now be detected on a MongoDB collection.
Bug Fixes
Memory usage reduction on MySQL and Oracle.
ErrorOnOverwrite for Databricks table mode.
Usability improvements with MongoDB workspaces.
Features
Users can now download job logs directly through the Tonic application.
Integer primary key generator allows more control.
Add index restoration parallelism for PostgreSQL.
Add name case consistency.
Bug Fixes
Prevent Safari from crashing.
No longer print environment variables when launching the PII detection or machine learning containers.
Improve API performance for endpoint api/schemadiff.
Mongo RegexMaskEditor now gets column values.
Features
Smart Linking generators added - train neural networks to mimic the implicit relationships across columns.
Webhooks now support sending JSON object literals.
MongoDB expanded generators on allowed data types and consistency for multiple types of paths.
Clarified error messages in the UI.
Constant generator will now show a true/false drop down when added to a boolean field.
Bug Fixes
Improved performance of schema change detection on large workspaces.
Handle long generator names in the UI.
Allow notifications container to start up without TONIC_URL env variable.
Updated TLS cipher negotiation between Tonic and AWS Aurora MysQL.
Full name will now be consistent with first and last name.
Null values in SQL Server xml fields are now handled properly.
Optimized memory usage on very large SQL Server rows.
Reduced the number of times statistics have to be calculated for JSON Mask generator, XML Mask generator, and Regex Mask generator.
Fixed issue where Amazon S3 + Spark jobs would not start.
Features
Preserve N bytes for MAC address generation
Modeling panel in table view can now be resized
Repartition and coalescing added for Databricks
Subset preview on small screen improved
Speed up PII scan for MySQL
Updated subsetting logs
Increment default fingerprint schema version
Bug Fixes
Disable Generate Data during page load
Fix constant generator timestamp issue
Handle case when Spark not installed on EMR cluster
Increase BigQuery limit of 10GB
Memory optimized tables fixed when tearing down SQL Server
Shift + Select in Bulk in MySQL fixed
Features
Webhooks can now be created to alert external systems when a job has finished.
Magnifying glass now appears in Collection View in Mongo to show additional values for a given path.
Post-job scripts can now be put in a specific order by user.
MongoDB expanded to support comments, notifications, current date generator, collection search.
Generators can be found by metadata now as well as name.
Copy workspace action limited to owner only.
Remove tutorial video.
Show UI warnings for Oracle when rows are rejected by sqlldr.
Bug Fixes
Data in identity columns is now properly inserted into Amazon Redshift databases.
User defined types are now dropped in the correct order when tearing down a SQL Server database.
Job status API no longer returns information about other jobs.
Make the polling for jobs resilient to failed checks.
Even better upstream null handling.
Features
Added support for Db2 iSeries
Added support for Delta Table on Databricks
Added support for reading IAM roles off Databricks machines instead of providing IAM credentials
Added a UI notification when your Tonic version is 10+ versions behind
Added support for MongoDB 2.4 and 3.4
Added the ability to automatically skip tables that match a regular expression via an environment variable
Added the ability to obfuscate values inside an array in Mongo
Added the ability for the JSON Mask generator to parse JSON objects containing escaped characters and surrounded by quotes
Added the ability to automatically cast for mismatched types during downstream subsetting
Added a Regex generator
Added a Generative Adversarial Network Generator
Bug Fixes
Refreshes subset preview when table mode is changed
Improved handling of IAM credentials on Databricks when an IAM instance profile is present
Hide Other in generator dropdown when there are no additional generators
Features
Added support for MongoDB
Added support for Amazon Redshift
Delta Table support on Databricks
Upgrades the subset preview with UI improvements
Bug Fixes
Better handling of adding foreign keys pointing to non-primary keys
Checks for PostgreSQL version mismatch
Remove generator button now works in synthesis mode and on key columns
Added support to break subsetting cycle when both Foreign Key and Primary Key are nullable
Features
Subset Preview
Support for Google SSO, including ability to read group membership
Java UDFs on Spark for Character Scramble and MAC Address generators
Added custom value processor extension framework
Bug Fixes
Auto-increment on MySQL bug fix
No longer remote auto-increment on primary keys or on preserved tables
Fixes composite foreign key issue with one nullable column in key
Incremental mode now works when a rowversion or timestamp column is on the table
Fixed collation issue for MySQL 8
Features
Add environment variable for altering MySQL batch size during CopyRows
Ability to search label on Foreign Key viewer
CSV generator support for tab/multi delimiters
Better performance tracking in the UI for upstream and downstream tables
Sunset Classic Subsetting in favor of the now default Full algorithm
Bug Fixes
Fix auto_increment issue on bigint columns
Don't fail if foreign key column has been removed
Fix Auto Increment on MySQL when dropping indexes
Better support for JSON during MySQL generation
Features
Support added for non-primary key auto-incrementing columns
MySQL no longer requires locks on the source database during generations
Generators are now easier to remove in the UI
Reference tables can now be defined in subsetting configurations
Enhancements to the Foreign Key UI
Added a clickable link to the Job Start notification
New Character Separated Value generator added
Bug Fixes
Performance optimizations for the Address generator
Improved UI experience for workspaces with thousands of tables
Optimized memory usage for large workspaces during data generation jobs
Features
Subsetting upstream has better handling for table relations with multiple constraint groups where one of the constraint groups is often null
Differential Privacy is now available for Continuous generator
Added new Tonic logos
Generators are not allowed on foreign key columns that are also primary keys
Subsetting is now functional when Primary Key Generators are applied to primary keys
Bug Fixes
Resolved data upload for MySQL
Oracle 19 helper improvements
HIPAA address generator fix for zip codes
Refresh data table after Foreign Keys update
Features
Password reset functionality added
Search and Sort columns when adding Foreign keys in Tonic
Nullable Foreign keys are now an option when adding them in Tonic
New Date Shift generator added
Foreign Keys are now sorted alphabetically by default
Ability to set a starting point in the sequential integer generator
Bug Fixes
Fix in how we handle multi-column primary keys in subsetting
@ mentioning style improvements for commenting
UI fixes for Foreign Keys section
Enhancements to statistics generation with conditional + categorical generators
Copying Databricks workspace works as expected
Features
Support for Db2 LUW added
New option to set strictness for schema changes
Added support for pg_repack extension
Added support for more Key generators in Spark
Added support for tinyint and smallint data types in subsetting
Bug Fixes
Better cache handling for subsetting
Improvements for NULL checking in Consistency On
Fixed issues in subsetting preview
Reduced collisions in Unique Email generator
Workers no longer crash when unable to obtain a queued job
Empty post-job scripts now throw a warning rather than failing the job
Better log messages with primary key generators fail
Fixed arithmetic overflow error when calculating SQL Server database size
Fixed upstream exhaustion in subsetting
