October 15, 2024 Lakehouse Studio Release Notes

In this release (Release 2024.10.15), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be gradually rolled out to the following regions over a period of one to two weeks from the release date, depending on your region.

Tencent Cloud Beijing Region
Tencent Cloud Shanghai Region
Tencent Cloud Guangzhou Region
Alibaba Cloud Shanghai Region
Alibaba Cloud Singapore Region
Amazon Beijing Region
Amazon Cloud Singapore

Incompatible Changes

None

New Features

Product-wide: Added account audit functionality and global operation audit functionality, allowing audit record queries for user logins, management operations, development task operations, scheduling, and task instance maintenance operations.
Data Synchronization: MySQL data source write operations now support pre-sql functionality.
Task Development: Task groups now support batch scheduling time settings.
Approval Center: Added permission application and approval process. Users can click to apply on the data asset page, and after approval by the responsible person, specific usage permissions for data objects will be granted.

Optimizations and Improvements

Global: Display remaining refresh time next to the auto-refresh button.
Real-time Synchronization: Multi-table merge synchronization, optimized table list display, and support for quick filtering and searching.
Real-time Synchronization: Optimized error handling for binlog format errors in MySQL 8.0 data source synchronization.
Data Synchronization: Optimized field configuration interaction, supporting flexible changes to field mapping relationships.
Task Development: Optimized the display performance and page layout of task group DAGs when there are a large number of nodes.
Task Development: In JDBC node run results, when there is an exception in parsing the returned fields, it does not block the overall result display.
Task Development: Optimized file naming for full downloads, automatically adding file suffixes.
Data Assets: Optimized scenarios where various metrics of data assets under the current instance are zero.
Data Upload: Optimized loading animation for long wait times during data upload.
Job History: For execution failures, display the reason for failure, whether it is code failure or system execution failure.
Help Documentation: Optimized keyword-based search functionality, resolving issues where corresponding documents could not be searched in some cases.
Security: Adjusted the default granting method for data source functionality permissions, supporting workspace administrators (workspace_admin) and workspace developers (workspace_dev) to create and edit data sources in their workspace.

Bug Fixes

Data Source: Fixed an issue where MySQL data source connectivity tests failed due to time zone impacts.
Data Synchronization: Fixed an issue where compressed files (zip, gz) in S3 data sources caused synchronization errors.
Data Synchronization: Fixed an issue where error messages were unclear when creating virtual tables in real-time synchronization and the source table could not be matched.

Known Limitations

None