May 10, 2024 Lakehouse Studio Release Notes

In this release (Release 2024.05.10), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be gradually rolled out to the following regions in phases, and the updates will be completed within one to two weeks from the release date, depending on your region.

Alibaba Cloud Shanghai Region
Tencent Cloud Shanghai Region
Alibaba Cloud Singapore Region
Tencent Cloud Beijing Region

Incompatible Changes

None

New Features

Data Synchronization: Real-time synchronization, full database mirroring synchronization, supports configuring multiple data sources in one task
Data Synchronization: Real-time synchronization, multi-table merge synchronization, newly supports importing heterogeneous data tables from the source, compatible with scenarios where there are differences in fields across sharded databases
Operations Center: Added support for expanding multiple layers of upstream and downstream in the DAG diagram of scheduling tasks and instances
Monitoring and Alerts: Added support for Google Chat as an alert notification channel
Data Catalog: Newly provides an overview dashboard of data assets
Data Catalog: Supports modifying table comments, deleting objects, and other visual white-screen control capabilities
Data Sharing: Newly added data sharing feature based on data wallet, allowing sharing of table and view objects with other service instances in the same region of the same cloud provider (can belong to different tenants). Changes to shared data are visible in real-time and can be shared and canceled at any time through data wallet management.

Optimizations and Improvements

Data Synchronization: In real-time synchronization, compatibility for source object names containing special symbols such as '.'
Data Synchronization: In real-time synchronization, PostgreSQL data source newly supports special field types such as Array
Data Synchronization: Optimized real-time synchronization tasks to shorten startup time and status display
Task Development: Optimized task execution log display, simplified display method, and by default, does not expose exception stack information

Bug Fixes

Data Integration: Fixed the issue where restarting a task after creating a new data source in trial synchronization tasks would fail with an error
Data Integration: Fixed the issue where some offline synchronization tasks would get stuck and not exit due to excessive memory usage
Task Development: Fixed the issue where only a single result could be downloaded when there were multiple run results in full download
Task Scheduling: Fixed the issue where cross-day task instances would occasionally get stuck and run for a long time without ending

Known Limitations

Monitoring and Alerts: Google Chat notification channel is only supported in the Alibaba Cloud Singapore region, other regions are not supported yet
Real-time Synchronization: Does not support source database and table names containing the $ symbol, otherwise it will affect the normal startup of the task