June 27, 2024 Lakehouse Studio Release Notes

In this release (Release 2024.06.27), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be gradually rolled out to the following regions over a period of one to two weeks from the release date, depending on your region.

• Alibaba Cloud Shanghai Region
• Alibaba Cloud Singapore Region
• Tencent Cloud Shanghai Region
• Tencent Cloud Guangzhou Region
• Tencent Cloud Beijing Region
• Amazon Beijing Region
• Amazon Singapore Region

New Service Regions Available

• Added Tencent Cloud Guangzhou Region
• Added Amazon Singapore Region

Incompatible Changes

• None

New Features

• Data Synchronization: Offline synchronization, source Lakehouse data source supports filtering conditions for specified data extraction.
• Data Synchronization: Real-time synchronization, supports data synchronization for heterogeneous sharding with source primary key (PK).
• Data Synchronization: Real-time synchronization, newly supports displaying traffic details and performing maintenance operations based on source tables, facilitating handling of source traffic peaks.
• Data Synchronization: Real-time synchronization supports taking primary key fields from different source tables and synchronizing data by creating a composite primary key.
• Data Synchronization: Supports configuring the concurrency of AMQP task consumption in advanced parameters to save resource overhead.

Optimizations and Improvements

• Global Product: Systematically improved internationalization translations, including page displays, error messages, and operation logs.
• Data Synchronization: Offline synchronization automatically generates table creation statements, providing options to create partitioned tables.
• Data Synchronization: Optimized the prompt text for offline tasks, providing more specific behavior descriptions.
• Data Development: Optimized the naming of fully downloaded files to enhance readability.
• Monitoring and Alerts: Recorded filter conditions for the monitoring rule list.
• Data Catalog: Custom lifecycle settings, default value changed to 36500 days to prevent accidental short-term settings leading to data being reclaimed and cleared.
• Data Catalog: Data upload now supports fields with empty string values.
• Job History: Optimized the display of diagnostic errors for failed tasks, exposing failure information.
• Job History: Removed the time range restriction when filtering and selecting.

Bug Fixes

• Data Development: Optimized the issue where the status display of temporary queries was inconsistent with the actual status under rare conditions such as screen lock.
• Task Scheduling: Resolved the issue where instances scheduled to run across days occasionally got stuck and did not exit normally.
• Task Scheduling: Fixed the issue where built-in parameters like sys_biz_day were not effective.
• Task Operations: Fixed the issue where the start scheduling time of periodic task instances was not displayed correctly.

Known Limitations

• None