June 6, 2024 Lakehouse Studio Release Notes
In this release (Release 2024.06.06), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be gradually rolled out to the following regions over the course of one to two weeks from the release date, depending on your region.
- Alibaba Cloud Shanghai Region
- Tencent Cloud Shanghai Region
- Alibaba Cloud Singapore Region
- Tencent Cloud Beijing Region
- Amazon Beijing Region
Incompatible Changes
- None
New Features
-
Data Synchronization: Added support for re-synchronizing historical data for specified databases and tables, given a data source and source table, in addition to the existing field filter conditions.
-
Data Synchronization: Offline synchronization now supports direct writing to Lakehouse JSON fields.
-
Data Synchronization: Added support for batch creation based on configuration files for SQL Server data source types.
-
Data Development: Added error highlighting in the code area based on runtime log errors to facilitate quick issue identification and resolution.
-
Data Development: Display the execution time of the current query in the query results.
-
Data Assets: Added support for proactive authorization of data assets.
-
Data Assets: Adapted to support the display of information for External Schema and External Table.
Optimizations and Improvements
- Global Product: Optimized the linkage of workspace selection values when switching between different modules and pages.
- Global Product: On the instance homepage, support fine-grained distinction of whether global statistics such as storage and computation can be viewed based on user permissions and roles.
- Data Synchronization: Whole database mirroring synchronization now supports configuring multiple data sources at once.
- Data Synchronization: Optimized time zone selection for data sources, supporting dropdown selection of common time zones instead of manual input.
- Data Development: In the scheduling configuration, when clicking "Intelligent Parsing," a prompt will be given if object information in the code does not match the corresponding task.
- Data Development: Added a dependency source column when configuring scheduling dependencies.
- Data Development: For JDBC node data connection methods, exposed the supported data source types for quick use and creation.
- Data Development: Python and Shell task nodes now support configuring task output tables in the scheduling configuration.
- Cluster Management: Optimized the display, deletion, and usage behavior of default clusters.
- Job History: Optimized the display of result cache information in jobs.
Bug Fixes
- Data Development: Fixed an issue where code formatting failed in scenarios with special characters.
- Data Assets: Fixed an issue where data lineage was not correctly parsed in multi-table joins within Views.
- Data Assets: Fixed an issue where users could not preview data shared via the data wallet.
Known Limitations
- Data Synchronization: Offline synchronization does not currently support the interval field type in Lakehouse.
- Data Assets: External tables can only display statistics such as row count and size after executing the analyze statement.