September 18, 2024 Lakehouse Studio Release Notes
In this release (Release 2024.09.18), we have introduced a series of new features, enhancements, and fixes. Please note that these updates will be gradually rolled out to the following regions over the course of one to two weeks from the release date, depending on your region.
- Tencent Cloud Beijing Region
- Tencent Cloud Shanghai Region
- Tencent Cloud Guangzhou Region
- Alibaba Cloud Shanghai Region
- Alibaba Cloud Singapore Region
- Amazon Beijing Region
- Amazon Cloud Singapore
Incompatible Changes
- None
New Features
- Product Global: Account registration page is now open, accounts can be registered via invitation code.
- Data Source: Added search capability to the new data source page.
- Offline Sync: Supports reading and writing of AWS S3 data sources.
- Real-time Sync: Supports real-time sync reading of Amazon Aurora data sources.
- Task Development: Added visualization exploration capability to data query results, allowing one-click view of the distribution of values in the current results.
- Task Development: Added a new virtual node task type. Virtual nodes do not generate any data and are used as dummy nodes to manage task flows.
- Task Development: Code search functionality now includes filters, allowing users to further filter the results to help locate the target task.
- Data Assets: The data upload function has been fully upgraded and optimized. During the new table creation process, the system can directly parse the information in the file to automatically create a new table and import data without manual creation by the user.
- Data Assets: Data search now includes keyword suggestion recommendations to help users find recommendations.
- Data Security: In the task development scenario, added operation permission control for displaying, copying, and downloading data query results.
- Data Security: View and management permission management for data sources.
- Security Center: Optimized the interaction when configuring network policies, highlighting duplicate IPs.
Optimizations and Improvements
- Real-time Sync: Removed multi-user collaboration capability, forcing the use of the latest version each time it is opened.
- Real-time Sync: Optimized the configuration of some key parameters and disabled editing to avoid misoperation when editing tasks.
- Task Development: Adjusted the structure of scheduling configuration information, optimizing the display format of each configuration item.
- Task Development: Supports moving tasks within a task group to other task groups by dragging and dropping.
- Task Development: Optimized the full download function, automatically adding file suffixes.
Bug Fixes
- Offline Integration: Fixed the issue of data loss when importing from OSS to Lakehouse with multiple concurrent imports set.
- Task Development: Fixed the issue of errors when resubmitting after changing the responsible person for dynamic tables.
- Task Development: Fixed the issue of lag caused by too many tasks in DAG mode within a task group.
Known Limitations
- None