September 5, 2023 Lakehouse Studio Release Notes

New Features

To help users find the information they need more quickly, our product documentation now supports keyword-based global search functionality. Additionally, we have added a Table of Contents (TOC) navigation within the documents to help users quickly locate relevant content in long documents.

2. Kafka Security Authentication File Upload

The data integration module now supports uploading Kafka security authentication files to ensure data security when using Kafka data sources.

3. Real-time Synchronization and Monitoring

The real-time synchronization feature now includes real-time metrics monitoring, helping users understand the status and performance of data synchronization in real-time.

4. Alert Message Filtering

The monitoring alert module has added precise filtering functionality for webhooks such as Feishu bots, allowing users to better manage and receive important alert messages.

5. Monitoring Rule Filtering

Users can now filter and screen monitoring rules based on their subscriptions and responsible roles, improving work efficiency.

6. Job History Filtering

The job history module has added the ability to filter by submitter, making it easier for users to find and manage historical job records.

Optimizations and Improvements

1. Multi-resolution Adaptation Optimization

We have optimized the multi-resolution adaptation for the product's browser display to ensure a good user experience on screens of different sizes.

2. JDBC Data Source Optimization

JDBC data sources now support customizing the visible database/schema range, enhancing the flexibility and security of data source configuration.

3. Data Development Collaborative Editing Optimization

Task code caching and multi-user, multi-device collaborative editing features have been optimized to improve collaboration efficiency during the data development process.

4. Data Development Performance Optimization

The rendering performance of switching between file and run result tabs has been optimized to provide a smoother operation experience.

5. Data Development Run Results Optimization

The display of run result tables has been optimized, including sorting optimization and support for distinguishing between different value types such as strings and numbers.

6. Data Development Editor Optimization

In the code editor, the system will automatically record the cursor position from the user's last edit, making it easier for users to continue editing.

7. Data Quality Display Optimization

The display information of inspection results has been optimized, and the associated scheduling supports quick navigation, improving data quality management efficiency.

Bug Fixes

1. Data Integration Field Type Conversion Issue Fix

Fixed the issue where char, varchar, text, and other field types failed to convert to decimal field types during data integration and were not set to null.

2. Task Scheduling Logic Optimization

Optimized the instance generation logic and instance dependency binding relationships in task scheduling, fixing issues where instances were not generated, generated repeatedly, or had incorrect dependency relationships in specific scenarios.

3. Security Center Authorization Error Fix

Fixed the authorization error caused by non-workspace administrators selecting a workspace when performing authorization operations.