Release 2025.03.05 Lakehouse Studio Release Notes

In this release (Release 2025.03.05), we have introduced a series of new features, enhancements, and fixes in this release. Please note that these updates will be rolled out gradually to the following regions over one to two weeks starting from the release date, depending on your region:

• Tencent Cloud Shanghai
• Tencent Cloud Beijing
• Tencent Cloud Guangzhou
• Alibaba Cloud Shanghai
• Alibaba Cloud Singapore
• AWS Singapore
• AWS Beijing

Incompatible Changes

• None

New Features

• Product-wide: Optimized functional permission points for built-in roles. Adjusted functional restrictions across scenarios (including left-side Studio menus, monitoring/alerting, and data quality) based on the latest role updates.
• Data Sync:
  • Offline Sync: Supports syncing Snappy-compressed Parquet files from S3.
  • Offline Sync: Added support for reading from and writing to DynamoDB data sources. [Beta]
  • Offline Sync: Added support for reading from HANA data sources. [Beta]
  • Offline Sync: Supports syncing tab-delimited CSV files from S3.
  • Multi-table Real-time Sync: Supports syncing data to Kafka.
  • Multi-table Real-time Sync: Added bulk table addition in virtual tables.
  • Offline/Real-time Sync: Added support for PolarDB for MySQL and PolarDB for PostgreSQL.
• Task Development:
  • Added Parameters configuration in the development area, merging ad-hoc parameters and scheduling parameters into a unified interface.
  • Introduced encrypted parameter values to hide sensitive information.
  • Added parameter value preview functionality.
  • Added parameter ignore feature to treat ${string} as plain text instead of parameter substitution.
  • Python/Shell nodes now support associating data source credentials with password parameter masking.
  • Added task priority configuration (0-9 levels, higher numbers indicate higher priority).
• Compute Clusters: Supports auto-scaling for GP (General Purpose) VC and Data Sync VC.
• Monitoring & Alerting:
  • Added support for mentioning users in Feishu alert messages.
  • Supports pushing alerts via custom APIs.
• Security Center:
  • Added granular permission controls for page functionalities (e.g., development, downloads, alerts).
  • Supports workspace-level custom roles (instance-level roles not yet supported).

Optimizations

• Account Registration: Added fields for company and position information during sign-up.
• Account Management: Users are forced to re-login after password changes.
• Data Sync:
  • Multi-table Real-time Sync: Supports deleting configured data sources.
  • Multi-table Real-time Sync: Added object count statistics in task configurations.
  • Multi-table Real-time Sync: Virtual tables now support schema selection.
  • Optimized cleanup for residual task instances and temporary tables (auto-deletion added).
  • Resumable full sync for interrupted tasks.
  • Source-side extended fields now support single-field composite keys.
  • Added single-table search and quick navigation in task configurations and O&M.
• Task Development: Added one-click task name copying.
• Operations Center:
  • Backfill tasks can now be paused for non-terminal instances.
  • Improved status visibility for backfill tasks.
• Monitoring & Alerting: Data quality test runs now trigger alerts for failures/timeouts.
• Data Catalog: Unified storage capacity display metrics across service instances.
• Security Center: Moved permission query entries to user/role detail pages.

Bug Fixes

• Task Development: Fixed rare page crash after executing SELECT queries (resolved by refresh).
• Task Development: Fixed missing task lists under task groups.

Known Limitations

• None