Ecosystem

Singdata Lakehouse integrates with mainstream data integration, BI, AI, and development tools, and is available on seven public clouds, including AWS, Alibaba Cloud, and Tencent Cloud. This page summarizes verified third-party tools and integration options by category.

If the tool you need is not listed, it may still be supported. Lakehouse provides standard access through JDBC, the MySQL protocol, and Python/Java SDKs. Any tool compatible with these protocols can connect directly. If you want to build a new connector or integration for Lakehouse, contact the Singdata partner team.

The following diagram shows where Singdata Lakehouse fits in an enterprise AI and data stack. Data sources are on the left, model providers are on the right, consumers such as AI Agents, business users, and application systems are at the top, cloud infrastructure is at the bottom, and the Singdata product matrix is in the middle.

Cloud Platforms (CSP)

Lakehouse is deployed on seven clouds: AWS, Alibaba Cloud, Tencent Cloud, GCP, Huawei Cloud, Baidu AI Cloud, and Volcengine. AWS, Alibaba Cloud, and Tencent Cloud provide dedicated documentation for storage connections, private network connections, and permission configuration. The configuration approach is consistent across the other cloud platforms. BYOS (Bring Your Own Storage) deployment is also supported: data is stored in your own cloud account and does not pass through the Singdata platform. See Supported Cloud Platforms and Private Storage Overview for details.


Data Integration

The following data integration tools work with Lakehouse and cover batch sync, real-time CDC, message streaming, and log collection. Lakehouse also supports 50+ data sources, including MySQL, Oracle, PostgreSQL, MongoDB, Hive, and MaxCompute, through Studio Data Sync without third-party tools:

ToolConnectionDescriptionReference
Apache KafkaKafka ConnectorReal-time message stream writing to LakehouseKafka Data Source
AutoMQKafka ProtocolNext-generation message queue, compatible with Kafka protocolAutoMQ Data Source
AirbyteJDBCOpen-source ELT platform with a rich connector ecosystemAirbyte Integration Guide
DataXPlugin-basedAlibaba open-source tool, suitable for batch data syncDataX Integration Guide
Apache FlinkFlink ConnectorStream processing engine for real-time writes to LakehouseFlink Connector
Apache SparkSpark ConnectorLarge-scale data reads and writes for Lakehouse tablesSpark Connector
LogstashLogstash ConnectorImport log data into LakehouseLogstash Integration Guide
BluepipeNative integrationReal-time CDC sync from Oracle to LakehouseBluepipe Sync Guide

BI and Visualization

The following BI tools are compatible with Lakehouse. Any BI tool supporting JDBC, ODBC, or MySQL protocol can connect directly and is not limited to the list below:

ToolConnectionDescriptionReference
FineBIJDBC / MySQLChina-based BI platformJDBC Connection · MySQL Protocol
TableauJDBCSuitable for complex visualizations and exploratory analysisTableau Connection Guide
Power BIMySQL ProtocolConnect via MySQL protocolPower BI Connection Guide
Apache SupersetSQLAlchemyOpen-source, suitable for self-service analyticsSuperset Connection Guide
MetabaseJDBCOpen-source, easy to deploy, suitable for small and medium teamsMetabase Connection Guide
Apache ZeppelinJDBCNotebook-style data explorationZeppelin Connection Guide
RathJDBCOpen-source intelligent analytics with automatic insight supportRath Connection Guide
StreamlitPython SDKRapidly build data apps for data science teamsStreamlit Connection Guide

Transformation and Compute Engines

The following data transformation tools and compute engines are compatible with Lakehouse:

ToolConnectionDescriptionReference
dbtdbt-clickzetta adapterData modeling and transformation, supports Dynamic Table materializationdbt Integration Guide
Apache SparkSpark ConnectorLarge-scale batch processing and machine learningSpark Connector
Apache FlinkFlink ConnectorReal-time stream processingFlink Connector

The dbt documentation series covers all scenarios from quick start to migration practice: jaffle-shop experience, Snowflake/BigQuery migration, incremental processing, real-time pipelines, and data quality testing. See DBT Practice Series.


AI and Machine Learning

The following AI frameworks and platforms work with Lakehouse for vector storage, RAG applications, and AI workflows:

ToolIntegrationDescriptionReference
LangChainPython SDKVector storage and RAG application developmentLangChain Integration
LlamaIndexPython SDKData indexing and retrievalLlamaIndex Integration
DifyMCP Server / SDKVector database + file storageDify Integration Overview
n8nMCP ServerUnified AI workflowsn8n Integration
MindsDBJDBCML/LLM modeling and prediction on Lakehouse dataMindsDB Integration
DatusMCP ServerData engineering agentDatus Integration
ZillizJoint solutionVector database joint solutionZilliz Joint Solution
Unstructured.ioSDKUnstructured document parsing and vectorizationUnstructured.io Integration

Lakehouse also provides an MCP Server that can be called by any AI Agent that supports the MCP protocol.


LLM Providers

Singdata AI Gateway provides unified access to mainstream LLM providers, including model routing, API key management, and usage tracking. After you connect through AI Gateway, products that call AI capabilities, such as Data Engineering Agent, Data Analytics Agent, and Lakehouse AI Functions, do not need separate model connections.

ProviderDescription
OpenAIGPT-4o, o1, and Embeddings
AnthropicClaude 3.5 / 4 series
Azure OpenAIEnterprise deployment with tenant-isolated data
Google Vertex AIGemini, PaLM, and Embeddings
Alibaba Cloud BailianQwen series for China-compliant deployments
VolcengineDoubao series for China-compliant deployments
Self-hostedPrivate deployments such as Ollama and vLLM

AI Gateway acts as a unified enterprise LLM egress layer. You can switch model providers without changing application code. See AI Gateway.


AI Agents

The following Agents can operate Lakehouse and Studio directly through cz-cli or MCP Server for data engineering and data analysis tasks.

cz-cli is the recommended integration path because it provides a deterministic command interface for Sub-Agents, CI/CD, and automation. Any AI coding Agent that supports shell tool calls, including the examples below, can use cz-cli to operate Lakehouse and Studio.

Built-in Agents

AgentDescriptionReference
Data Engineering AgentBuild and operate data pipelines, task schedules, and DAG orchestration through natural languageData Engineering Agent
Data Analytics AgentQuery, analyze, forecast, and build dashboards through natural languageData Analytics Agent

AI Coding Agents Integrated via cz-cli

The following Agents can operate Lakehouse and Studio through cz-cli:

AgentDescription
OpenClawSupports cz-cli tool calls for data engineering automation
Hermes AgentSupports cz-cli tool calls for Lakehouse data pipeline management
Claude Code (Anthropic)Supports cz-cli tool calls for code generation and data engineering
Kiro (Amazon)Supports cz-cli tool calls for data engineering and analysis tasks
Kilo CodeSupports cz-cli tool calls for data pipeline development
Codex (OpenAI)Supports cz-cli tool calls for SQL generation and data engineering

Any AI Agent that supports shell tool calls can integrate through cz-cli. See cz-cli Agent Integration.

AI Platforms Integrated via MCP Server

PlatformDescriptionReference
DifyAI workflow platform that calls Lakehouse data and vector capabilitiesDify Integration
n8nAutomation workflow platform for AI and data workflowsn8n Integration
DatusData engineering agentDatus Integration
Other MCP-compatible AgentsAny Agent that supports the MCP protocol can connectMCP Server

Programmatic Interfaces

Lakehouse provides the following native programming interfaces and SDKs:

InterfaceLanguageDescriptionReference
JDBC DriverJava / JVMStandard JDBC interface, compatible with all JVM ecosystemsJDBC Driver
MySQL ProtocolAllNo client dependency, compatible with MySQL ecosystemMySQL Protocol Connection
Python SDKPythonPEP 249 compatible, supports batch/real-time writesPython SDK
Java SDKJavaSupports BulkLoad and real-time stream writesJava SDK Batch Upload
SQLAlchemyPythonStandard Python ORM / SQL toolkitSQLAlchemy Connection
ZettaParkPythonDataFrame API similar to pandas and PySpark; translates Python operations into distributed SQL executionZettaPark Guide
cz-cliShellCommand-line client: SQL + Studio Tasks + AI Agentcz-cli Guide

SQL Clients and Database Management Tools

These tools connect via JDBC or MySQL protocol, compatible with standard SQL operations:

ToolConnectionDescriptionReference
DBeaverJDBCOpen-source and free, community edition is sufficient, suitable for daily queries and data explorationDBeaver Connection Guide
DataGripJDBCJetBrains product with strong code completion and SQL analysisDataGrip Connection Guide
SQL Workbench/JJDBCLightweight, basic SQL executionSQL Workbench/J Connection Guide
NavicatMySQL ProtocolVisual management with intuitive operationsNavicat Connection Guide

Data Lake Formats

Lakehouse is natively based on Apache Iceberg — tables are stored in Iceberg format, supporting time travel, partition evolution, schema evolution, and cross-engine access. Delta Lake and Hudi formats are also supported via external tables:

FormatRelationshipDescriptionReference
Apache IcebergNative formatUnderlying format for all Lakehouse tables, cross-engine accessSpark + Iceberg Analytics
Delta LakeExternal tableOpen table format from the Databricks ecosystemDelta Lake External Table
Apache HudiExternal tableOpen table format optimized for streaming writesHudi External Table

Federated Queries: Query Iceberg tables in Hive, Databricks, and Snowflake OpenCatalog directly via External Catalog, without data migration. See Federated Query.


Modern Data Stack

The following solution combinations show how to build a complete data platform using Lakehouse and ecosystem tools:

SolutionToolchainReference
ELT-orientedAirbyte → Lakehouse → dbt → MetabaseELT Modern Data Stack
Analytics-orientedLakehouse ← dbt → SupersetAnalytics Modern Data Stack
BI + AILakehouse + ZillizBI + AI Joint Solution