跳到主要内容

Roadmap 2023

提示

This is Databend Roadmap in 2023 🚀, sync from the #9448

After a full year of research and development in 2022, the functionality and stability of Databend were significantly enhanced, and several users began using it in production. Databend has helped them greatly reduce costs and operational complexity issues.

This is Databend Roadmap in 2023 (discussion).

See also:

Main tasks

Features

TaskStatusComments
Update#9261DONE
PrivilegesIN PROGRESS
Alter tableIN PROGRESS
Window functionPLAN
Lambda function and high-order functionsPLAN
TimestampTz data typePLAN
Materialized viewPLAN
Support SET_VAR hints#8833PLAN
Parquet readerPLAN
DataFramePLAN
Data Sharing(community version)IN PROGRESS
Concurrent query enhancePLAN
Distributed COPY#8594PLAN
Support Decimal data type#2931PLANhigh-priority

Improvements

TaskStatusComments
New expression#9411DONE
Error messagePLAN

Planner

TaskStatusComments
Scalar expression normalizationPLAN
Column constraint frameworkPLAN
Functional dependency framework#7438PLAN
Join reorderIN PROGRESS
CBOIN PROGRESS
Support TPC-DSPLAN
Support optimization tracingPLANEasy to debug/study.

Cache

TaskStatusComments
Unified cache layerIN PROGRESS
Meta data cacheIN PROGRESS
Index data cacheIN PROGRESS
Block data cachePLAN

Data Storage

TaskStatusComments
Fuse engine re-clusteringPLAN
Fuse engine orphan data cleanupPLAN
Fuse engine segment treePLANSupport large dataset(PB) in one table

Distributed Query Execution

TaskStatusComments
Visualized profilingIN PROGRESS
Aggregation spillingIN PROGRESS

Resource Quota

TaskStatusComments
Session-level quota control (CPU/Memory)IN PROGRESS
User-level quota control (CPU/Memory)PLAN
TaskStatusComments
JSON indexingPLANhigh-priority
Fulltext index#3915PLANhigh-priority
Array functions#7931PLANhigh-priority
Faiss index#9699PLAN

LakeHouse

TaskStatusComments
Apache HiveIN PROGRESS
Apache IcebergIN PROGRESS
Delta LakeIN PROGRESS
Querying external storage(Parquet)IN PROGRESS

Integrations

TaskStatusComments
Dbt integrationIN PROGRESS
Airbyte integrationIN PROGRESS
Datadog Vector integrate with Rust-driverIN PROGRESS
Datax integrate with Java-driverIN PROGRESS
CDC with FlinkPLAN
CDC with KafkaPLAN

Meta

TaskStatusComments
Jepsen testIN PROGRESS
Store membership in raftPLAN
Nonblocking snapshot buildingPLAN
Snapshot file format implPLAN
Upgrade on-disk store formatPLAN

Testing

TaskStatusComments
SQLlogic TestIN PROGRESSSupports more test cases
SQLancer TestIN PROGRESSSupports more type and more cases
Fuzzer TestPLAN

Releases