Feature Roadmap

Owned by Jiyong Huang
Jun 20, 2023
2 min read

2023 Themes

  • Expressive: enhance the analytic ability of rules

  • Ecology: connect to more source/sink

  • Usability: improve user experience of rule dev-ops

  • Extensible: provide more extension points and languages

  • Deployment: support versatile deployment target

  • Stability & Performance

  • Test & Doc

1.8.0 release (Nov 2022 ~ Jan 2023)

  • New format/schema model

  • Format/schema extensions and static schema

  • General tensorflow lite function

  • Portable plugin hot reload/update

  • File source for stream and more formats

  • Rule auto restart strategy

  • Full data import/export API

  • Graph API: switch node

  • Graph API: script node

  • Video stream source

  • WASM function extension (beta)

  • Flow Editor: beta version shipped by manager

  • Statistic functions

1.9.0 release (Jan 2023 ~ Mar 2023)

Ecology:

  • Multiple connection of Neuron

  • MQTT source/sink decompression/compression

  • Httppull source and REST sink to support dynamic token.

Expressive:

  • Add coalesce function.

  • Add compress/decompress functions.

  • Add json convert functions

Extensible:

  • Python virtual env support

  • Allow to set portable init timeout

Usability:

  • Rule/configuration set import/export

1.10.0 release (Mar 2023 ~ May 2023)

Expressive:

  • Add rule_id and delay function.

  • Support expression for array index.

  • Add get_key_state function to get data in redis.

  • Support a lot of array and object manipulation functions.

  • Allow . to access object field.

  • Unnest function for array field.

  • Graph API support to refer to stream/table.

  • Graph API support to join lookup table.

Ecology:

  • EdgeX v3 support.

  • File sink supports various types, rolling and compression.

  • Kafka sink support.

  • SQL source/sink connection limit.

  • Redis sink writes to multiple keys.

  • Source to support array payload.

  • Sink common properties: fields, dataField.

  • Sink batch write support.

Extensible:

  • Refactor wasmedge support

Usability:

  • Rule scheduling

Test & Doc:

  • Add ci for go-lint

  • Add ci for codecov

  • New doc section for examples/usecases.

1.11.0 release (Jun 2023 ~ Aug 2023)

Expressive:

  • SQL wildcard extended syntax

  • Event time for continuous query

  • Sliding window with delay trigger

  • Sliding window with conditional trigger

  • Session window partition support

  • Single quote string literal

  • More array/object functions

  • Support limit clause

  • Trigger meta functions

Performance:

  • Stream with schema: JSON encode/decode performance tune.

Ecology:

  • File source parallel read

  • Sink cache resume in a separate queue

Usability:

  • Rule schedule range

  • Sampling rule data

  • Dynamic configuration update

1.12.0 release (Sep 2023 ~ Nov 2023)

Expressive:

  • Schema inference

  • Sinks in order

Ecology:

  • TDEngine v3 support

  • Websocket

Usability:

  • Rule group

  • Explain statement

Deployment:

  • Android deployment

Test & Doc:

  • Usage scenarios

v2 release (TBD, Dec 2023 or 1Q 2024)

  • Resource manager

  • Table observation

  • Refactor plugin API

  • Static module system

  • Portable plugin enhancements

  • Schema improvement

  • Incremental window

  • Performance benchmark