v0.16.0

Added

• [SQL] Support for user-defined functions implemented in SQL (#1714)
• [Kafka] Allow specifying Kafka headers as part of output Kafka connector
  config (#1718)
• [SQL] Support for LEAD/LAG window aggregates (#1706)
• [SQL] Support for WATERMARK table column annotations (#1694)
• Added a new config flag tcp_metrics_exporter which allows to inspect
  the pipeline metrics for debugging purposes with the metrics-observer
  CLI. (#1710)
• Ability to selectively enable storage per-pipeline. (#1692)

Changed

• [Docs] Re-organize documentation sections (#1734)

v0.15.0

[0.15.0] - 2024-04-30

Added

• Initial support for Avro as an output format (#1673)

Changed

• Fixed a bug where sometimes the wrong profile for compilation is chosen by the manager. (#1696)

v0.14.0

Added

• [SQL] ARG_MIN, ARG_MAX aggregation functions
  (#1619)
• SQL: Support for ARRAYS_OVERLAP function (#1570)
• Connectors: Initial Delta Table output connector support
  (#1639)

Changed

• [SQL]: ARRAY_CONTAINS, ARRAY_POSITION, ARRAY_REMOVE functions
  for arguments of different types (#1636)

v0.13.0

Added

• Output buffering mechanism to consolidate multiple output
  updates over time.
  (#1558)
• pipeline-manager: allow programs to be compiled in unoptimized or
  optimized modes, which tradeoff compilation speed for runtime speed
  (#1524)
• WebConsole: Support NULL values on Data Inspection and Insertion page (#1392)

Changed

• pipeline-manager: connector transport configuration in the API is now
  strongly typed, and the transport names have the _input and _output
  suffix added (#1532)

Fixed

• WebConsole: State shows InQueue when program is empty (#1443)

v0.12.0

Changed

• dbsp: Major refactoring of the dbsp crate to improve compilation speed of SQL programs (#1516)

Added

• SQL: Support for GROUPING, GROUPING_ID, and GROUPING SETS (#1527)
• SQL: Support for aggregation functions: STDDEV,
  STDDEV_POP, STDDEV_SAMP (#1539)
• SQL: support for SORT_ARRAY function (#1490)
• SQL: support for ARRAY_REVERSE function (#1491)
• SQL: support for ARRAY_MAX, ARRAY_MIN functions (#1492)
• SQL: support for ARRAY_COMPACT function (#1493)
• SQL: support for ARRAY_PREPEND function (#1496)
• adapters: add an input connector for Amazon S3 (#1485)
• pipeline-manager: add option to pick a compilation profile (#1513)
• SQL: support for ARRAY_CONTAINS function (#1499)
• SQL: support for ARRAY_REPEAT function (#1497)
• SQL: support for ROUND(DOUBLE, digit), TRUNCATE(DOUBLE, digit) (#1512)
• SQL: support for ARRAY_REMOVE function (#1498)
• SQL: support for ARRAY_DISTINCT function (#1515)
• Added basic support to ingest and export data in the parquet format (#1510)
• WebConsole: Services page, Kafka service edit dialog (#1233)
• adapters: add an input connector for Amazon S3 (#1485)

v0.11.0

Added

• SQL: support for ARRAY_SIZE, ARRAY_LENGTH functions (#1489)
• SQL: support for ARRAY_POSITION function (#1480)

v0.10.0

Fixed

• WebConsole: Fix metrics values depend on polling period
• WebConsole: Improve WebConsole throughput and memory graphs (#491)

Added

• JDBC sink support via Debezium JDBC sink connector (#1384)
• SQL: Allow tables definitions to be retrieved from JDBC data sources (#1416)
• SQL: Support for EXP function (#1406)
• SQL: Support for ARRAY_APPEND function (#1419)
• SQL: support for TUMBLE streaming windows (#1404)
• API: endpoint to get a list of demo URLs (#1385)
• WebConsole: Add functionality that would enable setting up demos in the sandbox (#1321)
• WebConsole: Add Swagger link to navbar, make navbar more compact

Changed

• SQL: Illegal date literals and parsing illegal dates cause runtime
  errors instead of producing NULL (#1398)
• WebConsole: Various design adjustments
• WebConsole: Show the entire generated API key
• WebConsole: Improve login UX with AWS Cognito (redirect to desired page after successful login) (#1364)

v0.9.0

Added

• Compiler option for handling unquoted identifiers (#1360)
• SQL: Support for is_inf, is_nan and log methods for double (#1344)

Changed

• API: name and description are optional for connector PATCH endpoint. OpenAPI documentation for program, connector and service is more consistent. (#1315)
• SQL: check decimal precision while casting between decimal types (#1300)
• pipeline-manager: automatically queue programs for compilation (#1325)

Removed

• Remove the Python dbsp and feldera-api-client modules. In lieu of Python modules, direct requests to the REST API are now used. (#1338)

v0.8.0

Added

• API: Generalized upsert operation that allows partial modifications to table records (#1296)
• SQL: Functions on binary string (octet_length, position, overlay, substring) (#1264)
• pipeline-manager: add PUT endpoints for Programs, Pipelines, and Connectors (#1248)
• Documentation: Adding a markdown page for videos (#1126)
• SQL: Add hyperbolic functions (#1280)

Fixed

• pipeline-manager: fix a resource usage problem with http streaming under high load (#1257)
• SQL: Changed the semantics of integer arithmetic to match SQL standard (#1247)
• WebConsole: Connector name change doesn't reflect in the pipeline builder (#1238)
• WebConsole: UI sends HTTP request in an infinite loop (#1085)
• pipeline-manager: allow docs website to CORS allowed origins (#1285)

Changed

• Python demo and test scripts are standalone as they no longer depend on dbsp python library (#1230)
• pipeline-manager: update service endpoints to use names instead of IDs in URLs, and add PUT endpoint (#1263)
• SQL: Changed the semantics of integer arithmetic to match SQL standard (#1247)
• pipeline-manager: use names instead of IDs in API endpoints (#1214)
• WebConsole: use names instead of IDs as an API entity identifier (#1214)
• WebConsole: Bearer token expiration now triggers a background token refresh or redirects to a login page (#1100)
• Minimal rust version required to build feldera increased to 1.75 (was 1.73).

v0.7.0

Added

• WebConsole: Add ability to edit connector configuration as JSON
• SQL: Preliminary support for computations with bounded memory on unbounded
  streams (#1197)

Fixed

• SQL: Changed semantics of division to match SQL standard
  (#1201)
• WebConsole: display AWS Cognito username in user profile dropdown (#1077)