Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #136 from SpringQL/docs_include_markdown
docs: refactor lib/module document
- Loading branch information
Showing
9 changed files
with
63 additions
and
50 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,9 @@ | ||
<!-- markdownlint-disable MD041 --> | ||
|
||
Expression has two forms: | ||
|
||
1. Value expression, which is evaluated into an SqlValue from a row. | ||
2. Aggregate expression, which is evaluated into an SqlValue from set of rows. | ||
|
||
Since SQL parser cannot distinguish column reference and value expression, | ||
`ValueExprOrAlias` is used for value expressions excluding select_list. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,6 @@ | ||
<!-- markdownlint-disable MD041 --> | ||
SpringQL-core implementation. | ||
|
||
## High-level architecture diagram | ||
|
||
![High-level architecture diagram](https://raw.githubusercontent.com/SpringQL/SpringQL.github.io/main/static/img/springql-architecture.svg) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,12 @@ | ||
# Pipeline concept diagram | ||
|
||
Omit _Task Graph_ here. A pipeline has: | ||
|
||
- Stream | ||
- (native) Stream | ||
- Source/Sink Stream | ||
- Source Reader | ||
- Sink Writer | ||
- Pump | ||
|
||
![Pipeline concept diagram](https://raw.githubusercontent.com/SpringQL/SpringQL.github.io/main/static/img/pipeline-and-task-graph.svg) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
<!-- markdownlint-disable MD041 --> | ||
|
||
Stream Engine component. | ||
|
||
Responsible for pipeline management and execution. | ||
|
||
Stream engine has 2 executors: | ||
|
||
1. SQL executor | ||
2. Autonomous executor | ||
|
||
SQL executor receives commands from user interface to quickly change some status of a pipeline. | ||
It does not deal with stream data (Row, to be precise). | ||
|
||
Autonomous executor deals with stream data. | ||
|
||
Both SQL executor and autonomous executor instance run at a main thread, while autonomous executor has workers which run at different worker threads. | ||
|
||
## Entities inside Stream Engine | ||
|
||
![Entities inside Stream Engine](https://raw.githubusercontent.com/SpringQL/SpringQL.github.io/main/static/img/stream-engine-architecture-entity.svg) | ||
|
||
## Communication between entities | ||
|
||
Workers in AutonomousExecutor interact via EventQueue (Choreography-based Saga pattern). | ||
|
||
![Communication between entities](https://raw.githubusercontent.com/SpringQL/SpringQL.github.io/main/static/img/stream-engine-architecture-communication.svg) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters