Skip to main content
Version: 1.5

Flink components

Sources, sinks and custom transformations are based on Flink API. Access to various helpers is provided by FlinkCustomNodeContext. Special care should be taken to handle

  • lifecycle
  • exception handling properly

⚠️ Flink components should not extend Lifecycle - it won't be handled properly

Sources​

Source are defined with FlinkSource. In most cases (when you only pass one variable to initial Context) it's easier to use BaseFlinkSource.

Sinks​

Sinks are defined using FlinkSink. Again, BasicFlinkSink is provided for simple cases.

Custom transformers​

In Flink, custom transformation can arbitrarily change DataStream[Context], it's implemented with FlinkCustomStreamTransformation