package process
- Alphabetic
- Public
- All
Type Members
- abstract class AbstractLazyParameterInterpreterFunction extends AbstractRichFunction with LazyParameterInterpreterFunction
- abstract class AbstractOneParamLazyParameterFunction[T <: AnyRef] extends AbstractRichFunction with OneParamLazyParameterFunction[T]
-
trait
BasicFlinkSink extends FlinkSink with ExplicitUidInOperatorsSupport
This is basic Flink sink, which just uses single expression from sink definition
-
trait
BasicFlinkSource[Raw] extends FlinkSource with FlinkIntermediateRawSource[Raw]
Typical source with methods specific for Flink, user has only to define Source function.
Typical source with methods specific for Flink, user has only to define Source function.
- Raw
- type of raw event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).
- class FlinkContextInitializingFunction[Raw] extends RichMapFunction[Raw, Context]
-
trait
FlinkCustomJoinTransformation extends AnyRef
Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches
Join functionality is not complete, many things are not implemented yet - validation context passed to both BranchExpression and JoinContextTransformationDef should be taken from incoming branches - cannot test&generate test data from other branches
Additionally, a lot of refactoring should be done - removing tree structures - should CustomNode and Join be sth different in ConfigCreator
Some important TODOs are marked with TODO JOIN
- case class FlinkCustomNodeContext(jobData: JobData, nodeId: String, timeout: FiniteDuration, convertToEngineRuntimeContext: (RuntimeContext) ⇒ EngineRuntimeContext, lazyParameterHelper: FlinkLazyParameterFunctionHelper, signalSenderProvider: FlinkProcessSignalSenderProvider, exceptionHandlerPreparer: (RuntimeContext) ⇒ ExceptionHandler, globalParameters: Option[NkGlobalParameters], validationContext: Either[ValidationContext, Map[String, ValidationContext]], typeInformationDetection: TypeInformationDetection, componentUseCase: ComponentUseCase) extends Product with Serializable
- trait FlinkCustomStreamTransformation extends AnyRef
-
trait
FlinkIntermediateRawSource[Raw] extends ExplicitUidInOperatorsSupport
Source with typical source stream trasformations:
Source with typical source stream trasformations:
- adds source using provided SourceFunction (here raw source produces raw data) 2. sets UID 3. assigns timestamp and watermarks 4. initializes Context that is streamed within output DataStream (here raw data are mapped to Context) It separates raw event data produced by SourceFunction and data released to the stream as Context variables. By default it uses basic "single input value" implementation of initializer, see BasicContextInitializer.
- Raw
- type of raw event that is generated by flink source function.
- class FlinkLazyParameterFunctionHelper extends Serializable
- class FlinkProcessSignalSenderProvider extends AnyRef
-
trait
FlinkSink extends Sink with Serializable
Implementations of this trait can use LazyParameters
-
trait
FlinkSource extends Source
Source with methods specific for Flink
-
trait
FlinkSourceTestSupport[Raw] extends SourceTestSupport[Raw]
Support for test mechanism for typical flink sources.
Support for test mechanism for typical flink sources.
- Raw
- type of raw event that is generated by flink source function. This is needed to handle e.g. syntax suggestions in UI (in sources with explicite @MethodToInvoke).
- class LazyParameterFilterFunction extends AbstractOneParamLazyParameterFunction[Boolean] with FilterFunction[Context]
-
trait
LazyParameterInterpreterFunction extends AnyRef
LazyParameterInterpreter is used to evaluate LazyParamater[T].
LazyParameterInterpreter is used to evaluate LazyParamater[T]. It has to be tied to operator's lifecycle to avoid leaking of resources. Because of this if you need to evaluate parameter, you always need to mixin this trait. Please note that exception thrown during LazyParameter evaluation should be handled - e.g. be wrapping in handling/collect methods
- class LazyParameterMapFunction[T <: AnyRef] extends AbstractOneParamLazyParameterFunction[T] with FlatMapFunction[Context, ValueWithContext[T]]
- trait OneParamLazyParameterFunction[T <: AnyRef] extends LazyParameterInterpreterFunction
- abstract class RichLifecycleFunction extends AbstractRichFunction
- class RichLifecycleMapFunction[T, R] extends RichLifecycleFunction with MapFunction[T, R]
- case class SignalSenderKey(id: String, klass: Class[_]) extends Product with Serializable
Value Members
- object FlinkCustomStreamTransformation