Table (Source)
Description
Table source component is automatically generated based on the Flink Table API integration definition. The name of the component will be Integration-name Table. You can only ingest whole database tables or files using this component; check the Table API integration for more information.
Parameters and configuration
| Name | Description |
|---|---|
| Table | Table from which records will be read and processed |
Advanced parameters
| Name | Description |
|---|---|
| Event time | Expression which evaluates to the time when the event was created, expressed as an Instant (UTC) datatype, not processing or ingestion time. Read 'Additional considerations' section for more information. |
| Max out-of-orderness | The maximum amount of time an event is allowed to be late before being ignored when computing the result for time-based stream transformations: aggregates in time windows and joins. To read more about this mechanism see Flink documentation. |
| Idleness | The time period after which partition is marked as idle if no events are received from it. To read more about this mechanism see Flink documentation. |
Additional considerations
Read here to learn more about Instant data type. If provided as a numeric value rather than Instant, it must be in epoch milliseconds (not seconds); a Long is the most natural data type for representing this UTC millisecond value.
caution
Getting event time wrong can lead to subtle errors in time-based logic that are difficult to diagnose - if such logic behaves unexpectedly, this should be the first thing to verify.