Skip to main content
Version: Current

Integrations

Nussknacker allows to reach out to the data and services provided via streaming and queuing systems, consumable computer services, databases, ML deployment platforms, data formats and catalogues. Integration definition allows to define shared integration parameters only once for multiple components. You can see what kind of components will be generated on the integration tile in the Integrations view. Nussknacker will automatically generate components relevant to the given integration, for example source, enricher or sink and will add them to the Component Palette in Designer.

Configuring a new integration​

Open Integrations from the Designer's side menu (the view lives at the /configurator path), find the integration tile and click Add new. Each tile lists the kinds of components the integration generates (Source, Sink, Enricher).

note

The Integrations view is provided by the Integrations (configurator) Designer extension. It is available in Nussknacker Cloud and in Enterprise deployments, including the Docker Compose installation bundle. If the side menu shows no Integrations item (for example in the Open Source edition), configure integrations in configuration files - see the Open Source version integrations documentation.

Supported integrations​

Message brokers​

The following queueing and streaming systems are currently supported:

IntegrationType(s)
Aiven KafkaSource / Sink
Azure Event HubsSource / Sink
Confluent CloudSource / Sink
(generic) KafkaSource / Sink
MQTTSource / Sink
RedpandaSource / Sink
Table (Flink Table API)*Source / Sink

*Check Flink Table API section for more details.

Databases​

Integrations with database systems are implemented using multiple and diverse mechanisms, which results in different types of components being available. The table below summarizes different integration mechanisms and component types that they yield.

IntegrationComponentsComments
plain JDBCEnricherNo need to provide data type mappings between target database and data types used by Nussknacker
Flink connector available (Table API is used)Source / SinkThe integration definition includes data type mappings between the database and Flink
Flink catalog support availableEnricher / Source / SinkNo need to provide data type mappings

The following database systems are supported:

IntegrationType(s)
ClickhouseSource / Sink
MariaDBEnricher / Source
MySQLEnricher / Source / Sink
MS SQL Server (experimental)Enricher / Source
OracleEnricher / Source
PostgreSQLEnricher / Source / Sink
RedisEnricher (Key-Value Store)
RedshiftEnricher
SnowflakeEnricher
Table (Flink Table API)*Source / Sink

*Check Flink Table API section for more details.

MS SQL Server is marked as experimental in the integrations catalog.

The Source listed for MariaDB, MS SQL Server and Oracle is the SQL source; these databases have no Table source or sink.

Services:​

IntegrationType(s)
OpenAPIEnricher

ML Models Registries:​

IntegrationType(s)
Databricks Unity CatalogEnricher
MLflowEnricher

Filesystems​

IntegrationType(s)
Table (Flink Table API)*Source / Sink

*Check Flink Table API section for more details.

Data lakehouse (Apache Iceberg)​

IntegrationType(s)
AWS GlueSource / Sink

See AWS Glue (Iceberg REST catalog) for details.

The Flink's Table API provides a relational abstraction for unified stream and batch processing, allowing to define logical tables in Flink that map to data stored in external systems such as databases, message queues or file systems using SQL-like syntax. See Table API integration for more details.

AI Services​

AI Providers​

IntegrationType(s)
Amazon BedrockEnricher
AnthropicEnricher
Google AI GeminiEnricher
MistralAIEnricher
NvidiaEnricher
OpenAIEnricher
OpenAI-compatibleEnricher
Decision AI (Jev)Decision Model enricher

Vector databases​

IntegrationType(s)
QdrantEnricher
WeaviateEnricher

Miscalaneous​

IntegrationType(s)
MCP ServerN/A

Integration missing?​

If the provider or system of your choice is not supported yet, please contact us via info@nussknacker.io - we will handle the data types mappings and other technical details for you.