Channels

Data access in StreamAnalytix is recognized by Channels that are built-in drag and drop operators to consume data from various data sources such as message queues, transactional databases, log files, and sensors for IOT data.

For Spark pipelines, you can use the following channels:

 Kafka

 Reads messages from Kafka.

 RabbitMQ

 Reads messages from RabbitMQ.

 MapRStreams

 Reads messages from MapR Streams.

 S3 Receiver

 Reads objects from Amazon S3.

 DFS Receiver

 Reads data from the Hadoop Distributed File System (HDFS).

 Socket

 Reads data via TCP socket connection.

 Data Generator

 Generates random data for testing.

 Custom

 Reads data from any source.

 

For Storm pipelines, you can use the following channels:

 Kafka

 Reads messages from Kafka.

 RabbitMQ

 Reads messages from RabbitMQ.

 MapRStreams

 Reads messages from MapR Streams.

 ActiveMQ

 Reads messages from ActiveMQ.

 Replay

 Replays failed messages.

 Custom

 Reads data from any source