Apache Kafka
Ver: 2.0.0
Apache Kafka is a stream-processing software platform which aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.
Connect Apache Kafka with LogicHub
- Navigate to Automations > Integrations.
- Search for Apache Kafka.
- Click Details, then the + icon. Enter the required information in the following fields.
- Label: Enter a connection name.
- Reference Values: Define variables here to templatize integration connections and actions. For example, you can use https://www.{{hostname}}.com where, hostname is a variable defined in this input. For more information on how to add data, see 'Add Data' Input Type for Integrations.
- Verify SSL: Select option to verify connecting server's SSL certificate (Default is Verify SSL Certificate).
- Remote Agent: Run this integration using the LogicHub Remote Agent.
- Server IP or Hostname for Kafka: Server address for Apache Kafka.
- Port Number for Kafka: Server port to connect to Apache Kafka.
- API version for Kafka: api_version for Apache Kafka. Some example : [(0, 10, 1), (0, 10, 0), (0, 10), (0, 9),
(0, 8, 2), (0, 8, 1), (0, 8, 0)]. - Username: Username to connect to Apache Kafka.
- Password: Password to connect to Apache Kafka.
- After you've entered all the details, click Connect.
Actions for Apache Kafka
Publish feed to Kafka
Publish a feed (message) to the given topic in Apache Kafka.
Input Field
Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.
| Input Name | Description | Required |
|---|---|---|
| Topic of Kafka | Column name from parent table that contains Topic. | Required |
| Feed for Kafka | Column name from parent table that contains Feed. | Required |
Output
A JSON object containing multiple rows of results:
- has_error: True/False
- error: message/null
- result: Successfully published message
Get feeds from Kafka
Get feeds from the topic in Apache Kafka.
Input Field
Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.
| Input Name | Description | Required |
|---|---|---|
| Topic of Kafka | Column name from parent table that contains Topic. | Required |
| Limit of rows | Limit of records to be fetched. | Optional |
Output
A JSON object containing multiple rows of results:
- has_error: True/False
- error: message/null
- result: feed
Release Notes
v2.0.0- Updated architecture to support IO via filesystem
Updated about 1 year ago