Apache Kafka

Ver: 2.0.0

Apache Kafka is a stream-processing software platform which aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

Connect Apache Kafka with LogicHub

  1. Navigate to Automations > Integrations.
  2. Search for Apache Kafka.
  3. Click Details, then the + icon. Enter the required information in the following fields.
    • Label: Enter a connection name.
    • Reference Values: Define variables here to templatize integration connections and actions. For example, you can use https://www.{{hostname}}.com where, hostname is a variable defined in this input. For more information on how to add data, see 'Add Data' Input Type for Integrations.
    • Verify SSL: Select option to verify connecting server's SSL certificate (Default is Verify SSL Certificate).
    • Remote Agent: Run this integration using the LogicHub Remote Agent.
    • Server IP or Hostname for Kafka: Server address for Apache Kafka.
    • Port Number for Kafka: Server port to connect to Apache Kafka.
    • API version for Kafka: api_version for Apache Kafka. Some example : [(0, 10, 1), (0, 10, 0), (0, 10), (0, 9),
      (0, 8, 2), (0, 8, 1), (0, 8, 0)].
    • Username: Username to connect to Apache Kafka.
    • Password: Password to connect to Apache Kafka.
  4. After you've entered all the details, click Connect.

Actions for Apache Kafka

Publish feed to Kafka

Publish a feed (message) to the given topic in Apache Kafka.

Input Field

Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.

Input NameDescriptionRequired
Topic of KafkaColumn name from parent table that contains Topic.Required
Feed for KafkaColumn name from parent table that contains Feed.Required

Output

A JSON object containing multiple rows of results:

  • has_error: True/False
  • error: message/null
  • result: Successfully published message
3360

Get feeds from Kafka

Get feeds from the topic in Apache Kafka.

Input Field

Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.

Input NameDescriptionRequired
Topic of KafkaColumn name from parent table that contains Topic.Required
Limit of rowsLimit of records to be fetched.Optional

Output

A JSON object containing multiple rows of results:

  • has_error: True/False
  • error: message/null
  • result: feed
3360

Release Notes

  • v2.0.0 - Updated architecture to support IO via filesystem

© 2017-2021 LogicHub®. All Rights Reserved.