Version 1.1.30
Plugin type:
Sink
Enterprise support:
Confluent supported
Verification:
Confluent built
Author:
Confluent, Inc.
DocumentationThird Party Licenses

HDFS 3 Sink Connector

The HDFS 3 connector allows you to export data from Kafka topics to HDFS 3.x files in a variety of formats and integrates with Hive to make data immediately available for querying with HiveQL. The connector periodically polls data from Kafka and writes them to an HDFS 3.x cluster.

Installation

Confluent Hub CLI installation

Use the Confluent Hub client to install this connector with:
confluent-hub install confluentinc/kafka-connect-hdfs3:1.1.30
Shared.Button.Copy

Download installation

Or download the ZIP file and extract it into one of the directories that is listed on the Connect worker's plugin.path configuration properties. This must be done on each of the installations where Connect will be run.
By downloading you agree to the terms of use and software license agreement.

Configure an instance of your connector

Once installed, you can then create a connector configuration file with the connector's settings, and deploy that to a Connect worker.See here for more detailed instructions.

Support

This connector is a Confluent Commercial Connector and supported by Confluent. The requires purchase of a Confluent Platform subscription, including a license to this Commercial Connector. You can also use this connector for a 30-day trial without an enterprise license key - after 30 days, you need to purchase a subscription. Please contact your Confluent account manager for details.