Kafka Connect FileSystem Connector

Kafka Connect FileSystem Connector is a source connector for reading records from files in the file systems specified and load them into Kafka.

The connector supports:

  • Several sort of File Systems (FS) to use.
  • Dynamic and static URIs to ingest data from.
  • Policies to define rules about how to look for files and clean them up after processing.
  • File readers to parse and read different kind of file formats.

To learn more about the connector you can read this section and for more detailed configuration options you can read this other one.

Also, you can download the source code from here.