82
Unlimited Duration
October 13, 2022


Courses
Students
Kafka Connect is a tool for scalably and reliably streaming data between Apache Kafka® and other data systems. It makes it simple to quickly define connectors that move large data sets in and out of Kafka. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export connector can deliver data from Kafka topics into secondary indexes like Elasticsearch, or into batch systems–such as Hadoop for offline analysis.
Kafka Connect provides the following benefits:
- Data-centric pipeline: Connect uses meaningful data abstractions to pull or push data to Kafka.
- Flexibility and scalability: Connect runs with streaming and batch-oriented systems on a single node (standalone) or scaled to an organization-wide service (distributed).
- Reusability and extensibility: Connect leverages existing connectors or extends them to fit your needs and provides lower time to production.
Kafka Connect is focused on streaming data to and from Kafka, making it simpler for you to write high quality, reliable, and high performance connector plugins. Kafka Connect also enables the framework to make guarantees that are difficult to achieve using other frameworks. It is an integral component of an ETL pipeline, when combined with Kafka and a stream processing framework.
-
- Ingest Data from Upstream Systems Unlimited
- Confluent Cloud Managed Connectors Unlimited
- How Kafka Connect Works Unlimited
- Streaming Pipelines Unlimited
- Writing to Datastores from Kafka Unlimited
- Evolve Processing from Old Systems to New Unlimited
- Make Systems Real Time Unlimited
- Why Not Write Your Own Integrations? Unlimited
- Start Kafka in Minutes with Confluent Cloud Unlimited
-
- Hands On: Getting Started with Kafka Connect Unlimited
- Confluent Cloud Unlimited
- Create the orders Topic Unlimited
- Create a Data Generator with Kafka Connect Unlimited
- Connectors Unlimited
- Confluent Cloud Managed Connectors Unlimited
- Self-Managed Kafka Connect Unlimited
- Kafka Connect Workers Unlimited
- Managing a Kafka Connect Cluster Unlimited
- Hands On: Use SMTs with a Managed Connector Unlimited
- Hands On: Confluent Cloud Managed Connector CLI Unlimited
- Exercise Environment Preparation Steps Unlimited
- Confluent Cloud Managed Connector CLI exercise steps Unlimited
- Stream sample data to a Kafka topic using the DatagenSource connector Unlimited
- Kafka Connect Images on Docker Hub Unlimited
- Adding Connectors to a Container Unlimited
- Add a Connector Instance with ksqlDB Unlimited
- Build a New Container Image Unlimited
- Add Connector Instance at Container Launch Unlimited
- Kafka Connect’s REST API Unlimited
- Getting Basic Connect Cluster Information Unlimited
- Listing Installed Plugins Unlimited
- Formatting the Result of the Installed Plugin List Unlimited
- Create a Connector Instance Unlimited
- List Connector Instances Unlimited
- Inspect Config and Status for a Connector Unlimited
- Delete a Connector Unlimited
- Update a Connector Unlimited
- Inspect Task Details Unlimited
- Restart the Connector and Tasks Unlimited
- Pause and Resume a Connector Unlimited
- Display All of a Connector’s Tasks Unlimited
- Get a List of Topics Used by a Connector Unlimited
- Troubleshooting Kafka Connect Unlimited
- A Troubleshooting Scenario Unlimited
- Getting Task Status Unlimited
- The Log Is the Source of Truth Unlimited
- Task is being killed and will not recover until manually restarted Unlimited
- Dynamic Log Configuration Unlimited