• No products in the cart.

Students

Lectures

82

Course Duration

Unlimited Duration

Updated

October 13, 2022

Kafka Connect is a free, open-source component of Apache Kafka® that works as a centralized data hub for simple data integration between databases, key-value stores, search indexes, and file systems. The information in this page is specific to Kafka Connect for Confluent Platform.
Profile Photo
Annapurna Singh
0
24

Courses

490

Students

Kafka Connect is a tool for scalably and reliably streaming data between Apache Kafka® and other data systems. It makes it simple to quickly define connectors that move large data sets in and out of Kafka. Kafka Connect can ingest entire databases or collect metrics from all your application servers into Kafka topics, making the data available for stream processing with low latency. An export connector can deliver data from Kafka topics into secondary indexes like Elasticsearch, or into batch systems–such as Hadoop for offline analysis.


Kafka Connect provides the following benefits:


  • Data-centric pipeline: Connect uses meaningful data abstractions to pull or push data to Kafka.
  • Flexibility and scalability: Connect runs with streaming and batch-oriented systems on a single node (standalone) or scaled to an organization-wide service (distributed).
  • Reusability and extensibility: Connect leverages existing connectors or extends them to fit your needs and provides lower time to production.


Kafka Connect is focused on streaming data to and from Kafka, making it simpler for you to write high quality, reliable, and high performance connector plugins. Kafka Connect also enables the framework to make guarantees that are difficult to achieve using other frameworks. It is an integral component of an ETL pipeline, when combined with Kafka and a stream processing framework.

    • Ingest Data from Upstream Systems Unlimited
    • Confluent Cloud Managed Connectors Unlimited
    • How Kafka Connect Works Unlimited
    • Streaming Pipelines Unlimited
    • Writing to Datastores from Kafka Unlimited
    • Evolve Processing from Old Systems to New Unlimited
    • Make Systems Real Time Unlimited
    • Why Not Write Your Own Integrations? Unlimited
    • Start Kafka in Minutes with Confluent Cloud Unlimited
    • Hands On: Getting Started with Kafka Connect Unlimited
    • Confluent Cloud Unlimited
    • Create the orders Topic Unlimited
    • Create a Data Generator with Kafka Connect Unlimited
    • Connectors Unlimited
    • Confluent Cloud Managed Connectors Unlimited
    • Self-Managed Kafka Connect Unlimited
    • Kafka Connect Workers Unlimited
    • Managing a Kafka Connect Cluster Unlimited
    • Inside Kafka Connect Unlimited
    • Connectors Unlimited
    • Add a Connector Instance with the REST API Unlimited
    • Add a Connector Instance with ksqlDB Unlimited
    • Add a Connector Instance with the Console UI Unlimited
    • What Is the Role of the Connector? Unlimited
    • Converters Serialize/Deserialize the Data Unlimited
    • Serialization and Schemas Unlimited
    • Converters Specified for Key and Value Unlimited
    • Single Message Transforms Unlimited
    • Obtaining Plugins and Writing Your Own Unlimited
    • Hands On: Use SMTs with a Managed Connector Unlimited
    • Hands On: Confluent Cloud Managed Connector API Unlimited
    • Exercise Environment Preparation Steps Unlimited
    • Confluent Cloud Managed Connector API exercise steps Unlimited
    • Stream sample data to a Kafka topic using the DatagenSource connector Unlimited
    • Hands On: Confluent Cloud Managed Connector CLI Unlimited
    • Exercise Environment Preparation Steps Unlimited
    • Confluent Cloud Managed Connector CLI exercise steps Unlimited
    • Stream sample data to a Kafka topic using the DatagenSource connector Unlimited
    • Deploying Kafka Connect Unlimited
    • Tasks Are the Unit of Parallelism and Scale Unlimited
    • Connect Worker Unlimited
    • Kafka Connect Distributed Mode Unlimited
    • Kafka Connect Scalability Unlimited
    • Multiple Workers vs. Multiple Clusters Unlimited
    • Kafka Connect Standalone Mode Unlimited
    • Kafka Connect Images on Docker Hub Unlimited
    • Adding Connectors to a Container Unlimited
    • Add a Connector Instance with ksqlDB Unlimited
    • Build a New Container Image Unlimited
    • Add Connector Instance at Container Launch Unlimited
    • Exercise Environment Preparation Steps Unlimited
    • Running a Self-Managed Connector with Confluent Cloud exercise steps Unlimited
    • Stream data from MySql to a Kafka Topic Unlimited
    • Stream Data from Kafka to Elasticsearch Unlimited
    • Stream Data from Kafka to Neo4j Unlimited
    • Kafka Connect’s REST API Unlimited
    • Getting Basic Connect Cluster Information Unlimited
    • Listing Installed Plugins Unlimited
    • Formatting the Result of the Installed Plugin List Unlimited
    • Create a Connector Instance Unlimited
    • List Connector Instances Unlimited
    • Inspect Config and Status for a Connector Unlimited
    • Delete a Connector Unlimited
    • Update a Connector Unlimited
    • Inspect Task Details Unlimited
    • Restart the Connector and Tasks Unlimited
    • Pause and Resume a Connector Unlimited
    • Display All of a Connector’s Tasks Unlimited
    • Get a List of Topics Used by a Connector Unlimited
    • Error Handling in Kafka Connect Unlimited
    • Serialization Challenges – Wrong Converter Unlimited
    • Serialization Challenges – Multiple Formats Unlimited
    • Error Tolerances – Fail Fast (Default) Unlimited
    • Error Tolerances – Dead Letter Queue Unlimited
    • Reprocessing the Dead Letter Queue Unlimited
    • Manual DLQ Processing Unlimited
    • Troubleshooting Kafka Connect Unlimited
    • A Troubleshooting Scenario Unlimited
    • Getting Task Status Unlimited
    • The Log Is the Source of Truth Unlimited
    • Task is being killed and will not recover until manually restarted Unlimited
    • Dynamic Log Configuration Unlimited

Popular Courses

top
Managed by Ernesto.net © 2021. All rights reserved.