Konektor wastafel Amazon S3

Contoh ini menunjukkan cara menggunakan konektor wastafel Amazon S3 Confluent dan untuk membuat konektor wastafel Amazon S3 AWS CLI di Connect. MSK

1. Salin berikut ini JSON dan tempel di file baru. Ganti string placeholder dengan nilai yang sesuai dengan string koneksi server bootstrap MSK klaster Amazon Anda dan subnet dan grup keamanan cluster. IDs Untuk informasi tentang cara menyiapkan peran eksekusi layanan, lihatPeran dan kebijakan IAM untuk MSK Connect.

   {
       "connectorConfiguration": {
           "connector.class": "io.confluent.connect.s3.S3SinkConnector",
           "s3.region": "us-east-1",
           "format.class": "io.confluent.connect.s3.format.json.JsonFormat",
           "flush.size": "1",
           "schema.compatibility": "NONE",
           "topics": "my-test-topic",
           "tasks.max": "2",
           "partitioner.class": "io.confluent.connect.storage.partitioner.DefaultPartitioner",
           "storage.class": "io.confluent.connect.s3.storage.S3Storage",
           "s3.bucket.name": "my-test-bucket"
       },
       "connectorName": "example-S3-sink-connector",
       "kafkaCluster": {
           "apacheKafkaCluster": {
               "bootstrapServers": "<cluster-bootstrap-servers-string>",
               "vpc": {
                   "subnets": [
                       "<cluster-subnet-1>",
                       "<cluster-subnet-2>",
                       "<cluster-subnet-3>"
                   ],
                   "securityGroups": ["<cluster-security-group-id>"]
               }
           }
       },
       "capacity": {
           "provisionedCapacity": {
               "mcuCount": 2,
               "workerCount": 4
           }
       },
       "kafkaConnectVersion": "2.7.1",
       "serviceExecutionRoleArn": "<arn-of-a-role-that-msk-connect-can-assume>",
       "plugins": [
           {
               "customPlugin": {
                   "customPluginArn": "<arn-of-custom-plugin-that-contains-connector-code>",
                   "revision": 1
               }
           }
       ],
       "kafkaClusterEncryptionInTransit": {"encryptionType": "PLAINTEXT"},
       "kafkaClusterClientAuthentication": {"authenticationType": "NONE"}
   }

2. Jalankan AWS CLI perintah berikut di folder tempat Anda menyimpan JSON file di langkah sebelumnya.

   aws kafkaconnect create-connector --cli-input-json file://connector-info.json

   Berikut ini adalah contoh output yang Anda dapatkan ketika Anda menjalankan perintah dengan sukses.

   {
       "ConnectorArn": "arn:aws:kafkaconnect:us-east-1:123450006789:connector/example-S3-sink-connector/abc12345-abcd-4444-a8b9-123456f513ed-2", 
       "ConnectorState": "CREATING", 
       "ConnectorName": "example-S3-sink-connector"
   }