Uploading files to Amazon S3 to use with COPY
There are a couple approaches to take when uploading text files to Amazon S3:
If you have compressed files, we recommend that you split large files to take advantage of parallel processing in Amazon Redshift.
On the other hand, COPY automatically splits large, uncompressed, text-delimited file data to facilitate parallelism and effectively distribute the data from large files.
Create an Amazon S3 bucket to hold your data files, and then upload the data files to the bucket. For information about creating buckets and uploading files, see Working with Amazon S3 Buckets in the Amazon Simple Storage Service User Guide.
Important
The Amazon S3 bucket that holds the data files must be created in the same AWS Region as your cluster unless you use the REGION option to specify the Region in which the Amazon S3 bucket is located.
Ensure that the S3 IP ranges are added to your allowlist. To learn more about the required S3 IP ranges, see Network isolation.
You can create an Amazon S3 bucket in a specific Region either by selecting the Region when you create the bucket by using the Amazon S3 console, or by specifying an endpoint when you create the bucket using the Amazon S3 API or CLI.
Following the data load, verify that the correct files are present on Amazon S3.
Topics
