Using the Amazon Neptune Bulk Loader to Ingest Data
Amazon Neptune provides a Loader
command for loading data from
external files directly into a Neptune DB instance. You can use this command instead
of
executing a large number of INSERT
statements, addV
and addE
steps, or other API calls.
The Neptune Loader command is faster, has less overhead, is optimized for large datasets, and supports both Gremlin data and the RDF (Resource Description Framework) data used by SPARQL.
The following diagram shows an overview of the load process:

Here are the steps of the loading process:
-
Copy the data files to an Amazon Simple Storage Service (Amazon S3) bucket.
-
Create an IAM role with Read and List access to the bucket.
-
Create an Amazon S3 VPC endpoint.
-
Start the Neptune loader by sending a request via HTTP to the Neptune DB instance.
-
The Neptune DB instance assumes the IAM role to load the data from the bucket.
You can load encrypted data from Amazon S3 if it was encrypted using the Amazon S3
SSE-S3
mode. In that case, Neptune can impersonate your credentials and issue
s3:getObject
calls on your behalf. However, Neptune does not currently
support loading data encrypted using the SSE-C
mode.
The following sections provide instructions for preparing and loading data into Neptune.
Topics