Managing kdb databases
The following sections provide a detailed overview of the operations that you can perform by using a Managed kdb database.
Creating a kdb database
To create a kdb database
-
Sign in to the AWS Management Console and open the Amazon FinSpace console at https://console.aws.amazon.com/finspace
. -
Choose Kdb environments.
-
From the kdb environments table, choose the name of the environment.
-
On the environment details page, choose the Databases tab.
-
Choose Create database.
-
On the Create database page, enter a unique name for the database.
-
(Optional) Enter a description for your database.
-
(Optional) Add a new tag to assign it to your kdb database. For more information, see AWS tags.
Note
You can only add up to 50 tags to your database.
-
Choose Create database. The environment details page opens and the table under Databases lists the newly created database.
You can choose the database name from the list to view its details in database details page.
Managing data in a kdb database
The Managed kdb Insights database allows you to add, update, or delete a set of files. When you create a database, there is no data loaded in it. You must add data to the database through changesets. A changeset represents a versioned set of changes that are applied to a database.
Creating an Amazon S3 bucket policy
Before you can ingest data into your database, you must have a valid Amazon S3 bucket IAM policy in place to allow FinSpace to access the data you will ingest into it. The following is an example of such a policy.
In the following example, replace each user input
placeholder with your own values. Replace
555555555555 with the AWS account where you created your
Managed kdb Insights environment.
Example — Sample Amazon S3 bucket policy
{ "Version": "2012-10-17", "Id": "FinSpaceServiceAccess", "Statement": [{ "Effect": "Allow", "Principal": { "Service": "finspace.amazonaws.com" }, "Action": [ "s3:GetObject", "s3:GetObjectTagging" ], "Resource": "arn:aws:s3:::managed-kdb-data/*", "Condition": { "StringEquals": { "aws:SourceAccount": "555555555555" } } }, { "Effect": "Allow", "Principal": { "Service": "finspace.amazonaws.com" }, "Action": "s3:ListBucket", "Resource": "arn:aws:s3:::managed-kdb-data", "Condition": { "StringEquals": { "aws:SourceAccount": "555555555555" } } } ] }
Creating a new changeset
You can add, update, and delete data in a database by creating a new changeset.
You can either use
the console or the CreateKxChangeset API to create a changeset. To add a data to your database, create a changeset by providing the changeset type
as PUT, database path, and S3 URI path.
To update data in a database, you need to create another changeset with the
same database path you chose while adding the data. To delete data in a database,
create a new changeset with changeset type as DELETE.
Note
You should only add data in the correct kdb file format that follows a valid
kdb path structure. Other file formats and structures are not supported when
accessed from a FinSpace Managed kdb cluster. You can learn more about valid kdb
path structures here
To create a changeset from the console
-
Sign in to the AWS Management Console and open the Amazon FinSpace console at https://console.aws.amazon.com/finspace
. -
Choose Kdb environments.
-
From the kdb environments table, choose the name of the environment.
-
On the environment details page, choose Databases tab. The table under this tab displays a list of databases.
-
Choose a database name to view its details.
-
On the database details page, choose the Changesets tab.
-
Choose Create changeset.
-
On the Create changeset page, select one of the following types of changeset.
-
PUT – Adds or updates files in a database.
-
DELETE – Deletes files in a database. This option is not available when creating the changeset for the first time.
-
-
For Database path, specify a path within the database directory where you want to add data. If the data already exists at this path, it will be updated.
-
For S3 URI provide the source path of the file to add data.
-
Choose Create changeset. The database details page opens where you can see the status of the changeset in the changeset table.
You can choose the changeset ID to view details of a changeset.
Updating a kdb database
To update the metadata of a kdb database
-
Sign in to the AWS Management Console and open the Amazon FinSpace console at https://console.aws.amazon.com/finspace
. -
Choose Kdb environments.
-
From the kdb environments table, choose the name of the environment.
-
On the environment details page, choose Databases tab.
-
From the list of databases, choose the one that you want to update. The database details page opens.
-
On the database details page, choose Edit.
-
Edit the database description.
-
Choose Update database.
Viewing kdb database details
To view and get details of a kdb database
-
Sign in to the AWS Management Console and open the Amazon FinSpace console at https://console.aws.amazon.com/finspace
. -
Choose Kdb environments.
-
From the kdb environments table, choose the name of the environment.
-
On the environment details page, choose Databases tab. The table under this tab displays a list of databases.
-
Choose a database name to view its details. The database details page opens where you can view details about the database. You can also add and view changesets and tags associated with this database.
Deleting a kdb database
Note
This action is irreversible. Deleting a kdb database will delete all of its contents.
To delete a kdb database
-
Sign in to the AWS Management Console and open the Amazon FinSpace console at https://console.aws.amazon.com/finspace
. -
Choose Kdb environments.
-
From the kdb environments table, choose the name of the environment.
-
On the environment details page, choose the Databases tab.
-
From the list of databases, choose the one that you want to delete. The database details page opens.
-
On the database details page, choose Delete.
-
On the confirmation dialog box, enter confirm.
-
Choose Delete.
