You use the AWS::QBusiness::DataSource
resource to connect a data source to
your Amazon Q application.
Use the configuration
property to provide a JSON or YAML schema with the necessary
configuration details specific to your data source connector.
To learn more about AWS CloudFormation, see What is AWS CloudFormation? in the AWS CloudFormation User Guide.
Topics
Confluence configuration
properties
The following provides information about important configuration properties required in the schema.
Configuration | Description | Type | Required |
---|---|---|---|
|
Configuration information for the endpoint for the data source. |
This property has a sub-property called
|
Yes |
|
This is the endpoint information for the data source. This is a sub-property for
the connectionConfiguration . |
This property has the following sub-properties.
|
Yes |
|
The URL for your Confluence instance. For example,
https://example.confluence.com . |
Specify the URL in the pattern |
Yes |
|
The hosting method for your Confluence instance. |
The allowed values are |
Yes |
|
The authentication method for your Confluence instance. |
The allowed values are |
Yes |
|
Configuration information for the content of the data source. For example, configuring specific types of content and field mappings. |
This property has the following sub-properties.
|
Yes |
|
A list of objects that map the attributes or field names of your Confluence spaces, pages, blogs, comments, and attachments to Amazon Q index field names. |
These properties have the following sub-properties.
|
No |
|
The field name of your Confluence spaces, pages, blogs, comments, or attachments. |
|
Yes |
|
The field type of your Confluence spaces, pages, blogs, comments, or attachments. |
The allowed values are |
Yes |
|
The data source field name of your Confluence spaces, pages, blogs, comments, or attachments. |
|
Yes |
|
The date format of your Confluence spaces, pages, blogs, comments, or attachments. |
Specify the date format in the form |
No |
|
Additional configuration options for your content in your data source. |
This property has the following sub-properties.
|
Yes |
|
Specify true to crawl access control information from
documents. |
|
No |
|
Specify true if you want to automatically rotate the secret. |
|
No |
|
Specify field to use for UserId for ACL crawling. |
|
No |
|
The host where the web proxy is required. The host name should be without protocol (http:// or https://). |
|
Yes |
|
Port used by the host URL transport protocol. The port number should be a numeric value between 0 and 65535. |
|
Yes |
|
Specify the maximum single file size limit in MBs that Amazon Q will crawl. Amazon Q will crawl only the files within the size limit you define. The default file size is 50MB. The maximum file size should be greater than 0MB and less than or equal to 50MB. |
The allowed values are numbers between greater than 0 and less than or equal to 50. |
No |
|
A list of regular expression patterns to include and/or exclude certain files in your Confluence data source. Files that match the patterns are included in the index. Files that don't match the patterns are excluded from the index. If a file matches both an inclusion and exclusion pattern, the exclusion pattern takes precedence and the file isn't included in the index. |
|
No |
|
Specify true to index files in your Confluence personal
spaces, pages, blogs, page comments, page attachments, blog comments, and blog
attachments. |
|
No |
|
The type of data source. We recommend that you use CONFLUENCEV2 as
your data source type. |
Valid values are |
Yes |
|
Specify |
|
Yes |
|
Specify whether Amazon Q should update your index by syncing all documents or only new, modified, and deleted documents. |
Valid values are
|
Yes |
|
The Amazon Resource Name (ARN) of a Secrets Manager secret that contains the key-value pairs required to connect to your Confluence instance. |
The minimum length is 20 and the maximum length is 2,048 characters. If you use basic authentication, the secret must contain a JSON structure with the following keys: If you use OAuth 2.0 authentication, the secret must contain a JSON
structure with the following keys:
|
Yes |
|
The version of this template that's currently supported. |
|
No |
Confluence (Cloud) JSON schema for using the
configuration property with AWS CloudFormation
The following is the Confluence (Cloud) JSON schema and examples for the configuration property for AWS CloudFormation.
Topics
Confluence (Cloud) JSON schema for using the configuration property with AWS CloudFormation
The following is the Confluence (Cloud) JSON schema for the configuration property for AWS CloudFormation
{
"type": "object",
"properties": {
"type": {
"type": "string",
"enum": ["CONFLUENCEV2", "CONFLUENCE"]
},
"syncMode": {
"type": "string",
"enum": ["FULL_CRAWL", "FORCED_FULL_CRAWL"]
},
"secretArn": {
"type": "string",
"minLength": 20,
"maxLength": 2048
},
"enableIdentityCrawler": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"connectionConfiguration": {
"type": "object",
"properties": {
"repositoryEndpointMetadata": {
"type": "object",
"properties": {
"hostUrl": {
"type": "string",
"pattern": "https:.*"
},
"type": {
"type": "string",
"enum": ["SAAS"]
},
"authType": {
"type": "string",
"enum": ["Basic", "OAuth2"]
}
},
"required": ["hostUrl", "type", "authType"]
}
},
"required": ["repositoryEndpointMetadata"]
},
"repositoryConfigurations": {
"type": "object",
"properties": {
"space": {
"type": "object",
"properties": {
"fieldMappings": {
"type": "array",
"items": [
{
"type": "object",
"properties": {
"indexFieldName": {
"type": "string"
},
"indexFieldType": {
"type": "string",
"enum": ["STRING", "STRING_LIST", "DATE"]
},
"dataSourceFieldName": {
"type": "string"
},
"dateFieldFormat": {
"type": "string",
"pattern": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
},
"required": [
"indexFieldName",
"indexFieldType",
"dataSourceFieldName"
]
}
]
}
},
"required": ["fieldMappings"]
},
"page": {
"type": "object",
"properties": {
"fieldMappings": {
"type": "array",
"items": [
{
"type": "object",
"properties": {
"indexFieldName": {
"type": "string"
},
"indexFieldType": {
"type": "string",
"enum": ["STRING", "STRING_LIST", "DATE", "LONG"]
},
"dataSourceFieldName": {
"type": "string"
},
"dateFieldFormat": {
"type": "string",
"pattern": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
},
"required": [
"indexFieldName",
"indexFieldType",
"dataSourceFieldName"
]
}
]
}
},
"required": ["fieldMappings"]
},
"blog": {
"type": "object",
"properties": {
"fieldMappings": {
"type": "array",
"items": [
{
"type": "object",
"properties": {
"indexFieldName": {
"type": "string"
},
"indexFieldType": {
"type": "string",
"enum": ["STRING", "STRING_LIST", "DATE", "LONG"]
},
"dataSourceFieldName": {
"type": "string"
},
"dateFieldFormat": {
"type": "string",
"pattern": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
},
"required": [
"indexFieldName",
"indexFieldType",
"dataSourceFieldName"
]
}
]
}
},
"required": ["fieldMappings"]
},
"comment": {
"type": "object",
"properties": {
"fieldMappings": {
"type": "array",
"items": [
{
"type": "object",
"properties": {
"indexFieldName": {
"type": "string"
},
"indexFieldType": {
"type": "string",
"enum": ["STRING", "STRING_LIST", "DATE", "LONG"]
},
"dataSourceFieldName": {
"type": "string"
},
"dateFieldFormat": {
"type": "string",
"pattern": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
},
"required": [
"indexFieldName",
"indexFieldType",
"dataSourceFieldName"
]
}
]
}
},
"required": ["fieldMappings"]
},
"attachment": {
"type": "object",
"properties": {
"fieldMappings": {
"type": "array",
"items": [
{
"type": "object",
"properties": {
"indexFieldName": {
"type": "string"
},
"indexFieldType": {
"type": "string",
"enum": ["STRING", "STRING_LIST", "DATE", "LONG"]
},
"dataSourceFieldName": {
"type": "string"
},
"dateFieldFormat": {
"type": "string",
"pattern": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
},
"required": [
"indexFieldName",
"indexFieldType",
"dataSourceFieldName"
]
}
]
}
},
"required": ["fieldMappings"]
}
}
},
"additionalProperties": {
"type": "object",
"properties": {
"isCrawlAcl": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"fieldForUserId": {
"type": "string"
},
"inclusionSpaceKeyFilter": {
"type": "array",
"items": {
"type": "string"
}
},
"exclusionSpaceKeyFilter": {
"type": "array",
"items": {
"type": "string"
}
},
"pageTitleRegEX": {
"type": "array",
"items": {
"type": "string"
}
},
"blogTitleRegEX": {
"type": "array",
"items": {
"type": "string"
}
},
"commentTitleRegEX": {
"type": "array",
"items": {
"type": "string"
}
},
"attachmentTitleRegEX": {
"type": "array",
"items": {
"type": "string"
}
},
"isCrawlPersonalSpace": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlArchivedSpace": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlArchivedPage": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlPage": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlBlog": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlPageComment": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlPageAttachment": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlBlogComment": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"isCrawlBlogAttachment": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
]
},
"maxFileSizeInMegaBytes": {
"type": "string"
},
"inclusionFileTypePatterns": {
"type": "array",
"items": {
"type": "string"
}
},
"exclusionFileTypePatterns": {
"type": "array",
"items": {
"type": "string"
}
},
"inclusionUrlPatterns": {
"type": "array",
"items": {
"type": "string"
}
},
"exclusionUrlPatterns": {
"type": "array",
"items": {
"type": "string"
}
},
"proxyHost": {
"type": "string"
},
"proxyPort": {
"type": "string"
},
"enableDeletionProtection": {
"anyOf": [
{
"type": "boolean"
},
{
"type": "string",
"enum": ["true", "false"]
}
],
"default": false
},
"deletionProtectionThreshold": {
"type": "string",
"default": "15"
}
},
"required": []
}
},
"version": {
"type": "string",
"anyOf": [
{
"pattern": "1.0.0"
}
]
},
"required": [
"type",
"syncMode",
"secretArn",
"connectionConfiguration",
"repositoryConfigurations",
"additionalProperties"
]
}
Confluence (Cloud) JSON schema example for using the configuration property with AWS CloudFormation
The following is the Confluence (Cloud) JSON schema example for the configuration property for AWS CloudFormation
{
"AWSTemplateFormatVersion": "2010-09-09",
"Description": "CloudFormation CONFLUENCE Data Source Template",
"Resources": {
"DataSourceConfluence": {
"Type": "AWS::QBusiness::DataSource",
"Properties": {
"ApplicationId": "app12345-1234-1234-1234-123456789012",
"IndexId": "indx1234-1234-1234-1234-123456789012",
"DisplayName": "MyConfluenceDataSource",
"RoleArn": "arn:aws:iam::123456789012:role/qbusiness-data-source-role",
"Configuration": {
"type": "CONFLUENCEV2",
"syncMode": "FULL_CRAWL",
"secretArn": "arn:aws:secretsmanager:us-west-2:123456789012:secret:my-confluence-secret",
"enableIdentityCrawler": "true",
"connectionConfiguration": {
"repositoryEndpointMetadata": {
"hostUrl": "https://mycompany.atlassian.net",
"type": "SAAS",
"authType": "OAuth2"
}
},
"repositoryConfigurations": {
"space": {
"fieldMappings": [
{
"indexFieldName": "space_id",
"indexFieldType": "STRING",
"dataSourceFieldName": "id",
"dateFieldFormat": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
]
},
"page": {
"fieldMappings": [
{
"indexFieldName": "page_id",
"indexFieldType": "STRING",
"dataSourceFieldName": "id",
"dateFieldFormat": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
]
},
"blog": {
"fieldMappings": [
{
"indexFieldName": "blog_id",
"indexFieldType": "STRING",
"dataSourceFieldName": "id",
"dateFieldFormat": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
]
},
"comment": {
"fieldMappings": [
{
"indexFieldName": "comment_id",
"indexFieldType": "STRING",
"dataSourceFieldName": "id",
"dateFieldFormat": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
]
},
"attachment": {
"fieldMappings": [
{
"indexFieldName": "attachment_id",
"indexFieldType": "STRING",
"dataSourceFieldName": "id",
"dateFieldFormat": "yyyy-MM-dd'T'HH:mm:ss'Z'"
}
]
}
},
"additionalProperties": {
"isCrawlAcl": "true",
"fieldForUserId": "user_id",
"inclusionSpaceKeyFilter": ["SPACE1", "SPACE2"],
"exclusionSpaceKeyFilter": ["SPACE3"],
"pageTitleRegEX": ["^.*$"],
"blogTitleRegEX": ["^.*$"],
"commentTitleRegEX": ["^.*$"],
"attachmentTitleRegEX": ["^.*$"],
"isCrawlPersonalSpace": "false",
"isCrawlArchivedSpace": "false",
"isCrawlArchivedPage": "true",
"isCrawlPage": "true",
"isCrawlBlog": "true",
"isCrawlPageComment": "false",
"isCrawlPageAttachment": "false",
"isCrawlBlogComment": "true",
"isCrawlBlogAttachment": "true",
"maxFileSizeInMegaBytes": "50",
"inclusionFileTypePatterns": ["*.pdf", "*.docx"],
"exclusionFileTypePatterns": ["*.tmp"],
"inclusionUrlPatterns": ["*"],
"exclusionUrlPatterns": ["*.tmp"],
"enableDeletionProtection": "false",
"deletionProtectionThreshold": "15"
}
}
}
}
}
}
Confluence (Cloud) YAML schema for using the
configuration property with AWS CloudFormation
The following is the Confluence (Cloud) YAML schema and examples for the configuration property for AWS CloudFormation:
Topics
Confluence (Cloud) YAML schema for using the configuration property with AWS CloudFormation
The following is the Confluence (Cloud) YAML schema for the configuration property for AWS CloudFormation.
type: object
properties:
type:
type: string
enum:
- CONFLUENCEV2
- CONFLUENCE
syncMode:
type: string
enum:
- FULL_CRAWL
- FORCED_FULL_CRAWL
secretArn:
type: string
minLength: 20
maxLength: 2048
enableIdentityCrawler:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
connectionConfiguration:
type: object
properties:
repositoryEndpointMetadata:
type: object
properties:
hostUrl:
type: string
pattern: "https:.*"
type:
type: string
enum:
- SAAS
authType:
type: string
enum:
- Basic
- OAuth2
required:
- hostUrl
- type
- authType
required:
- repositoryEndpointMetadata
repositoryConfigurations:
type: object
properties:
space:
type: object
properties:
fieldMappings:
type: array
items:
type: object
properties:
indexFieldName:
type: string
indexFieldType:
type: string
enum:
- STRING
- STRING_LIST
- DATE
dataSourceFieldName:
type: string
dateFieldFormat:
type: string
pattern: "yyyy-MM-dd'T'HH:mm:ss'Z'"
required:
- fieldMappings
page:
type: object
properties:
fieldMappings:
type: array
items:
type: object
properties:
indexFieldName:
type: string
indexFieldType:
type: string
enum:
- STRING
- STRING_LIST
- DATE
- LONG
dataSourceFieldName:
type: string
dateFieldFormat:
type: string
pattern: "yyyy-MM-dd'T'HH:mm:ss'Z'"
required:
- fieldMappings
blog:
type: object
properties:
fieldMappings:
type: array
items:
type: object
properties:
indexFieldName:
type: string
indexFieldType:
type: string
enum:
- STRING
- STRING_LIST
- DATE
- LONG
dataSourceFieldName:
type: string
dateFieldFormat:
type: string
pattern: "yyyy-MM-dd'T'HH:mm:ss'Z'"
required:
- fieldMappings
comment:
type: object
properties:
fieldMappings:
type: array
items:
type: object
properties:
indexFieldName:
type: string
indexFieldType:
type: string
enum:
- STRING
- STRING_LIST
- DATE
- LONG
dataSourceFieldName:
type: string
dateFieldFormat:
type: string
pattern: "yyyy-MM-dd'T'HH:mm:ss'Z'"
required:
- fieldMappings
attachment:
type: object
properties:
fieldMappings:
type: array
items:
type: object
properties:
indexFieldName:
type: string
indexFieldType:
type: string
enum:
- STRING
- STRING_LIST
- DATE
- LONG
dataSourceFieldName:
type: string
dateFieldFormat:
type: string
pattern: "yyyy-MM-dd'T'HH:mm:ss'Z'"
required:
- fieldMappings
additionalProperties:
type: object
properties:
isCrawlAcl:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
fieldForUserId:
type: string
inclusionSpaceKeyFilter:
type: array
items:
type: string
exclusionSpaceKeyFilter:
type: array
items:
type: string
pageTitleRegEX:
type: array
items:
type: string
blogTitleRegEX:
type: array
items:
type: string
commentTitleRegEX:
type: array
items:
type: string
attachmentTitleRegEX:
type: array
items:
type: string
isCrawlPersonalSpace:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlArchivedSpace:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlArchivedPage:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlPage:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlBlog:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlPageComment:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlPageAttachment:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlBlogComment:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
isCrawlBlogAttachment:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
maxFileSizeInMegaBytes:
type: string
inclusionFileTypePatterns:
type: array
items:
type: string
exclusionFileTypePatterns:
type: array
items:
type: string
inclusionUrlPatterns:
type: array
items:
type: string
exclusionUrlPatterns:
type: array
items:
type: string
proxyHost:
type: string
proxyPort:
type: string
enableDeletionProtection:
anyOf:
- type: boolean
- type: string
enum:
- "true"
- "false"
default: false
deletionProtectionThreshold:
type: string
default: "15"
required: []
version:
type: string
anyOf:
- pattern: 1.0.0
required:
- type
- syncMode
- secretArn
- connectionConfiguration
- repositoryConfigurations
- additionalProperties
Confluence (Cloud) YAML schema example for using the configuration property with AWS CloudFormation
The following is the Confluence (Cloud) YAML example for the Configuration property for AWS CloudFormation:
AWSTemplateFormatVersion: "2010-09-09"
Description: CloudFormation CONFLUENCE Data Source Template
Resources:
DataSourceConfluence:
Type: AWS::QBusiness::DataSource
Properties:
ApplicationId: app12345-1234-1234-1234-123456789012
IndexId: indx1234-1234-1234-1234-123456789012
DisplayName: MyConfluenceDataSource
RoleArn: arn:aws:iam::123456789012:role/qbusiness-data-source-role
Configuration:
type: CONFLUENCEV2
syncMode: FULL_CRAWL
secretArn: arn:aws:secretsmanager:us-west-2:123456789012:secret:my-confluence-secret
enableIdentityCrawler: "true"
connectionConfiguration:
repositoryEndpointMetadata:
hostUrl: https://mycompany.atlassian.net
type: SAAS
authType: OAuth2
repositoryConfigurations:
space:
fieldMappings:
- indexFieldName: space_id
indexFieldType: STRING
dataSourceFieldName: id
dateFieldFormat: yyyy-MM-dd'T'HH:mm:ss'Z'
page:
fieldMappings:
- indexFieldName: page_id
indexFieldType: STRING
dataSourceFieldName: id
dateFieldFormat: yyyy-MM-dd'T'HH:mm:ss'Z'
blog:
fieldMappings:
- indexFieldName: blog_id
indexFieldType: STRING
dataSourceFieldName: id
dateFieldFormat: yyyy-MM-dd'T'HH:mm:ss'Z'
comment:
fieldMappings:
- indexFieldName: comment_id
indexFieldType: STRING
dataSourceFieldName: id
dateFieldFormat: yyyy-MM-dd'T'HH:mm:ss'Z'
attachment:
fieldMappings:
- indexFieldName: attachment_id
indexFieldType: STRING
dataSourceFieldName: id
dateFieldFormat: yyyy-MM-dd'T'HH:mm:ss'Z'
additionalProperties:
isCrawlAcl: "true"
fieldForUserId: user_id
inclusionSpaceKeyFilter:
- SPACE1
- SPACE2
exclusionSpaceKeyFilter:
- SPACE3
pageTitleRegEX:
- "^.*$"
blogTitleRegEX:
- "^.*$"
commentTitleRegEX:
- "^.*$"
attachmentTitleRegEX:
- "^.*$"
isCrawlPersonalSpace: "false"
isCrawlArchivedSpace: "false"
isCrawlArchivedPage: "true"
isCrawlPage: "true"
isCrawlBlog: "true"
isCrawlPageComment: "false"
isCrawlPageAttachment: "false"
isCrawlBlogComment: "true"
isCrawlBlogAttachment: "true"
maxFileSizeInMegaBytes: "50"
inclusionFileTypePatterns:
- "*.pdf"
- "*.docx"
exclusionFileTypePatterns:
- "*.tmp"
inclusionUrlPatterns:
- "*"
exclusionUrlPatterns:
- "*.tmp"
enableDeletionProtection: "false"
deletionProtectionThreshold: "15"