Supported features Prerequisites Connection instructions Notes

SharePoint connector V2.0

SharePoint is a collaborative website building service that you can use to customize web content and create pages, sites, document libraries, and lists. You can use Amazon Kendra to index your SharePoint data source.

Amazon Kendra currently supports SharePoint Online and SharePoint Server (2013, 2016, 2019, and Subscription Edition).

Note

Support for SharePoint connector V1.0 / SharePointConfiguration API is scheduled to end in 2023. We recommend migrating to or using SharePoint connector V2.0 / TemplateConfiguration API.

For troubleshooting your Amazon Kendra SharePoint data source connector, see Troubleshooting data sources.

Supported features

Amazon Kendra SharePoint data source connector supports the following features:

Field mappings
User context filtering
User identity crawling
Inclusion/exclusion patterns
Full and incremental content syncs
Virtual private cloud (VPC)

Prerequisites

Before you can use Amazon Kendra to index your SharePoint data source, make these changes in your SharePoint and AWS accounts.

In SharePoint Online, make sure you have:

Copied your SharePoint instance URLs. The format for the host URL you enter is https://yourdomain.sharepoint.com/sites/mysite. Your URL must start with https and contain sharepoint.com.
Copied the domain name of your SharePoint instance URL.
Noted your basic authentication credentials containing the user name and password with site admin permissions to connect to SharePoint Online.
Deactivated Security Defaults in your Azure portal using an administrative user. For more information on managing security default settings in the Azure portal, see Microsoft documentation on how to enable/disable security defaults.
Deactivated multi-factor authentication (MFA) in your SharePoint account, so that Amazon Kendra is not blocked from crawling your SharePoint content.
If using authentication type other than Basic authentication: Copied the tenant ID of your SharePoint instance. For details on how to find your tenant ID, see Find your Microsoft 365 tenant ID.
If you need to migrate to cloud user authentication with Microsoft Entra, see Microsoft documentation on cloud authentication.

For OAuth 2.0 authentication and OAuth 2.0 refresh token authentication: Noted your Basic authentication credentials containing the user name and password you use to connect to SharePoint Online and the client ID and client secret generated after registering SharePoint with Azure AD.

If you're not using ACL, added the following permissions:

Microsoft Graph	SharePoint
Notes.Read.All (Application)—Read all OneNote notebooks Sites.Read.All (Application)—Read items in all site collections	AllSites.Read (Delegated)—Read items in all site collections

Note

Note.Read.All and Sites.Read.All are required only if you want to crawl OneNote Documents.

If you want to crawl specific sites, the permission can be restricted to specific sites rather than all sites available in the domain. You configure Sites.Selected (Application) permission. With this API permission, you need to set access permission on every site explicitly through Microsoft Graph API. For more information, see Microsoft's blog on Sites.Selected permissions.

If you're using ACL, added the following permissions:

Microsoft Graph	SharePoint
Group.Member.Read.All (Application)—Read all group memberships Notes.Read.All (Application)—Read all OneNote notebooks Sites.FullControl.All (Delegated)—Required to retrieve ACLs of the documents Sites.Read.All (Application)—Read items in all site collections User.Read.All (Application)—Read all users' full profiles	AllSites.Read (Delegated)—Read items in all site collections

Note

GroupMember.Read.All and User.Read.All are required only if Identity crawler is activated.

For Azure AD App-Only authentication: Private key and the Client ID you generated after registering SharePoint with Azure AD. Also note the X.509 certificate.

If you're not using ACL, added the following permissions:

SharePoint
Sites.Read.All (Application)—Required to access items and lists in all site collections

Note

If you're using ACL, added the following permissions:

SharePoint
Sites.FullControl.All (Application)—Required to retrieve ACLs of the documents

Note

For SharePoint App-Only authentication: Noted your SharePoint client ID and client secret generated while granting permission to SharePoint App Only, and your Client ID and Client secret generated when you registered your SharePoint app with Azure AD.

Note

SharePoint App-Only Authentication is not supported for SharePoint 2013 version.

(Optional) If you're crawling OneNote documents and using Identity crawler, added the following permissions:

Microsoft Graph
GroupMember.Read.All (Application)—Read all group memberships Notes.Read.All (Application)—Read all OneNote notebooks Sites.Read.All (Application)—Read items in all site collections User.Read.All (Application)—Read all users' full profiles

Note

No API permissions are required for crawling entities using Basic authentication and SharePoint App-only authentication.

In SharePoint Server, make sure you have:

Copied your SharePoint instance URLs and the domain name of your SharePoint URLs. The format for the host URL you enter is https://yourcompany/sites/mysite. Your URL must start with https.

Note
(On-premise/server) Amazon Kendra checks if the endpoint information included in AWS Secrets Manager is the same the endpoint information specified in your data source configuration details. This helps protect against the confused deputy problem, which is a security issue where a user doesn’t have permission to perform an action but uses Amazon Kendra as a proxy to access the configured secret and perform the action. If you later change your endpoint information, you must create a new secret to sync this information.
Deactivated multi-factor authentication (MFA) in your SharePoint account, so that Amazon Kendra is not blocked from crawling your SharePoint content.
If using SharePoint App-Only authentication for access control:
- Copied the SharePoint client ID generated when you registered App Only at Site Level. Client ID format is ClientId@TenantId. For example, ffa956f3-8f89-44e7-b0e4-49670756342c@888d0b57-69f1-4fb8-957f-e1f0bedf82fe.
- Copied the SharePoint client secret generated when you registered App Only at Site Level.
Note: Because client IDs and client secrets are generated for single sites only when you register SharePoint Server for App Only authentication, only one site URL is supported for SharePoint App Only authentication.

Note
SharePoint App-Only Authentication is not supported for SharePoint 2013 version.
If using Email ID with Custom Domain for access control:
- Noted your custom email domain value—for example: "amazon.com".
If using Email ID with Domain from IDP authorization, copied your:
- LDAP Server Endpoint (endpoint of LDAP server including protocol and port number). For example: ldap://example.com:389.
- LDAP Search Base (search base of the LDAP user). For example: CN=Users,DC=sharepoint,DC=com.
- LDAP user name and LDAP password.
Either configured NTLM authentication credentials or configured Kerberos authentication credentials containing a user name (SharePoint account user name) and password (SharePoint account password).

In your AWS account, make sure you have:

Created an Amazon Kendra index and, if using the API, noted the index ID.
Created an IAM role for your data source and, if using the API, noted the ARN of the IAM role.

Note
If you change your authentication type and credentials, you must update your IAM role to access the correct AWS Secrets Manager secret ID.
Stored your SharePoint authentication credentials in an AWS Secrets Manager secret and, if using the API, noted the ARN of the secret.

Note
We recommend that you regularly refresh or rotate your credentials and secret. Provide only the necessary access level for your own security. We do not recommend that you re-use credentials and secrets across data sources, and connector versions 1.0 and 2.0 (where applicable).

If you don’t have an existing IAM role or secret, you can use the console to create a new IAM role and Secrets Manager secret when you connect your SharePoint data source to Amazon Kendra. If you are using the API, you must provide the ARN of an existing IAM role and Secrets Manager secret, and an index ID.

Connection instructions

To connect Amazon Kendra to your SharePoint data source, you must provide details of your SharePoint credentials so that Amazon Kendra can access your data. If you have not yet configured SharePoint for Amazon Kendra see Prerequisites.

Console: SharePoint Online

To connect Amazon Kendra to SharePoint Online

Sign in to the AWS Management Console and open the Amazon Kendra console.
From the left navigation pane, choose Indexes and then choose the index you want to use from the list of indexes.

Note
You can choose to configure or edit your User access control settings under Index settings.
On the Getting started page, choose Add data source.
On the Add data source page, choose SharePoint connector V2.0, and then choose Add data source.
On the Specify data source details page, enter the following information:
1. In Name and description, for Data source name—Enter a name for your data source. You can include hyphens but not spaces.
2. (Optional) Description—Enter an optional description for your data source.
3. In Default language—Choose a language to filter your documents for the index. Unless you specify otherwise, the language defaults to English. Language specified in the document metadata overrides the selected language.
4. In Tags, for Add new tag—Include optional tags to search and filter your resources or track your AWS costs.
5. Choose Next.
On the Define access and security page, enter the following information:
1. In Source, for Hosting Method—Choose SharePoint Online.
2. Site URLs specific to your SharePoint repository—Enter the SharePoint host URLs. The format for the host URLs you enter is https://yourdomain.sharepoint.com/sites/mysite. The URL must start with https protocol. Separate URLs with a new line. You can add up to 100 URLs.
3. Domain—Enter the SharePoint domain. For example, the domain in the URL https://yourdomain.sharepoint.com/sites/mysite is yourdomain.
4. For Authorization, you can choose from the following ACL options:
  - User principal name – Access control will be based on User principal name fetched from Azure Portal.
  - Email – Access control will be based on email ids fetched from Azure Portal.
  Note
  If you don't specify a value, Email is considered as the default value.
5. For Authentication, choose between Basic, OAuth 2.0, Azure AD App-Only authentication, SharePoint App-Only authentication, and OAuth 2.0 refresh token authentication based on your use case.
  1. If using Basic Authentication, enter the following information:
    - For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret an AWS Secrets Manager secret window opens. Enter the following information in the window:
      
      Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
      
      Username—User name for your SharePoint account.
      
      Password—Password for your SharePoint account.
  2. If using OAuth 2.0 authentication, enter the following information:
    - Tenant ID—Tenant ID of your SharePoint account.
    - For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret an AWS Secrets Manager secret window opens. Enter the following information in the window:
      
      Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
      
      Username—User name for your SharePoint account.
      
      Password—Password for your SharePoint account.
      
      Client ID—The Azure AD client ID generated when you register SharePoint in Azure AD.
      
      Client secret—The Azure AD client secret generated when you register SharePoint in Azure AD.
  3. If using Azure AD App-Only authentication, enter the following information:
    - Tenant ID—Tenant ID of your SharePoint account.
    - Azure AD self-signed X.509 certificate—Certificate to authenticate the connector for Azure AD.
    - For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret an AWS Secrets Manager secret window opens. Enter the following information in the window:
      
      Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
      
      Client ID—The Azure AD client ID generated when you register SharePoint in Azure AD.
      
      Private key—A private key to authenticate the connector for Azure AD.
  4. If using SharePoint App-Only authentication, enter the following information:
    - Tenant ID—Tenant ID of your SharePoint account.
    - For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret an AWS Secrets Manager secret window opens. Enter the following information in the window:
      
      Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
      
      SharePoint client ID—The SharePoint client ID you generated when you registered App Only at Tenant Level. ClientID format is ClientID@TenantId. For example, ffa956f3-8f89-44e7-b0e4-49670756342c@888d0b57-69f1-4fb8-957f-e1f0bedf82fe.
      
      SharePoint client secret—The SharePoint client secret generated when your register for App Only at Tenant Level.
      
      Client ID—The Azure AD client ID generated when you register SharePoint in Azure AD.
      
      Client secret—The Azure AD client secret generated when you register SharePoint to Azure AD.
  5. If using OAuth 2.0 refresh token authentication, enter the following information:
    - Tenant ID—Tenant ID of your SharePoint account.
    - For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret an AWS Secrets Manager secret window opens. Enter the following information in the window:
      
      Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
      
      Client ID—The unique Azure AD client ID generated when you register SharePoint in Azure AD.
      
      Client secret—The Azure AD client secret generated when you register SharePoint to Azure AD.
      
      Refresh token—The refresh token generated to connect Amazon Kendra to SharePoint.
6. Identity crawler—(Activated only when ACL is enabled) Choose to activate Amazon Kendra identity crawler to sync identity information. If you choose to turn identity crawler off, you must upload the principal information using the PutPrincipalMapping API.
  
  You can also choose to:
  1. Crawl Local Group Mapping—Activate to crawl local group mapping.
  2. Crawl AD Group Mapping—Activate to crawl Azure Active Directory group mapping.
    
    Note
    AD Group mapping crawling is available only for OAuth 2.0, OAuth 2.0 refresh token, and SharePoint App Only authentication.
7. (Optional) Configure VPC and security group—Select a VPC to use with your SharePoint instance. If so, you must add Subnets and VPC security groups.
8. IAM role—Choose an existing IAM role or create a new IAM role to access your repository credentials and index content.
  
  Note
  IAM roles used for indexes cannot be used for data sources. If you are unsure if an existing role is used for an index or FAQ, choose Create a new role to avoid errors.
9. Choose Next.
On the Configure sync settings page, enter the following information:
1. In Sync scope, choose from the following options :
  1. Select entities—Choose the entities you want to crawl. You can select to crawl All entities or any combination of Files, Attachments, Links Pages, Events, Comments, and List Data.
  2. In Additional configuration, for Entity regex patterns—Add regular expression patterns for Links, Pages, and Events to include specific entities instead of syncing all your documents.
  3. Regex patterns—Add regular expression patterns to include or exclude files by File path, File name, File type, OneNote section name, and OneNote page name instead of syncing all your documents. You can add up to 100.
    
    Note
    OneNote crawling is available only for OAuth 2.0, OAuth 2.0 refresh token, and SharePoint App Only authentication.
2. For Sync mode choose how you want to update your index when your data source content changes. When you sync your data source with Amazon Kendra for the first time, all content is synced by default.
  - Full sync—Sync all content regardless of the previous sync status.
  - New or modified documents sync—Sync only new or modified documents.
  - New, modified, or deleted documents sync—Sync only new, modified, and deleted documents.
3. In Sync run schedule, for Frequency—How often Amazon Kendra will sync with your data source.
4. Choose Next.
On the Set field mappings page, enter the following information:
1. For Events Pages, Files, Links, Attachments, and Comments—Select from the Amazon Kendra generated default data source fields that you want to map to your index.
2. Add field—To add custom data source fields to create an index field name to map to and the field data type.
3. Choose Next.
On the Review and create page, check that the information you have entered is correct and then select Add data source. You can also choose to edit your information from this page. Your data source will appear on the Data sources page after the data source has been added successfully.

Console: SharePoint Server

To connect Amazon Kendra to SharePoint

Sign in to the AWS Management Console and open the Amazon Kendra console.
From the left navigation pane, choose Indexes and then choose the index you want to use from the list of indexes.

Note
You can choose to configure or edit your User access control settings under Index settings.
On the Getting started page, choose Add data source.
On the Add data source page, choose SharePoint connector V2.0, and then choose Add data source.
On the Specify data source details page, enter the following information:
1. In Name and description, for Data source name—Enter a name for your data source. You can include hyphens but not spaces.
2. (Optional) Description—Enter an optional description for your data source.
3. In Default language—Choose a language to filter your documents for the index. Unless you specify otherwise, the language defaults to English. Language specified in the document metadata overrides the selected language.
4. In Tags, for Add new tag—Include optional tags to search and filter your resources or track your AWS costs.
5. Choose Next.
On the Define access and security page, enter the following information:
1. In Source, for Hosting Method—Choose SharePoint Server.
2. Choose SharePoint Version—Choose between SharePoint 2013, SharePoint 2016, SharePoint 2019, and SharePoint (Subscription Edition).
3. Site URLs specific to your SharePoint repository—Enter the SharePoint host URLs. The format for the host URLs you enter is https://yourcompany/sites/mysite. The URL must start with https protocol. Separate URLs with a new line. You can add up to 100 URLs.
4. Domain—Enter the SharePoint domain. For example, the domain in the URL https://yourcompany/sites/mysite is yourcompany
5. SSL certificate location—Enter the Amazon S3 path to your SSL certificate file.
6. (Optional) For Web proxy—Enter the host name (without the http:// or https:// protocol), and the port number used by the host URL transport protocol. The numeric value of the port number must be between 0 and 65535.
7. Authorization—Turn on or off access control list (ACL) information for your documents, if you have an ACL and want to use it for access control. The ACL specifies which documents that users and groups can access. The ACL information is used to filter search results based on the user or their group access to documents. For more information, see User context filtering.
  
  For SharePoint Server you can choose from the following ACL options:
  1. Email ID with Domain from IDP—Access control will be based on email ids extracted from email domains fetched from the underlying identity provider (IDP). You provide the IDP connection details in your Secrets Manager secret during Authentication.
  2. Email ID with Custom Domain—Access control will be based on email IDs. You want to provide the email domain value. For example, "amazon.com". The email domain will be used to construct the email ID for access control. You must enter your email domain using Add Email Domain.
  3. Domain\User with Domain—Access control will be structured using a Domain\User ID format. You need to provide a valid Domain name. For example: "sharepoint2019" to construct access control.
8. For Authentication, choose between SharePoint App-Only authentication, NTLM authentication, and Kerberos authentication based on your use case.
  1. Enter the following information for both NTLM authentication and Kerberos authentication:
    
    For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret, an AWS Secrets Manager secret window opens. Enter the following information in the window:
    - Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
    - Username—User name for your SharePoint account.
    - Password—Password for your SharePoint account.
    If using Email ID with Domain from IDP, also enter your:
    - LDAP Server Endpoint—Endpoint of LDAP server, including protocol and port number. For example: ldap://example.com:389.
    - LDAP Search Base—Search base of LDAP user. For example: CN=Users,DC=sharepoint,DC=com.
    - LDAP username—Your LDAP user name.
    - LDAP Password—Your LDAP password.
  2. Enter the following information for SharePoint App-Only authentication.
    
    For AWS Secrets Manager secret—Choose an existing secret or create a new Secrets Manager secret to store your SharePoint authentication credentials. If you choose to create a new secret, an AWS Secrets Manager secret window opens. Enter the following information in the window:
    - Secret name—A name for your secret. The prefix ‘AmazonKendra-SharePoint-’ is automatically added to your secret name.
    - Client ID—The SharePoint client ID you generated when you registered App Only at Site Level. The ClientID format is ClientID@TenantId. For example, ffa956f3-8f89-44e7-b0e4-49670756342c@888d0b57-69f1-4fb8-957f-e1f0bedf82fe.
    - SharePoint client secret—The SharePoint client secret generated when your register for App Only at Site Level.
      
      Note: Because client IDs and client secrets are generated for single sites only when you register SharePoint Server for App Only authentication, only one site URL is supported for SharePoint App Only authentication.
    If using Email ID with Domain from IDP, also enter your:
    - LDAP Server Endpoint—Endpoint of LDAP server, including protocol and port number. For example: ldap://example.com:389.
    - LDAP Search Base—Search base of LDAP user. For example: CN=Users,DC=sharepoint,DC=com.
    - LDAP username—Your LDAP user name.
    - LDAP Password—Your LDAP password.
9. Identity crawler—Specify whether to turn on Amazon Kendra’s identity crawler. The identity crawler uses the access control list (ACL) information for your documents to filter search results based on the user or their group access to documents. If you have an ACL for your documents and choose to use your ACL, you can then also choose to turn on Amazon Kendra’s identity crawler to configure user context filtering of search results. Otherwise, if identity crawler is turned off, all documents can be publicly searched. If you want to use access control for your documents and identity crawler is turned off, you can alternatively use the PutPrincipalMapping API to upload user and group access information for user context filtering.
  1. Crawl Local Group Mapping—Activate to crawl local group mapping.
  2. (For Email ID with Domain from IDP only)Crawl AD Group Mapping—Activate to crawl Active Directory mapping.
    
    Note
    AD Group mapping crawling is available only SharePoint App Only authentication.
10. (Optional) Configure VPC and security group—Select a VPC to use with your SharePoint instance. If so, you must add Subnets and VPC security groups.
11. IAM role—Choose an existing IAM role or create a new IAM role to access your repository credentials and index content.
  
  Note
  IAM roles used for indexes cannot be used for data sources. If you are unsure if an existing role is used for an index or FAQ, choose Create a new role to avoid errors.
12. Choose Next.
On the Configure sync settings page, enter the following information:
1. In Sync scope, choose from the following options :
  1. Select entities—Choose the entities you want to crawl. You can select to crawl All entities or any combination of Files, Attachments, Links Pages, Events, and List Data.
  2. In Additional configuration, for Entity regex patterns—Add regular expression patterns for Links, Pages, and Events to include specific entities instead of syncing all your documents.
  3. Regex patterns—Add regular expression patterns to include or exclude files by File path File name File type, OneNote section name, and OneNote page name instead of syncing all your documents. You can add up to 100.
    
    Note
    OneNote crawling is available only for SharePoint App Only authentication.
2. Sync mode—Choose how you want to update your index when your data source content changes. When you sync your data source with Amazon Kendra for the first time, all content is crawled and indexed by default. You must run a full sync of your data if your initial sync failed, even if you don't choose full sync as your sync mode option.
  - Full sync: Freshly index all content, replacing existing content each time your data source syncs with your index.
  - New, modified sync: Index only new and modified content each time your data source syncs with your index. Amazon Kendra can use your data source's mechanism for tracking content changes and index content that changed since the last sync.
  - New, modified, deleted sync: Index only new, modified, and deleted content each time your data source syncs with your index. Amazon Kendra can use your data source's mechanism for tracking content changes and index content that changed since the last sync.
3. In Sync run schedule, for Frequency—How often Amazon Kendra will sync with your data source.
4. Choose Next.
On the Set field mappings page, enter the following information:
1. For Events Pages, Files, Links, Attachments, and List data—Select from the Amazon Kendra generated default data source fields that you want to map to your index.
2. Add field—To add custom data source fields to create an index field name to map to and the field data type.
3. Choose Next.
On the Review and create page, check that the information you have entered is correct and then select Add data source. You can also choose to edit your information from this page. Your data source will appear on the Data sources page after the data source has been added successfully.

API

To connect Amazon Kendra to SharePoint

You must specify a JSON of the data source schema using the TemplateConfiguration API. You must provide the following information:

Data source—Specify the data source type as SHAREPOINTV2 when you use the TemplateConfiguration JSON schema. Also specify the data source as TEMPLATE when you call the CreateDataSource API.
Repository Endpoint Metadata—Specify the tenantID domain and siteUrls of your SharePoint instance.
Sync mode—Specify how Amazon Kendra should update your index when your data source content changes. When you sync your data source with Amazon Kendra for the first time, all content is crawled and indexed by default. You must run a full sync of your data if your initial sync failed, even if you don't choose full sync as your sync mode option. You can choose between:
- FORCED_FULL_CRAWL to freshly index all content, replacing existing content each time your data source syncs with your index.
- FULL_CRAWL to index only new, modified, and deleted content each time your data source syncs with your index. Amazon Kendra can use your data source’s mechanism for tracking content changes and index content that changed since the last sync.
- CHANGE_LOG to index only new and modified content each time your data source syncs with your index. Amazon Kendra can use your data source’s mechanism for tracking content changes and index content that changed since the last sync.
Identity crawler—Specify whether to turn on Amazon Kendra’s identity crawler. The identity crawler uses the access control list (ACL) information for your documents to filter search results based on the user or their group access to documents. If you have an ACL for your documents and choose to use your ACL, you can then also choose to turn on Amazon Kendra’s identity crawler to configure user context filtering of search results. Otherwise, if identity crawler is turned off, all documents can be publicly searched. If you want to use access control for your documents and identity crawler is turned off, you can alternatively use the PutPrincipalMapping API to upload user and group access information for user context filtering.

Note
Identity crawler is available only when you set crawlAcl to true.
Repository Additional Properties—Specify the:
- (For Azure AD) s3bucketName and s3certificateName you use to store your Azure AD self-signed X.509 certificate.
- Authentication type (auth_Type) you use, whether OAuth2, OAuth2App, OAuth2Certificate, Basic, OAuth2_RefreshToken, NTLM, and Kerberos.
- Version (version) you use, whether Server or Online. If you use Server you can futher specify the onPremVersion as 2013, 2016, 2019, or SubscriptionEdition.

Secret Amazon Resource Name (ARN)—Provide the Amazon Resource Name (ARN) of a Secrets Manager secret that contains the authentication credentials you created in your SharePoint account.

If you use SharePoint Online, you can choose between Basic, OAuth 2.0, Azure AD App-only and SharePoint App Only authentication. The following are the minimum JSON structure that must be in your secret for each authentication option:

Basic authentication


{
    "userName": "SharePoint account user name",
    "password": "SharePoint account password"
}

OAuth 2.0 authentication


{
    "clientId": "client id generated when registering SharePoint with Azure AD",
    "clientSecret": "client secret generated when registering SharePoint with Azure AD",
    "userName": "SharePoint account user name",
    "password": "SharePoint account password"
}

Azure AD App-Only authentication


{
    "clientId": "client id generated when registering SharePoint with Azure AD",
    "privateKey": "private key to authorize connection with Azure AD"
}

SharePoint App-Only authentication


{
    "clientId": "client id generated when registering SharePoint for App Only at Tenant Level",
    "clientSecret": "client secret generated when registering SharePoint for App Only at Tenant Level",
    "adClientId": "client id generated while registering SharePoint with Azure AD",
    "adClientSecret": "client secret generated while registering SharePoint with Azure AD"
}

OAuth 2.0 refresh token authentication


{
    "clientId": "client id generated when registering SharePoint with Azure AD",
    "clientSecret": "client secret generated when registering SharePoint with Azure AD",
    "refreshToken": "refresh token generated to connect to SharePoint"
}

If you use SharePoint Server, you can choose between SharePoint App-Only authentication, NTLM authentication, and Kerberos authentication. The following are the minimum JSON structure that must be in your secret for each authentication option:

SharePoint App-Only authentication


{
    "siteUrlsHash": "Hash representation of SharePoint site URLs",
    "clientId": "client id generated when registering SharePoint for App Only at Site Level",
    "clientSecret": "client secret generated when registering SharePoint for App Only at Site Level" 
}

SharePoint App-Only authentication with domain from IDP authorization


{
    "siteUrlsHash": "Hash representation of SharePoint site URLs",
    "clientId": "client id generated when registering SharePoint for App Only at Site Level",
    "clientSecret": "client secret generated when registering SharePoint for App Only at Site Level",
    "ldapUrl": "LDAP Account url eg. ldap://example.com:389",
    "baseDn": "LDAP Account base dn eg. CN=Users,DC=sharepoint,DC=com",
    "ldapUser": "LDAP account user name",
    "ldapPassword": "LDAP account password"
}

(Server only) NTLM or Kerberos authentication


{
    "siteUrlsHash": "Hash representation of SharePoint site URLs",
    "userName": "SharePoint account user name",
    "password": "SharePoint account password"
}

(Server only) NTLM or Kerberos authentication with domain from IDP authorization


{
    "siteUrlsHash": "Hash representation of SharePoint site URLs",
    "userName": "SharePoint account user name",
    "password": "SharePoint account password",
    "ldapUrl": "ldap://example.com:389",
    "baseDn": "CN=Users,DC=sharepoint,DC=com",
    "ldapUser": "LDAP account user name",
    "ldapPassword": "LDAP account password"
}

Note

We recommend that you regularly refresh or rotate your credentials and secret. Provide only the necessary access level for your own security. We do not recommend that you re-use credentials and secrets across data sources, and connector versions 1.0 and 2.0 (where applicable).

IAM role—Specify RoleArn when you call CreateDataSource to provide an IAM role with permissions to access your Secrets Manager secret and to call the required public APIs for the SharePoint connector and Amazon Kendra. For more information, see IAM roles for SharePoint data sources.

You can also add the following optional features:

Virtual Private Cloud (VPC)—Specify VpcConfiguration when you call CreateDataSource. For more information, see Configuring Amazon Kendra to use an Amazon VPC.
Inclusion and exclusion filters—You can specify whether to include or exclude certain files, OneNotes, and other content.

Note
Most data sources use regular expression patterns, which are inclusion or exclusion patterns referred to as filters. If you specify an inclusion filter, only content that matches the inclusion filter is indexed. Any document that doesn’t match the inclusion filter isn’t indexed. If you specify an inclusion and exclusion filter, documents that match the exclusion filter are not indexed, even if they match the inclusion filter.
Field mappings—Choose to map your SharePoint data source fields to your Amazon Kendra index fields. For more information, see Mapping data source fields.

Note
The document body field or the document body equivalent for your documents is required in order for Amazon Kendra to search your documents. You must map your document body field name in your data source to the index field name _document_body. All other fields are optional.

For a list of other important JSON keys to configure, see Microsoft SharePoint template schema.

Notes

The connector supports custom field mappings only for the Files entity.
For all SharePoint Server versions, the ACL token must be in lower case. For Email with Domain from IDP and Email ID with Custom Domain ACL, for example: user@sharepoint2019.com. For Domain\User with Domain ACL, for example: sharepoint2013\user.
The connector does not support change log mode/New or modified content sync for SharePoint 2013.
If an entity name has a % character in its name, the connector will skip these files due to API limitations.
OneNote can only be crawled by the connector using a Tenant ID, and with OAuth 2.0, OAuth 2.0 refresh token, or SharePoint App Only authentication activated for SharePoint Online.
The connector crawls the first section of a OneNote document using its default name only, even if the document is renamed.
The connector crawls links in SharePoint 2019, SharePoint Online, and Subscription Edition, only if Pages and Files are selected as entities to be crawled in addition to Links.
The connector crawls links in SharePoint 2013 and SharePoint 2016 if Links is selected as an entity to be crawled.
The connector crawls list attachments and comments only when List Data is also selected as an entity to be crawled.
The connector crawls event attachments only when Events is also selected as an entity to be crawled.
For SharePoint Online version, the ACL token will be in lower case. For example, if User principal name is MaryMajor@domain.com in Azure portal, the ACL token in the SharePoint Connector will be marymajor@domain.com.
In Identity Crawler for SharePoint Online and Server, if you want to crawl nested groups, you have to activate Local as well as AD Group Crawling.
If you're using SharePoint Online, and the User Principal Name in your Azure Portal is a combination of upper case and lower case, the SharePoint API internally converts it to lower case. Because of this, the Amazon Kendra SharePoint connector sets ACL in lower case.

Warning Javascript is disabled or is unavailable in your browser.

To use the Amazon Web Services Documentation, Javascript must be enabled. Please refer to your browser's Help pages for instructions.

Document Conventions

SharePoint connector V1.0

Microsoft SQL Server