{"id":470,"date":"2020-10-29T18:24:49","date_gmt":"2020-10-29T18:24:49","guid":{"rendered":"https:\/\/machine-learning.webcloning.com\/2020\/10\/29\/configuring-your-amazon-kendra-confluence-server-connector\/"},"modified":"2020-10-29T18:24:49","modified_gmt":"2020-10-29T18:24:49","slug":"configuring-your-amazon-kendra-confluence-server-connector","status":"publish","type":"post","link":"https:\/\/salarydistribution.com\/machine-learning\/2020\/10\/29\/configuring-your-amazon-kendra-confluence-server-connector\/","title":{"rendered":"Configuring your Amazon Kendra Confluence Server connector"},"content":{"rendered":"<div id=\"\">\n<p>Many builders and teams on AWS use Confluence as a way of collaborating and sharing information within their teams and across their organizations. These types of workspaces are rich with data and contain sets of knowledge and information that can be a great source of truth to answer organizational questions.<\/p>\n<p>Unfortunately, it isn\u2019t always easy to tap into these data sources to extract the information you need. For example, the data source might not be connected to an enterprise search service within the organization, or the service is outdated and lacks natural language search capabilities, leading to poorer search experiences.<\/p>\n<p><a href=\"https:\/\/aws.amazon.com\/kendra\/\" target=\"_blank\" rel=\"noopener noreferrer\">Amazon Kendra<\/a> is an intelligent search service powered by machine learning (ML). Amazon Ken\u00addra reimagines enterprise search for your websites and applications so your employees and customers can easily find the content they\u2019re looking for, even when it\u2019s scattered across multiple locations and content repositories within your organization.<\/p>\n<p>Amazon Kendra lets you easily add data sources using a wide range of connector types, so you can use its intelligent search capabilities to search your content repositories. Amazon Kendra maintains document access rights and automatically syncs with your index to make sure you\u2019re always searching the most up-to-date content.<\/p>\n<p>In this post, we walk through the process of setting up your Amazon Kendra connector for Confluence Server.<\/p>\n<h2>Prerequisites<\/h2>\n<p>The post assumes that you have Confluence set up and an index created in Amazon Kendra. For instructions on setting up your index, see <a href=\"https:\/\/docs.aws.amazon.com\/kendra\/latest\/dg\/create-index.html\" target=\"_blank\" rel=\"noopener noreferrer\">Creating an index<\/a>.<\/p>\n<h2>Creating the Confluence connector<\/h2>\n<p>To set up your Confluence connector, complete the following steps:<\/p>\n<ol>\n<li>On the Amazon Kendra console, navigate to your index and choose <strong>Add data sources<\/strong>.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17530 size-full\" title=\"Add data sources\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/1-Confluence-test.jpg\" alt=\"\" width=\"900\" height=\"279\"><\/p>\n<ol start=\"2\">\n<li>From the list of available connectors, choose <strong>Confluence Server<\/strong>.<\/li>\n<li>Choose <strong>Add connector<\/strong>.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17531 size-full\" title=\"Add connector\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/2-ConfluenceServer.jpg\" alt=\"\" width=\"900\" height=\"557\"><\/p>\n<p>Next, we need to specify the data source details.<\/p>\n<ol start=\"4\">\n<li>For <strong>Data source name<\/strong>, enter a name.<\/li>\n<li>For <strong>Description<\/strong>, enter an optional description.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17532 size-full\" title=\"Enter an optional description\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/3-SpecifyDataSourceDetails.jpg\" alt=\"\" width=\"900\" height=\"569\"><\/p>\n<p>The next step is data access and security.<\/p>\n<ol start=\"6\">\n<li>For <strong>Confluence URL<\/strong>, enter the URL to your Confluence site.<\/li>\n<\/ol>\n<p>If your site is running in a private VPC, you must configure Amazon Kendra to access your VPC resources.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17533 size-full\" title=\"Define access and security\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/4-Defineaccessandsecurity.jpg\" alt=\"\" width=\"900\" height=\"267\"><\/p>\n<ol start=\"7\">\n<li>In the <strong>Set authentication<\/strong> section, for <strong>Type of authentication<\/strong>, you can choose to create new authentication credentials or use an existing one. (For this post, we choose <strong>New<\/strong>.)<\/li>\n<li>For <strong>Secret name<\/strong>, enter a name.<\/li>\n<li>For <strong>User name<\/strong>\u00b8 enter your Confluence account user name.<\/li>\n<li>For <strong>Password<\/strong>, enter a password.<\/li>\n<\/ol>\n<p>This information is stored in <a href=\"https:\/\/aws.amazon.com\/secrets-manager\" target=\"_blank\" rel=\"noopener noreferrer\">AWS Secrets Manager<\/a>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17534 size-full\" title=\"Set authentication\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/5-Setauthentication.jpg\" alt=\"\" width=\"900\" height=\"501\"><\/p>\n<ol start=\"11\">\n<li>In the <strong>Set IAM role <\/strong>section, choose the <a href=\"http:\/\/aws.amazon.com\/iam\" target=\"_blank\" rel=\"noopener noreferrer\">AWS Identity and Access Management<\/a> (IAM) role that Amazon Kendra uses to crawl your Confluence data and update the index.<\/li>\n<\/ol>\n<p>At minimum, the role should have permission to create and update indexes in Amazon Kendra and read your Confluence credentials from Secrets Manager.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17535 size-full\" title=\"Set IAM role\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/6-SetIAMrole.jpg\" alt=\"\" width=\"900\" height=\"310\"><\/p>\n<p>In the <strong>Configure sync settings <\/strong>section, you set up your index sync options.<\/p>\n<ol start=\"12\">\n<li>For <strong>Set sync scope<\/strong>, choose to include or exclude specific Confluence workspaces.<\/li>\n<li>For <strong>Set sync run schedule<\/strong>, choose the schedule you want for your sync jobs. Each data source can have its own update schedule.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17536 size-full\" title=\"Choose the schedule you want for your sync jobs\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/7-Configuresyncsettings.jpg\" alt=\"\" width=\"900\" height=\"701\"><\/p>\n<p>Custom attributes allow you to add additional metadata to your documents in the index. For example, you can create a custom attribute called <code>Department<\/code> with values <code>HR<\/code>, <code>Sales<\/code>, and <code>Manufacturing<\/code>. You can apply these attributes to your documents so that you can limit the response to documents in the <code>HR<\/code> department, for example.<\/p>\n<ol start=\"14\">\n<li>In the field mapping section, you can choose the mappings of Confluence fields to Amazon Kendra fields in the index. You can update required fields, recommended fields, and additional suggested field mappings.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17537 size-full\" title=\"Choose the mappings of Confluence fields\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/8-Other.jpg\" alt=\"\" width=\"900\" height=\"623\"><\/p>\n<ol start=\"15\">\n<li>Review your settings summary to check if everything looks okay and choose <strong>Add data source<\/strong>.<\/li>\n<\/ol>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17538 size-full\" title=\"Add data source\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/9-SyncSchedule.jpg\" alt=\"\" width=\"900\" height=\"544\"><\/p>\n<h2>Starting the Confluence connector manually<\/h2>\n<p>After you create your data source, you can start the sync process manually by choosing <strong>Sync now<\/strong>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17539 size-full\" title=\"Start the sync process manually by choosing Sync now\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/10-Sync.jpg\" alt=\"\" width=\"900\" height=\"193\"><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17540 size-full\" title=\"Start the sync process manually by choosing Sync now\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/11-AliensConfluence.jpg\" alt=\"\" width=\"900\" height=\"455\"><\/p>\n<p>When the sync job is complete, the status shows as <code>Succeeded<\/code>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17541 size-full\" title=\"Status shows as Succeeded\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/12-Succeeded.jpg\" alt=\"\" width=\"900\" height=\"125\"><\/p>\n<h2>Testing the results<\/h2>\n<p>After the sync job is complete, you can search many different ways. For this post, we walk through using the Amazon Kendra console to test the results. For more information, see <a href=\"https:\/\/docs.aws.amazon.com\/kendra\/latest\/dg\/searching-example.html#searching-index-console\" target=\"_blank\" rel=\"noopener noreferrer\">Querying an index (console)<\/a>.<\/p>\n<p>In the navigation pane, choose <strong>Search console<\/strong>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17543 size-full\" title=\"Choose Search console\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/Dropdown.jpg\" alt=\"\" width=\"350\" height=\"311\"><\/p>\n<p>Now you can search the index.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone wp-image-17542 size-full\" title=\"Searching the index\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/End-SearchtheIndex.jpg\" alt=\"\" width=\"900\" height=\"592\"><\/p>\n<h2>Conclusion<\/h2>\n<p>In this post, we walked through the process of creating and running the Confluence Server data source connector. This connector enables you to connect to a Confluence data source, specify which areas to crawl, and how to process field metadata elements and other key functions.<\/p>\n<p>By doing this, you can use the intelligent search capabilities of Amazon Kendra, powered by ML, on your Confluence Server content. To see a full list of data sources currently supported by Amazon Kendra, see <a href=\"https:\/\/docs.aws.amazon.com\/kendra\/latest\/dg\/hiw-data-source.html\" target=\"_blank\" rel=\"noopener noreferrer\">Data sources<\/a>.<\/p>\n<p>\u00a0<\/p>\n<hr>\n<h3>About the Authors<\/h3>\n<p><strong><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-4140 alignleft\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2018\/04\/08\/ben-snively-100.jpg\" alt=\"\" width=\"100\" height=\"133\">Ben Snively<\/strong>\u00a0is an AWS Public Sector Specialist Solutions Architect.\u00a0He works with government, non-profit, and education customers on big data\/analytical and AI\/ML projects, helping them build solutions using AWS.<\/p>\n<p>\u00a0<\/p>\n<p>\u00a0<\/p>\n<p>\u00a0<\/p>\n<p><strong><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-17550 alignleft\" src=\"https:\/\/d2908q01vomqb2.cloudfront.net\/f1f836cb4ea6efb2a0b1b99f41ad8b103eff4b59\/2020\/10\/28\/Palani.jpg\" alt=\"\" width=\"101\" height=\"115\">Sam Palani<\/strong>\u00a0is an AI\/ML Specialist Solutions Architect at AWS. He works with public sector customers to help them architect and implement machine learning solutions at scale. When not helping customers, he enjoys long hikes, unwinding with a good book, listening to his classical vinyl collection and hacking projects with Raspberry Pi.<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/aws.amazon.com\/blogs\/machine-learning\/configuring-your-amazon-kendra-confluence-server-connector\/<\/p>\n","protected":false},"author":0,"featured_media":471,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3],"tags":[],"_links":{"self":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/470"}],"collection":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/comments?post=470"}],"version-history":[{"count":0,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/posts\/470\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media\/471"}],"wp:attachment":[{"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/media?parent=470"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/categories?post=470"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/salarydistribution.com\/machine-learning\/wp-json\/wp\/v2\/tags?post=470"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}