The Qoder CN enterprise knowledge base lets you connect to your own storage service to meet your data security and sensitivity requirements. This topic shows you how to switch from the built-in storage to your own storage service.
Qoder CN administrators and organization-wide global administrators (Exclusive Edition) can switch the knowledge base storage service from the Qoder CN built-in storage service to an enterprise's own storage service in Storage Migration of the Qoder CN console.
If your storage service supports public network access, Qoder CN Enterprise Dedicated Edition can connect to it directly. For enhanced security, you can configure an IP address whitelist to control access. If not configured, see Network configuration.
If your storage service is not publicly accessible, you must configure a VPC to enable communication between your service and Qoder CN Enterprise Dedicated Edition. You also need to enable reverse access so Qoder CN can retrieve resources from your storage service. If not configured, see Network configuration and Enable reverse access.
Prepare your storage services:
Object storage: For more information, see Alibaba Cloud OSS guide.| Compatible products | Alibaba Cloud OSS, Amazon S3, Tencent Cloud COS, Huawei Cloud OBS, and open-source MinIO |
|---|---|
| Required permissions | The authorized account must have the following permissions:
List objects in bucket (List): Allows listing all objects.
Upload new objects (Put): Allows uploading new objects.
Delete objects (Delete): Allows deleting objects.
|
| Storage class | Standard (non-archival) |
| Version | All versions are compatible. |
| Storage capacity | At least 10 GB. This can be expanded later based on usage. |
Vector database: For more information, see Alibaba Cloud Elasticsearch configuration guide.| Compatible products | Elasticsearch Enterprise Edition and Elasticsearch open-source edition |
|---|---|
| Version | Version 8.15 or later |
| Required permissions | The authorized account must have the following permissions:
Create index (create_index): Allows creating new indexes. If the request also includes an alias, the manage permission is also required.
Write documents (write,create_doc): Allows all document write operations, including indexing, updating, deleting, bulk operations, and updating mappings.
Read documents (read): Allows read-only operations such as count, explain, get, mget, scripts, search, and scroll.
Delete documents (delete): Allows deleting documents from an index.
Required index privileges: The user must have create_index, read, delete, and index privileges for the relevant indexes.
|
| Storage capacity | At least 300 GB. This can be expanded later based on usage. |
| Configure an IP address whitelist (optional) | When you access an Alibaba Cloud Elasticsearch instance, we recommend adding the accessing device's IP address to the instance's IP address whitelist. To get the egress IP address of your Qoder CN instance, submit a ticket. |
The enterprise knowledge base uses two types of storage: object storage for uploaded files such as documents and code packages, and a vector database for chunked and vectorized data.Qoder CN supports migrating both the object storage and vector database services for maximum security and privacy of your knowledge base data. The following diagram shows the end-to-end process for storage service migration and usage:1. As a prerequisite, a Qoder CN administrator or an enterprise administrator configures public or private network access on the Enterprise Management page of the Alibaba Cloud Management Console, and configures storage service migration in the Qoder CN console.
2. Usage: After the migration, when an administrator uploads a knowledge base file, Qoder CN saves the file to your object storage and the vector data to your vector database.
Log on to the Alibaba Cloud Management Console and configure the network access settings for your Qoder CN Enterprise Dedicated Edition.
Public network access
If your storage service supports public network access, see Network configuration to configure public network access for Qoder CN Enterprise Dedicated Edition. You can also configure an IP address whitelist to enhance data security.
VPC access
If your own storage service does not support public network access, you must configure a VPC between Qoder CN Enterprise Dedicated Edition and your storage service to enable access, and enable reverse access to allow Qoder CN Enterprise Dedicated Edition to obtain resources from your storage service. To configure VPC access and reverse access, see Network configuration and Enable reverse access.
Log on to the Qoder CN enterprise console. On the Knowledge Management page, click Storage Migration.
On the Storage Migration page, configure the connection settings for your object storage and vector database. After you enter the required information, click Test Connection to verify the settings. If the connection is successful, click Save. A "Migration completed" message confirms a successful configuration.
After you save the configuration, the changes take effect immediately. All content in the default Qoder CN knowledge base is cleared, and the knowledge base in the Qoder CN console is reset to an empty state.This action is irreversible from the console. To switch back to the built-in Qoder CN storage service, you must submit a ticket.
After the service switch configuration takes effect, when you upload data to the knowledge base, Qoder CN uploads the data to the object storage service configured by the administrator. After the configuration is complete, on the Knowledge Management page, you can view information about the added files in the Knowledge List, such as the Data Processing Status (a status of "Completed" indicates successful processing), file size, popularity, uploader, and upload time. Click Add Data in the upper-right corner to upload new files, and click Remove for a file to delete it. After the configuration is complete, you can also use OSS Browser to log in to the corresponding OSS bucket and confirm in the file management interface that the knowledge base files, such as zz112344.txt, have been successfully written to the target storage path.
If file uploads fail after you switch to your own storage service, a connection issue is the likely cause. Go to the Storage Migration page and verify that the connection to your storage service is active.
