Storm OpenAPI(en)
  1. Admin Tools
Storm OpenAPI(en)
  • Welcome to STORM
    • Introduction
  • Quickstart
    • Getting Started
      • Creating an Agent
      • Account Creation
    • Core Scenario
      • Document Upload
      • Workflow Design
      • Test
      • Deployment
      • Channel Integration
  • Feature Guide
    • Console
      • Agent Management
      • Dashboard
      • Permission Management
    • Agent Template
      • Knowledge Retrieval
      • Character Dialogue
      • Consultation Record Analysis
      • SQL Query
      • News Article
    • Agent Builder
      • Knowledge
        • Documents
        • Folders
        • Feedback
      • Workflow
        • Node Description
          • LLM
          • Search(RAG)
          • API
          • IF ELSE
          • Variable Declaration and Assignment
          • Postprocessing
      • Test
      • Log
      • Dashboard
    • Admin Tools
      • Deployment Management
      • Channel Integration
      • Model Fine-Tuning
      • Training Data Quality Management
      • Other Settings
  • Apis
    • Agent
      • Deploy Agent
      • View Agent Deployment History
      • View Agent
    • Bucket
      • Create Bucket
      • View Bucket
    • Document
      • Document Training Request by file
      • Document Training Request by URL
      • View Documents
      • Delete Document
    • Chat
      • Send Chat (non-stream)
      • Send Chat (stream)
      • Search Context
    • STORM Parse
      • /convert/md
    • Instance Agent
      • Add Instance Session
      • Upload Instance Document
      • Request RAG Source For Query
      • Delete Instance Session
  • Learn More
    • FAQ
    • Pricing
  1. Admin Tools

Training Data Quality Management

Training Data Quality Management#

The Training Data Quality Management page automatically scans registered knowledge to ensure that sensitive information is not included in the training data.
This feature is designed to enhance security and stability, especially in environments where it is unrealistic for operators to manually review every piece of uploaded content.
image10 1.png

Review Options for Training Data#

“Review Required” on Sensitive Information Detection
When this option is enabled, the system continues training even if sensitive information is detected.
However, all detected items are automatically added to the “Review Required” list so that administrators can review them afterward.
“Training Failure” on Sensitive Information Detection
When this option is selected, training is automatically stopped for any knowledge containing detected sensitive information.
This option is recommended for agents that handle highly sensitive or confidential data, providing a stricter level of data governance.

Review Pattern List#

Pattern Name
Clearly identify the type of sensitive information to be detected.
Examples: Customer Phone Number, Resident Registration Number, Internal Project Name, etc.
Regular Expression Pattern
Define sensitive data patterns using regular expressions (Regex) to detect matching content.



Group 633224.png
When the system detects text matching a registered pattern, the details can be viewed in the Training Data Quality column.
Modified at 2025-10-20 05:57:41
Previous
Model Fine-Tuning
Next
Other Settings
Built with