Understanding Feedback in Orion
What is Feedback?
Feedback in Orion is a powerful mechanism that allows you to provide input on insights and guide the system to deliver more relevant and accurate results over time. By highlighting specific text and adding your comments, you help Orion learn your preferences and improve future analyses.
Why Provide Feedback?
When you provide feedback on insights, Orion:
- Learns your preferences and analytical requirements
- Applies these learnings to future assignments
- Improves the quality and relevance of insights over time
- Creates a continuous improvement cycle for your data analysis
Adding Feedback
To provide feedback on an insight:
- Navigate to the insight detail page
- Highlight the specific text you want to comment on
- Select thumbs up (👍) or thumbs down (👎) to indicate positive or negative sentiment
- Enter your feedback text in the field that appears
- (Optional) Click the gear icon (⚙️) to add rules to your feedback
- Click the checkmark (✓) to save your feedback
Your feedback is now stored and will be applied to future analyses using the same template.
Understanding Feedback Rules
Rules allow you to specify exactly when and where your feedback should be applied, making feedback more precise and contextual.
Types of Rules
Orion supports four types of rules:
- Tag Rules (
Tag
): Apply feedback based on specific tags associated with insights - User Rules (
User
): Apply feedback only for specific users - Prompt Text Rules (
Prompt Text
): Apply feedback when certain text appears in prompts - Insight Text Rules (
Insight Text
): Apply feedback when certain text appears in insights
Rule Operators
Each rule type supports specific operators:
- For
Tag
andUsers
rules: Is
: Apply when the value matches one in the list-
Is not
: Apply when the value doesn't match any in the list -
For
Prompt Text
andInsight Text
rules: Contains
: Apply when the text contains the specified valueDoes not contain
: Apply when the text doesn't contain the specified value
How Rules Work Together
- Multiple rules in a ruleset use AND logic (all rules must be satisfied)
- If no rules are specified, the feedback applies to all contexts
- Rules are evaluated against the context of each insight
- More specific rules create more targeted feedback application
Adding Rules to Feedback
When Creating New Feedback
- After highlighting text and selecting your feedback sentiment (thumbs up/down)
- Enter your feedback text
- Click the gear icon (⚙️) to open the rules panel
- Click "Add Rule"
- Configure your rule:
- Select the rule type (Tag, User, Prompt Text, Insight Text)
- Choose an appropriate operator (Is, Is not, Contains, Does not contain)
- Enter the value(s) for your rule
- Click the checkmark (✓) to save your feedback with the rules
For Existing Feedback
- Navigate to the Configuration page and select the Feedback tab
- Locate the feedback you want to modify
- Click the three dots (⋯) next to the feedback
- In the Rules section, click "Add Rule"
- Configure your rule as described above
- Click Save to apply the rule
You can add multiple rules to create precise conditions for when your feedback should be applied.
The Template-Feedback Connection
Orion maintains a relationship between templates and feedback:
- Feedback provided on any insight is associated with its source template
- New assignments created from a template automatically inherit all previous feedback
- This ensures consistent improvement across all analyses from the same template
- You only need to provide specific feedback once for it to benefit all future related assignments
Managing Feedback
Viewing Feedback
- Navigate to the Configuration page
- Select the Feedback tab to see all feedback across your organization
- Use filters to find specific feedback items
Editing Feedback
- Navigate to the Feedback tab in Configuration
- Find the feedback you want to edit
- Click the three dots (⋯) to open the feedback tray
- Select "Edit"
- Make your changes to the feedback text
- Click "Save"
Deleting Feedback
From the Configuration page: 1. Navigate to the Feedback tab 2. Find the feedback you want to delete 3. Click the three dots (⋯) to open the feedback tray 4. Click the delete button 5. Confirm deletion when prompted
From an Insight: 1. Hover over the highlighted text containing feedback 2. Click the trashcan (🗑️) icon in the tooltip 3. Confirm deletion when prompted
Changing Feedback Status
You can set feedback as Active or Ignored:
- From the feedback list, click the dropdown arrow next to status
- Select either "Active" or "Ignore"
- Active feedback is applied to analyses, while ignored feedback is not
Best Practices for Effective Feedback
- Be detailed & specific in your feedback comments
- Use rules to target feedback to appropriate contexts
- Regularly review and clean up outdated feedback
- Combine feedback with tags for more organized knowledge management
- Start with broader feedback and refine with more specific rules over time
By effectively using Orion's feedback system, you create a continuously improving analytical environment that becomes increasingly aligned with your organization's needs and preferences.