Skip to content

Understanding Feedback in Orion

What is Feedback?

Feedback in Orion is a powerful mechanism that allows you to provide input on insights and guide the system to deliver more relevant and accurate results over time. By highlighting specific text and adding your comments, you help Orion learn your preferences and improve future analyses.

Insight Feedback Example

Why Provide Feedback?

When you provide feedback on insights, Orion:

  • Learns your preferences and analytical requirements
  • Applies these learnings to future assignments
  • Improves the quality and relevance of insights over time
  • Creates a continuous improvement cycle for your data analysis

Adding Feedback

To provide feedback on an insight:

  1. Navigate to the insight detail page
  2. Highlight the specific text you want to comment on
  3. Select thumbs up (👍) or thumbs down (👎) to indicate positive or negative sentiment
  4. Enter your feedback text in the field that appears
  5. (Optional) Click the gear icon (⚙️) to add rules to your feedback
  6. Click the checkmark (✓) to save your feedback

Apply Feedback

Your feedback is now stored and will be applied to future analyses using the same template.

Understanding Feedback Rules

Rules allow you to specify exactly when and where your feedback should be applied, making feedback more precise and contextual.

Types of Rules

Orion supports four types of rules:

  1. Tag Rules (Tag): Apply feedback based on specific tags associated with insights
  2. User Rules (User): Apply feedback only for specific users
  3. Prompt Text Rules (Prompt Text): Apply feedback when certain text appears in prompts
  4. Insight Text Rules (Insight Text): Apply feedback when certain text appears in insights

Rule Operators

Each rule type supports specific operators:

  • For Tag and Users rules:
  • Is: Apply when the value matches one in the list
  • Is not: Apply when the value doesn't match any in the list

  • For Prompt Text and Insight Text rules:

  • Contains: Apply when the text contains the specified value
  • Does not contain: Apply when the text doesn't contain the specified value

How Rules Work Together

  • Multiple rules in a ruleset use AND logic (all rules must be satisfied)
  • If no rules are specified, the feedback applies to all contexts
  • Rules are evaluated against the context of each insight
  • More specific rules create more targeted feedback application

Adding Rules to Feedback

When Creating New Feedback

  1. After highlighting text and selecting your feedback sentiment (thumbs up/down)
  2. Enter your feedback text
  3. Click the gear icon (⚙️) to open the rules panel
  4. Click "Add Rule"
  5. Configure your rule:
  6. Select the rule type (Tag, User, Prompt Text, Insight Text)
  7. Choose an appropriate operator (Is, Is not, Contains, Does not contain)
  8. Enter the value(s) for your rule
  9. Click the checkmark (✓) to save your feedback with the rules

Apply Feedback with rules

For Existing Feedback

  1. Navigate to the Configuration page and select the Feedback tab
  2. Locate the feedback you want to modify
  3. Click the three dots (⋯) next to the feedback
  4. In the Rules section, click "Add Rule"
  5. Configure your rule as described above
  6. Click Save to apply the rule

You can add multiple rules to create precise conditions for when your feedback should be applied.

The Template-Feedback Connection

Orion maintains a relationship between templates and feedback:

  • Feedback provided on any insight is associated with its source template
  • New assignments created from a template automatically inherit all previous feedback
  • This ensures consistent improvement across all analyses from the same template
  • You only need to provide specific feedback once for it to benefit all future related assignments

Managing Feedback

Viewing Feedback

  1. Navigate to the Configuration page
  2. Select the Feedback tab to see all feedback across your organization
  3. Use filters to find specific feedback items

Feedback Table

Editing Feedback

  1. Navigate to the Feedback tab in Configuration
  2. Find the feedback you want to edit
  3. Click the three dots (⋯) to open the feedback tray
  4. Select "Edit"
  5. Make your changes to the feedback text
  6. Click "Save"

Feedback Sheet Rules

Deleting Feedback

From the Configuration page: 1. Navigate to the Feedback tab 2. Find the feedback you want to delete 3. Click the three dots (⋯) to open the feedback tray 4. Click the delete button 5. Confirm deletion when prompted

From an Insight: 1. Hover over the highlighted text containing feedback 2. Click the trashcan (🗑️) icon in the tooltip 3. Confirm deletion when prompted

Changing Feedback Status

You can set feedback as Active or Ignored:

  1. From the feedback list, click the dropdown arrow next to status
  2. Select either "Active" or "Ignore"
  3. Active feedback is applied to analyses, while ignored feedback is not

Best Practices for Effective Feedback

  • Be detailed & specific in your feedback comments
  • Use rules to target feedback to appropriate contexts
  • Regularly review and clean up outdated feedback
  • Combine feedback with tags for more organized knowledge management
  • Start with broader feedback and refine with more specific rules over time

By effectively using Orion's feedback system, you create a continuously improving analytical environment that becomes increasingly aligned with your organization's needs and preferences.