Skip to main content
DatabricksCustomer feedback

A commenter reports that their organization hosted weekly office hours and workshops for Databricks Genie, but three months post-demo nobody uses it.

What happened

Post: "Databricks Genie agent."

Source

RedditOct 24, 2026By u/Limp-Hovercraft7990

r/databricks

Databricks Genie agent.

upvotes
30
comments
20

Post

My company wants to roll out a Databricks Genie agent to around 5,000 users, with these requirements: Accuracy: Answers should consistently meet 90%+ accuracy. Reliability as data grows: The agent should not hallucinate or degrade when more tables are added. Scalability: The solution should extend from one business unit to multiple BUs. can we use genie In microsoft Teams. I’ve gone through the official Databricks documentation but haven’t found concrete guidance on achieving or measuring these. How would you approach this? Any architecture patterns, evaluation frameworks, or lessons from similar rollouts would be really helpful.

Extracted from these lines

  • [comment u/cafealpha82] My org had genie agent workshop every week / office hour to walk through business how to use with pretty good semantic model. After initial pretty demos - fast forward 3 mo - no one uses.

reddit.com/r/databricks/comments/1xe2uzw/databricks_genie_agentRead the full source

Comments on the post

5 of 20 comments
  • “Use the genie workbench to optimize the agent across its tables and metadata, then use the chat mode api and the experiments feature in databricks to implement LLM judge based production monitoring and regression testing on the system tables containing its traces. That will allow you to calibrate it to that 90% standard and monitor its performance for degradation. You will never get no hallucina”

    u/shadowfax1222115 points · Oct 24, 2026View

  • “Lmao”

    u/Arnechos10 points · Oct 24, 2026View

  • “Don’t use Microsoft teams - you get no agent mode and no inspect which means your answer quality will be terrible. No one here is talking about metric views… that is the number one way you can get 90+% accuracy. As others have said, pilot to 50 years then 250 etc etc. you’ll need to be very engaged in going through the questions people are asking”

    u/Dry_Young_93969 points · Oct 24, 2026View

  • “Just remember to add “make no mistakes” to all your prompts. You got this!”

    u/throwaway7371666 points · Oct 24, 2026View

  • “Do a canary release. Pilot to 50 users first, then 500, and so on. Focus on 1 BU first to experience how to make a functional Genie Agents. That experience later you can scale to more BUs. Benchmarking in Genie can be used to evaluate accuracy and hallucination. You said you have gone through the docs, no chance you didn't stumble upon this if you really did go through it. Yes Genie can be use”

    u/addictzz3 points · Oct 24, 2026View

Extracted by Autobound

From the Signal API record
Signal
Customer feedback

What this signalsUser posts often show product pain before it reaches reviews or churn.

Subreddit
r/databricks

The full record

From the Signal API record

Numbers

Mentions
18

Details

Timing
Ongoing state
Category
Usability
Virality
Somewhat high
Post kind
Text
Prominence
Aside
Company's role
Vendor

Topics and mentions

Topics

  • adoption
  • usability
  • ai

Flair

  • Discussion

Products named

  • Databricks Genie

Extraction

Sentiment
Negative
Detected
Oct 24, 2026
signal_type
reddit-company
signal_subtype
customerFeedback

Use this data

Get every Reddit signal for Databricks and the companies you sell to, in the tools you already use.

  1. Ask Claude about it

    Connect Autobound to Claude, Claude Code or Cursor with MCP. Then ask: “What changed at Databricks this week?”

  2. Send it to your own tools

    The Signal API returns Reddit signals for any list of companies as JSON, for your CRM, warehouse or app.

  3. Try it free

    Sign up and spend your free credits on the companies you sell to.

    Start Free1,000 free credits

The API returns more than this page shows

This page shows a preview. The full reddit-company record in the Signal API and MCP can also have these 8 fields. Some fields are empty for some signals.

Company

  • linkedin_urlValue in the API
  • industriesValue in the API
  • employee_count_lowValue in the API
  • employee_count_highValue in the API
  • revenueValue in the API
  • descriptionValue in the API

Signal

  • signal_nameValue in the API
  • associationValue in the API
Show the full JSONThe record on this page and the API request

GET /v1/signals/6e3ad9b3-e3bf-5808-a73b-312af3a816de returns this record as JSON. POST /v1/companies/enrich returns every signal for databricks.com.

{
  "signal_id": "6e3ad9b3-e3bf-5808-a73b-312af3a816de",
  "signal_type": "reddit-company",
  "signal_subtype": "customerFeedback",
  "detected_at": "2026-10-24T08:02:42+00:00",
  "company": {
    "name": "Databricks",
    "domain": "databricks.com"
  },
  "data": {
    "nsfw": false,
    "stage": "none",
    "awards": 0,
    "timing": "ongoing_state",
    "topics": [
      "adoption",
      "ai",
      "usability"
    ],
    "post_id": "1xe2uzw",
    "summary": "A commenter reports that their organization hosted weekly office hours and workshops for Databricks Genie, but three months post-demo nobody uses it.",
    "category": "usability",
    "comments": [
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkodywzhgo4/",
        "depth": 0,
        "score": 15,
        "author": "shadowfax12221",
        "excerpt": "Use the genie workbench to optimize the agent across its tables and metadata, then use the chat mode api and the experiments feature in databricks to implement LLM judge based production monitoring and regression testing on the system tables containing its traces. That will allow you to calibrate it to that 90% standard and monitor its performance for degradation.\n\n You will never get no hallucina",
        "posted_at": "2026-10-24T08:17:36.000Z",
        "author_url": "https://www.reddit.com/user/shadowfax12221/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkoegwg5z8g/",
        "depth": 0,
        "score": 10,
        "author": "Arnechos",
        "excerpt": "Lmao",
        "posted_at": "2026-10-24T08:17:55.000Z",
        "author_url": "https://www.reddit.com/user/Arnechos/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkqyak9qaoz/",
        "depth": 0,
        "score": 9,
        "author": "Dry_Young_9396",
        "excerpt": "Don’t use Microsoft teams - you get no agent mode and no inspect which means your answer quality will be terrible.\nNo one here is talking about metric views… that is the number one way you can get 90+% accuracy.\nAs others have said, pilot to 50 years then 250 etc etc. you’ll need to be very engaged in going through the questions people are asking",
        "posted_at": "2026-10-24T09:15:06.000Z",
        "author_url": "https://www.reddit.com/user/Dry_Young_9396/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rku6t9osash/",
        "depth": 0,
        "score": 6,
        "author": "throwaway737166",
        "excerpt": "Just remember to add “make no mistakes” to all your prompts. You got this!",
        "posted_at": "2026-10-24T10:27:40.000Z",
        "author_url": "https://www.reddit.com/user/throwaway737166/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkpb3aztg2r/",
        "depth": 0,
        "score": 3,
        "author": "addictzz",
        "excerpt": "Do a canary release. Pilot to 50 users first, then 500, and so on. Focus on 1 BU first to experience how to make a functional Genie Agents. That experience later you can scale to more BUs.\n\n Benchmarking in Genie can be used to evaluate accuracy and hallucination. You said you have gone through the docs, no chance you didn't stumble upon this if you really did go through it.\n\n Yes Genie can be use",
        "posted_at": "2026-10-24T08:38:14.000Z",
        "author_url": "https://www.reddit.com/user/addictzz/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkw81vkxgh0/",
        "depth": 0,
        "score": 3,
        "author": "erenhan",
        "excerpt": "You need to have multiple genie rooms, your tables should be as gold as possible, you should create LLM orchestrator, I suggest to deploy databricks app, its doable however you need a solid team",
        "posted_at": "2026-10-24T11:13:17.000Z",
        "author_url": "https://www.reddit.com/user/erenhan/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rkyvuczqois/",
        "depth": 0,
        "score": 3,
        "author": "Moneyshot_Larry",
        "excerpt": "You can only fit 30 tables in a genie agent so right out of the gate if you have 5000 users that had a WIDE variety of questions they want asks then you ain’t making a single genie agent. You’re making multiple, topic based genies that go DEEP in a few subjects and then databricks Genie One is your front door to have questions routed to the appropriate genie agent.",
        "posted_at": "2026-10-24T12:12:56.000Z",
        "author_url": "https://www.reddit.com/user/Moneyshot_Larry/"
      },
      {
        "url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/comment/19rl36ttrd9r7/",
        "depth": 0,
        "score": 3,
        "author": "car1os",
        "excerpt": "You need to focus on metric views, Pages. Domains, good table and column descriptions. Make sure you start seeing genie snippets. Define primary keys and foreign keys. Define multiple genie agents specialized in different topics. As others have said do a pilot with one BU. Then let users ask question in genie one. And see how it goes. Go one step at a time. Keep your pilot users engaged and set th",
        "posted_at": "2026-10-24T13:49:28.000Z",
        "author_url": "https://www.reddit.com/user/car1os/"
      }
    ],
    "evidence": [
      "[comment u/cafealpha82] My org had genie agent workshop every week / office hour to walk through business how to use with pretty good semantic model. After initial pretty demos - fast forward 3 mo - no one uses."
    ],
    "virality": "somewhat_high",
    "post_date": "2026-10-24T08:02:42.000Z",
    "post_kind": "text",
    "post_text": "My company wants to roll out a Databricks Genie agent to around 5,000 users, with these requirements:\n\nAccuracy: Answers should consistently meet 90%+ accuracy.\n\nReliability as data grows: The agent should not hallucinate or degrade when more tables are added.\n\nScalability: The solution should extend from one business unit to multiple BUs.\n\ncan we use genie In microsoft Teams.\n\nI’ve gone through the official Databricks documentation but haven’t found concrete guidance on achieving or measuring these. How would you approach this? Any architecture patterns, evaluation frameworks, or lessons from similar rollouts would be really helpful.",
    "sentiment": "negative",
    "subreddit": "databricks",
    "post_flair": [
      "Discussion"
    ],
    "post_title": "Databricks Genie agent.",
    "prominence": "aside",
    "source_url": "https://www.reddit.com/r/databricks/comments/1xe2uzw/databricks_genie_agent/",
    "entity_role": "vendor",
    "post_author": "Limp-Hovercraft7990",
    "upvote_ratio": 0.9166666666666666,
    "mention_count": 18,
    "mention_surge": true,
    "subreddit_url": "https://www.reddit.com/r/databricks/",
    "total_upvotes": 30,
    "comments_total": 20,
    "total_comments": 20,
    "event_date_text": "fast forward 3 mo",
    "post_author_url": "https://www.reddit.com/user/Limp-Hovercraft7990/",
    "signal_category": "feedback",
    "comments_included": 13,
    "products_mentioned": [
      "Databricks Genie"
    ]
  }
}

Long text fields are shortened on this page.

Looking up one signal by its id is free. Enrich costs 2 credits per signal returned; a call with no results is free.