Skip to main content
ElasticCustomer feedback

An Elasticsearch user evaluating Elastic's Agent Builder reports severe frustration, noting that it produces bogus responses and terrible errors on simple queries over half the time despite...

Source: Autobound Signal API · 124 signals tracked for Elastic · updated

Get Elastic's live signals in Claude or ChatGPT, or by API

AskWhat changed at Elastic this week? Use Autobound signals for elastic.co.

What happened

An Elasticsearch user evaluating Elastic's Agent Builder reports severe frustration, noting that it produces bogus responses and terrible errors on simple queries over half the time despite extensive context.

Source

RedditNov 4, 2026By u/StatisticianSolid889

r/elasticsearch

AI Agents constantly make terrible mistakes

upvotes
2
comments
10

Post

Highlighted: the lines this signal was extracted from

I'm messing about with the Agent builder for my company. Mainly just testing the waters and see what its capable of. At elasticon 2025 and 2026 the agents were presented as this sort of supertool. My experience with it has been very frustrating. It keeps making the most terrible errors in simple querys. I have given it A LOT of context now and it sure does help. But more than half the time it just gives back complete bogus. Im using Claude 4.6 sonnet. Was wondering if people are experiencing the same thing or if im just doing it completely wrong. Would love some tips!

reddit.com/r/elasticsearch/comments/1xnqkb4/ai_agents_constantly_make...Read the full source

Comments on the post

5 of 10 comments
  • “Claude Sonnet 4.6 is ranked at #73 on benchmarks. It's also a bit outdated when it comes to LLM models. It came out in Feb 2026 but by LLM age and the speed at which models have been changing, that's a bit old. I'd try seeing how well the latest Sonnet 5.5 works or even Opus 5.5. Any specific reason why you are using Sonnet 4.6? https://benchlm.ai/models/claude-sonnet-4-6”

    u/desmone12 points · Nov 4, 2026View

  • “Thanks for the feedback! Let me also forward this internally. And like others have said, a newer (and maybe larger) model is the first thing I’d try out here.”

    u/xeraa-net2 points · Nov 4, 2026View

  • “Did you experience this issue with elastic ai agent or kibana ai asistant?”

    u/Feeling_Current5341 points · Nov 5, 2026View

  • “While I’m not using the agent builder I am working with ai agents against Elasticsearch data with open models. I do often struggle to get it to do exactly what I want. I often have to go above and beyond to give it enough context to get it work right. The most reliable form I have is to update my mcp with tools that parameterize the searches I need it to run. The issues that I struggle with are us”

    u/JustanITguyatwork1 points · Nov 4, 2026View

  • “True”

    u/BobDope1 points · Nov 6, 2026View

Extracted by Autobound

From the Signal API record
Signal
Customer feedback

What this signalsUser posts often show product pain before it reaches reviews or churn.

Subreddit
r/elasticsearch
Event date
Nov 2026

Companies

  • AnthropicAlso named

The full record

From the Signal API record

Numbers

Mentions
5

Details

Timing
Ongoing state
Category
Features
Virality
Low
Post kind
Text
Prominence
Core
Company's role
Vendor

Topics and mentions

Topics

  • usability
  • ai
  • search
  • llm

Products named

  • Agent Builder
  • Elasticsearch

Extraction

Sentiment
Negative
Detected
Nov 4, 2026
signal_type
reddit-company
signal_subtype
customerFeedback

Use this data

Get every Reddit signal for Elastic and the companies you sell to, in the tools you already use.

  1. Ask Claude about it

    Connect Autobound to Claude, Claude Code or Cursor with MCP. Then ask: “What changed at Elastic this week?”

  2. Send it to your own tools

    The Signal API returns Reddit signals for any list of companies as JSON, for your CRM, warehouse or app.

  3. Try it free

    Sign up and spend your free credits on the companies you sell to.

    Start Free1,000 free credits

The API returns more than this page shows

This page shows a preview. The full reddit-company record in the Signal API and MCP can also have these 8 fields. Some fields are empty for some signals.

Company

  • linkedin_urlValue in the API
  • industriesValue in the API
  • employee_count_lowValue in the API
  • employee_count_highValue in the API
  • revenueValue in the API
  • descriptionValue in the API

Signal

  • signal_nameValue in the API
  • associationValue in the API
Show the full JSONThe record on this page and the API request

GET /v1/signals/aee01fd2-3291-5c7c-a0b1-95800b31d076 returns this record as JSON. POST /v1/companies/enrich returns every signal for elastic.co.

{
  "signal_id": "aee01fd2-3291-5c7c-a0b1-95800b31d076",
  "signal_type": "reddit-company",
  "signal_subtype": "customerFeedback",
  "detected_at": "2026-11-04T15:07:32+00:00",
  "company": {
    "name": "Elastic",
    "domain": "elastic.co"
  },
  "data": {
    "nsfw": false,
    "stage": "none",
    "awards": 0,
    "timing": "ongoing_state",
    "topics": [
      "ai",
      "search",
      "llm",
      "usability"
    ],
    "post_id": "1xnqkb4",
    "summary": "An Elasticsearch user evaluating Elastic's Agent Builder reports severe frustration, noting that it produces bogus responses and terrible errors on simple queries over half the time despite extensive context.",
    "category": "features",
    "comments": [
      {
        "url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/comment/19s4wlvazd8xs/",
        "depth": 0,
        "score": 2,
        "author": "desmone1",
        "excerpt": "Claude Sonnet 4.6 is ranked at #73 on benchmarks. It's also a bit outdated when it comes to LLM models. It came out in Feb 2026 but by LLM age and the speed at which models have been changing, that's a bit old.\n\n I'd try seeing how well the latest Sonnet 5.5 works or even Opus 5.5.\n\n Any specific reason why you are using Sonnet 4.6?\n\n https://benchlm.ai/models/claude-sonnet-4-6",
        "posted_at": "2026-11-04T16:24:25.000Z",
        "author_url": "https://www.reddit.com/user/desmone1/"
      },
      {
        "url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/comment/19s56twbw0v41/",
        "depth": 0,
        "score": 2,
        "author": "xeraa-net",
        "excerpt": "Thanks for the feedback! Let me also forward this internally.\nAnd like others have said, a newer (and maybe larger) model is the first thing I’d try out here.",
        "posted_at": "2026-11-04T20:13:37.000Z",
        "author_url": "https://www.reddit.com/user/xeraa-net/"
      },
      {
        "url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/comment/19s62cc56ehdx/",
        "depth": 0,
        "score": 1,
        "author": "Feeling_Current534",
        "excerpt": "Did you experience this issue with elastic ai agent or kibana ai asistant?",
        "posted_at": "2026-11-05T08:00:07.000Z",
        "author_url": "https://www.reddit.com/user/Feeling_Current534/"
      },
      {
        "url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/comment/19s4tivjjojup/",
        "depth": 0,
        "score": 1,
        "author": "JustanITguyatwork",
        "excerpt": "While I’m not using the agent builder I am working with ai agents against Elasticsearch data with open models. I do often struggle to get it to do exactly what I want. I often have to go above and beyond to give it enough context to get it work right. The most reliable form I have is to update my mcp with tools that parameterize the searches I need it to run. The issues that I struggle with are us",
        "posted_at": "2026-11-04T15:15:17.000Z",
        "author_url": "https://www.reddit.com/user/JustanITguyatwork/"
      },
      {
        "url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/comment/19s7eh1xwsqkl/",
        "depth": 0,
        "score": 1,
        "author": "BobDope",
        "excerpt": "True",
        "posted_at": "2026-11-06T01:59:13.000Z",
        "author_url": "https://www.reddit.com/user/BobDope/"
      }
    ],
    "evidence": [
      "[post] I'm messing about with the Agent builder for my company. Mainly just testing the waters and see what its capable of.",
      "[post] My experience with it has been very frustrating. It keeps making the most terrible errors in simple querys. I have given it A LOT of context now and it sure does help. But more than half the time it just gives back complete bogus."
    ],
    "virality": "low",
    "post_date": "2026-11-04T15:07:32.000Z",
    "post_kind": "text",
    "post_text": "I'm messing about with the Agent builder for my company. Mainly just testing the waters and see what its capable of. At elasticon 2025 and 2026 the agents were presented as this sort of supertool.\n\nMy experience with it has been very frustrating. It keeps making the most terrible errors in simple querys. I have given it A LOT of context now and it sure does help. But more than half the time it just gives back complete bogus.\n\nIm using Claude 4.6 sonnet.\n\nWas wondering if people are experiencing the same thing or if im just doing it completely wrong. Would love some tips!",
    "sentiment": "negative",
    "subreddit": "elasticsearch",
    "event_date": "2026-11",
    "post_title": "AI Agents constantly make terrible mistakes",
    "prominence": "core",
    "source_url": "https://www.reddit.com/r/elasticsearch/comments/1xnqkb4/ai_agents_constantly_make_terrible_mistakes/",
    "entity_role": "vendor",
    "post_author": "StatisticianSolid889",
    "upvote_ratio": 0.6666666666666666,
    "mention_count": 5,
    "mention_surge": true,
    "subreddit_url": "https://www.reddit.com/r/elasticsearch/",
    "total_upvotes": 2,
    "comments_total": 10,
    "total_comments": 10,
    "other_companies": [
      {
        "name": "Anthropic",
        "role": "partner",
        "domain": "anthropic.com"
      }
    ],
    "post_author_url": "https://www.reddit.com/user/StatisticianSolid889/",
    "signal_category": "feedback",
    "comments_included": 5,
    "products_mentioned": [
      "Agent Builder",
      "Elasticsearch"
    ]
  }
}

Long text fields are shortened on this page.

Looking up one signal by its id is free. Enrich costs 2 credits per signal returned; a call with no results is free.