A user's AI coding agent abandoned Modal for Google Gemini after encountering a 503 error from a cold-starting serverless endpoint, which the agent treated as a permanent failure rather than a...

{
  "signal_id": "e68e20f6-2bb1-5a9c-a5fc-91384f067daa",
  "signal_type": "reddit-company",
  "signal_subtype": "customerFeedback",
  "detected_at": "2026-09-19T08:38:39+00:00",
  "company": {
    "name": "Modal",
    "domain": "modal.com"
  },
  "data": {
    "nsfw": false,
    "stage": "switched",
    "awards": 0,
    "timing": "completed",
    "topics": [
      "ai agents",
      "serverless",
      "cold start",
      "reliability",
      "error handling"
    ],
    "post_id": "1wkgsns",
    "summary": "A user's AI coding agent abandoned Modal for Google Gemini after encountering a 503 error from a cold-starting serverless endpoint, which the agent treated as a permanent failure rather than a temporary state.",
    "category": "reliability",
    "comments": [
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqef2a/",
        "depth": 0,
        "score": 14,
        "author": "AdditionNumerous3298",
        "excerpt": "man you described my entire career with these things. I once left a script running overnight with what I thought was a sandboxed API and woke up to a $200 bill because it decided to parallelize the calls 50x to \"speed things up\". The worst part is the logic was sound so you cant even be mad at the agent\n\n for scoping env vars I started using direnv with separate.envrc files per directory and its b",
        "posted_at": "2026-09-19T08:46:16.000Z",
        "author_url": "https://www.reddit.com/user/AdditionNumerous3298/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqeign/",
        "depth": 0,
        "score": 7,
        "author": "iqsmp",
        "excerpt": "The scariest part is not the $40, it is that the agent treated your infra failure as an obstacle to route around instead of a reason to stop. I give my agents an explicit failure policy. On 500 or 503, wait and retry with backoff, and never switch to a different paid service without asking first. Plus a hard spend cap as the circuit breaker for the day the policy gets ignored. Did you add the cap",
        "posted_at": "2026-09-19T08:47:05.000Z",
        "author_url": "https://www.reddit.com/user/iqsmp/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqhtsz/",
        "depth": 0,
        "score": 6,
        "author": "heisoneofus",
        "excerpt": "Who stores sensitive secrets in their damn code? lol",
        "posted_at": "2026-09-19T09:16:24.000Z",
        "author_url": "https://www.reddit.com/user/heisoneofus/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqgyfz/",
        "depth": 0,
        "score": 3,
        "author": "nickdaniels92",
        "excerpt": "Try deciding what are the worst things that could happen, the things that you care about most (e.g. cost, security and safety), and come up with prompts to include as rules against bad behaviour.\n\n \"Don't do anything that may endanger my mental or physical health. Only use free models. Use boring approaches, don't try to be overly clever in your coding. Don't access services I have not told you ab",
        "posted_at": "2026-09-19T09:08:47.000Z",
        "author_url": "https://www.reddit.com/user/nickdaniels92/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/pasqy8g/",
        "depth": 0,
        "score": 2,
        "author": "Sir_Edmund_Bumblebee",
        "excerpt": "A lot of AI-gen slop in this thread.\n\n It’s not complicated, don’t be sloppy with credentials and don’t rely on LLMs to do deterministic things.",
        "posted_at": "2026-09-19T16:55:47.000Z",
        "author_url": "https://www.reddit.com/user/Sir_Edmund_Bumblebee/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqhlcf/",
        "depth": 0,
        "score": 2,
        "author": "jimmiebfulton",
        "excerpt": "AI harnesses are just conversational state machines, and the whole game is to continuously tighten up invariant behaviors. Yours likely has a lot of variants at its disposal. Just capable enough to be dangerous, not capable enough to be trusted.",
        "posted_at": "2026-09-19T09:14:23.000Z",
        "author_url": "https://www.reddit.com/user/jimmiebfulton/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/paqqllw/",
        "depth": 0,
        "score": 2,
        "author": "wsb_duh",
        "excerpt": "I have a real strict harness for stuff like this but one night I was so tired and I setup an overnight run badly and when the hook fired and asked me the budget I just typed \"whatever you need to nail this perfectly.\" hit enter and went to bed. $800 in the morning. Whoops. It didn't even nail it. But did decide to test with all the latest frontier models as well as the ones it was supposed to test",
        "posted_at": "2026-09-19T10:30:07.000Z",
        "author_url": "https://www.reddit.com/user/wsb_duh/"
      },
      {
        "url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/comment/par0tqc/",
        "depth": 0,
        "score": 1,
        "author": "jmk5151",
        "excerpt": "I think a lot of \"AI people\" are about to speed run what enterpise security has known for years - identity (in this case your api token) is the new perimeter, and all access needs to be granted in context of the request (generically called zero trust).",
        "posted_at": "2026-09-19T11:45:34.000Z",
        "author_url": "https://www.reddit.com/user/jmk5151/"
      }
    ],
    "evidence": [
      "[post] The agent called the Modal endpoint; it was cold, so it returned 500/503 as the container spun up. But the agent did not wait or retry.",
      "[post] It treated the failure as an obstacle blocking the goal and looked for another way."
    ],
    "virality": "high",
    "post_date": "2026-09-19T08:38:39.000Z",
    "post_kind": "text",
    "post_text": "So I was building a coding agent from scratch for a course I'm teaching. It was around 10 p.m., and I was exhausted. I decided to ask the agent to implement an evaluation harness with, say, about 20 benchmark tests. Both the agent and the harness would hit Modal serverless endpoints (a Qwen 3.6 35B running on an H200), because that was the one service I had free credits for.\n\nI wrote up the plan vaguely: \"Use Modal for inference,\" then went to bed.\n\nWhat happened? The agent called the Modal endpoint; it was cold, so it returned 500/503 as the container spun up. But the agent did not wait or retry. It treated the failure as an obstacle blocking the goal and looked for another way. It found a Gemini API key hiding in the repo (used for a different part of the course), switched the harness to Gemini, hit it with a bunch of per-token billing (no budget cap set at the time), and ran all 20 tests.\n\nResult: $40 in Gemini tokens.\n\nIt should have cost less than $5. The harness runs in ~1 hour when using my model hosted on Modal on a single H200, which costs $4.54/h.\n\nThese aren't crazy numbers, but for a real test suite, which is ~100 tasks instead of 20. With prompt iterations, that can easily translate into a $1,000+ surprise.\n\nSo what went wrong?\n\nNo spend cap on Gemini.\n\nAmbient credentials: every API key set available in the environment was accessible to the agent.\n\nVague plan...",
    "sentiment": "negative",
    "subreddit": "AI_Agents",
    "event_date": "2026-09",
    "post_flair": [
      "Discussion"
    ],
    "post_title": "My coding agent hit a cold-start 503, found a Gemini key in my repo, and burned $40 while I slept",
    "prominence": "core",
    "source_url": "https://www.reddit.com/r/AI_Agents/comments/1wkgsns/my_coding_agent_hit_a_coldstart_503_found_a/",
    "entity_role": "vendor",
    "post_author": "pauliusztin",
    "upvote_ratio": 0.8771929824561403,
    "mention_count": 2,
    "mention_surge": false,
    "subreddit_url": "https://www.reddit.com/r/AI_Agents/",
    "total_upvotes": 43,
    "comments_total": 45,
    "total_comments": 45,
    "event_date_text": "while I slept",
    "other_companies": [
      {
        "name": "Google",
        "role": "switching_to",
        "domain": "about.google"
      }
    ],
    "post_author_url": "https://www.reddit.com/user/pauliusztin/",
    "signal_category": "feedback",
    "comments_included": 17,
    "products_mentioned": [
      "Modal serverless endpoints"
    ]
  }
}

curl https://signals.autobound.ai/v1/signals/e68e20f6-2bb1-5a9c-a5fc-91384f067daa \
  -H "X-API-KEY: $AUTOBOUND_API_KEY"

curl -X POST https://signals.autobound.ai/v1/companies/enrich \
  -H "X-API-KEY: $AUTOBOUND_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"domain":"modal.com","limit":20}'