Skip to content
This repository was archived by the owner on Feb 25, 2025. It is now read-only.

[CRITICAL] The LLM that you're using right now returned #1296

Closed
laz-001 opened this issue Feb 15, 2025 · 41 comments
Closed

[CRITICAL] The LLM that you're using right now returned #1296

laz-001 opened this issue Feb 15, 2025 · 41 comments
Labels
bug Something isn't working

Comments

@laz-001
Copy link

laz-001 commented Feb 15, 2025

Update

Potentially solved within codestoryai/sidecar@6ac0514

see instructions to update: #1296 (comment)

Environment

Version: 1.96.4 (user setup)
Release: 25031
Commit: 4e858de632a2bb7407167560cbe824397e95fa4a
Date: 2025-01-31T18:48:20.686Z
Electron: 32.2.7
ElectronBuildId: undefined
Chromium: 128.0.6613.186
Node.js: 20.18.1
V8: 12.8.374.38-electron.0
OS: Windows_NT x64 10.0.19045

Description

The LLM that you're using right now returned a response that does not adhere to the format our framework expects, and thus this request has failed. If you keep seeing this error, this is likely because the LLM is unable to follow our system instructions and it is recommended to switch over to one of our recommended models instead.

this comes up again and again on queries (using claude sonnet) like

"we introduced a 'kind' field to the blog-card and db. display left beside the username (as a slim elegant dropdown, reuse existent widgets). do not extend to other tasks."

Reproduction

No response

Log output

@laz-001 laz-001 added the bug Something isn't working label Feb 15, 2025
@thanet-s
Copy link

Same issue, with Creator plan and use Claude 3.5 Sonnet model

The LLM that you're using right now returned a response that does not adhere to the format our framework expects, and thus this request has failed. If you keep seeing this error, this is likely because the LLM is unable to follow our system instructions and it is recommended to switch over to one of our recommended models instead.

@Rimmy555
Copy link

I have the same issue as well, none of the models work for me either right now. Not even if I just say "Hello"

@surfer312
Copy link

same issue

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

/agent, @theskcd, maybe trigger some alarm.

@addanuj
Copy link

addanuj commented Feb 15, 2025

For almost after every 2nd or 3rd command. this issue is killing all expectations from AIDE

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

this issue is killing all expectations from AIDE

There are many details that are highly annoying. Site mentions 4 people, it feels here sometimes that just one person tries to keep everything together. I mean the thing is open. I would do some work, but development is not streamlined enough. quite sad.

@theskcd
Copy link
Contributor

theskcd commented Feb 15, 2025

I did push fixes to our backend for this, hopefully it feels more stable for a while now

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

I did push fixes to our backend for this, hopefully it feels more stable for a while now

confirming success i guess, work went on on my side.

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

I did push fixes to our backend for this, hopefully it feels more stable for a while now

confirming success i guess, work went on on my side.

started again

@aneeshjain5
Copy link

Have been experiencing the issue for last 3 days, I don't understand why I had taken the subscription for this scrap app.

@Derpwinni
Copy link

Have been experiencing the issue for last 3 days, I don't understand why I had taken the subscription for this scrap app.

they dont even answer on emails

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

@theskcd , may I suggest that you at least try to open the development a little bit up. The errors seem to come from the open-source rust sidecar.

I believe that many of the users are willing to spend an hour (or even a day) on an issue. But you need to open development up. Currently, it makes not much sense to even try to contribute.

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

I don't understand why I had taken the subscription for this scrap app.

I understand me: despite immediately detecting many weaknesses and flaws, i noticed that AIDE (another weakness: the brand) did work in a way that I was expecting (and did not find in bolt/cursor/windsurf/zencoder).

(so i thought: give it a try for a month)

It is really a tragedy that practice shows that one cannot work only with this IDE, because obviously the dev are in some kind of activity trap, blinded to see that they've lost their path to a stable product.

@theskcd
Copy link
Contributor

theskcd commented Feb 15, 2025

Hey! Not blinded by the bugs at all, it's just the tragedy of bugs and prompting skills that show as cracks at scale. I am personally happy to refund if you all are not happy.

The bugs are honestly on our providers for LLM and some prompting (both of which are actively worked on) and unlike normal software with LLM we have to run the evals to make sure that we don't regress.

I get the feeling you all are getting, and I do apologise for it.

@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

happy to refund

This is not about a refund.

(...) elaborations

I work with multiple tools in parallel, AIDE has the most problems of this kind, by far.

@theskcd
Copy link
Contributor

theskcd commented Feb 15, 2025

yeah I hear you, I am not shifting blame btw, acknowledging it

@laz-001 laz-001 mentioned this issue Feb 15, 2025
@laz-001
Copy link
Author

laz-001 commented Feb 15, 2025

yeah I hear you, I am not shifting blame btw, acknowledging it

All good, friend. Just help us help you:

@laz-001
Copy link
Author

laz-001 commented Feb 16, 2025

@ people that are complaining:

please take into account (like I do), that AIDE does not burn the credits like other agentic IDEs.

Yes, you get some crashes, but you have a really good deal: unlimited (fair use) calls.

@laz-001
Copy link
Author

laz-001 commented Feb 16, 2025

I did push fixes to our backend f

@theskcd could you please point me to the PR/commit? (stricly, it should "re" the issue-number here)

or this, hopefully it feels more stable for a while now

@theskcd
Copy link
Contributor

theskcd commented Feb 16, 2025

codestoryai/sidecar@6ac0514 should fix most of these errors and more, please rage here if after reloading the editor and updating the sidecar the issue is still not fixed

@aneeshjain5
Copy link

codestoryai/sidecar@6ac0514 should fix most of these errors and more, please rage here if after reloading the editor and updating the sidecar the issue is still not fixed

The issue is still not fixed. Screenshot attached with date and time.

Image

@theskcd
Copy link
Contributor

theskcd commented Feb 16, 2025

can you confirm for me if you have restarted the editor and updated sidecar? you do need to do that for the latest changes to get pulled

@laz-001
Copy link
Author

laz-001 commented Feb 16, 2025

and updated sidecar?

how does one update the sidecar? (please remember: mostly the paying folks complains, we're not in the role "open-source developer").

@theskcd
Copy link
Contributor

theskcd commented Feb 16, 2025

oh sorry my bad, I wish I could record the workflow but my editor is already updated.

steps to update the sidecar:

  • restart the editor
  • you will see a "New update available" beside sidecar on the assistant panel
  • profit
Image

@laz-001
Copy link
Author

laz-001 commented Feb 16, 2025

oh sorry my bad, I wish I could record the workflow but my editor is already updated.

yeah, just found it by accident.

hover the Sideψar connected' shows v0.1.35` for me now (after clicking).

I'll try tomorrow and report back.

@theskcd
Copy link
Contributor

theskcd commented Feb 16, 2025

yup thats the version you want for the fixes

@laz-001
Copy link
Author

laz-001 commented Feb 16, 2025

yup thats the version you want for the fixes

i've updated the issue, so users see it immediately.

@aneeshjain5
Copy link

aneeshjain5 commented Feb 17, 2025

can you confirm for me if you have restarted the editor and updated sidecar? you do need to do that for the latest changes to get pulled

Yes I had restarted the editor. Updated the sidecar to version 0.1.35, yet the issue persists.

@nyigutof
Copy link

Image

This problem is too much.

@nyigutof
Copy link

Image

This problem is too much.

For last 2 months and no fix

@addanuj
Copy link

addanuj commented Feb 17, 2025

@theskcd when we should expect it to get fixed? Constantly gettting this error no mattar what you put in chat.
The LLM that you're using right now returned a response that does not adhere to the format our framework expects, and thus this request has failed. If you keep seeing this error, this is likely because the LLM is unable to follow our system instructions and it is recommended to switch over to one of our recommended models instead.

@laz-001
Copy link
Author

laz-001 commented Feb 17, 2025

@addanuj , you need to "click to update", right at "Sidebar connected".

(sidenote: use WIN-KEY + SHIFT + S, this activates a screenshot tool on windows usually)

@theskcd
Copy link
Contributor

theskcd commented Feb 17, 2025

@nyigutof could you click the update sidecar button

@nyigutof
Copy link

@theskcd

Image

@nyigutof
Copy link

@theskcd

Image

same error on my side

@laz-001
Copy link
Author

laz-001 commented Feb 17, 2025

@nyigutof , seems you tried the vscode update under help menu.

you need to click the sidebar update:

Image

@nyigutof
Copy link

@laz-001

Image

i have no update

@surfer312
Copy link

i have no update..this fuckign sucks...

@laz-001
Copy link
Author

laz-001 commented Feb 17, 2025

i have no update

you had one, and executed it, screenshot it posted was a copy of yours here: #1296 (comment)

hover "Sidecar connected" should show you 0.1.35

@laz-001
Copy link
Author

laz-001 commented Feb 17, 2025

i have no update..this fuckign sucks...

close/open AIDE IDE, the look on sidecar corner

@laz-001
Copy link
Author

laz-001 commented Feb 17, 2025

I'll try tomorrow and report back.

I can confirm that after updating sidecar, i got today no error-messages till now.

@theskcd , this issue confirms one thing:

you need help to streamline your processes. You are currently far to fuzzy to create commercial dev-tools.

Your work is impressive - but your team lacks one thing: a streamlining master.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

9 participants