Remove finalSystemMessageBeforeResponse from Sidekick component. The systemMessage is now always given to the model as the last part of the context window.
Remove other cruft from the built-in Sidekick system message.
Remove Card component from the Sidekick's possible output MDX components.
API token limiting: long API responses in Sidekick are now automatically truncated. If this happens, the response is chunked and the LLM is given a new function loadBySimilarity to query the last function response.
Add Sidekick component. Sidekicks are a high-level abstraction for combining tool use, docs QA, and generated UI.
Change MdxSystemMessage to no longer automatically infer component names from the usageExamples. Instead, usageExamples is now a plain string, and component names are passed separately via the componentNames prop.
Updated the <FixieCorpus> component to use the new Fixie Corpus REST API.
This is currently only available to users on beta.fixie.ai but will be brought
to app.fixie.ai soon.
Add tokenCount field to OpenTelemetry-emitted spans. Now, if you're emitting via OpenTelemetry (e.g. to DataDog), the spans will tell you how many tokens each component resolved to. This is helpful for answering quetsions like "how big is my system message?".
Breaking: Remove prompt-engineered UseTools. Previously, if you called UseTools with a model that doesn't support native function calling (e.g. Anthropic), UseTools would use a polyfilled version that uses prompt engineering to simulate function calling. However, this wasn't reliable enough in practice, so we've dropped it.
Fix issue where gpt-4-32k didn't accept functions.
Fix issue where Anthropic didn't permit function call/responses in its conversation history.
Add Anthropic's claude-2 models as valid chat model types.
Fix issue where Anthropic prompt formatting had extra :s.
Update toTextStream to accept a logger, so you can now see log output when you're running AI.JSX on the server and outputting to a stream. See AI + UI and Observability.
ImageGen now produces an Image object which will render to a URL in the command line, but returns an <img /> tag when using in the browser (React/Next).