Skip to content

Architecture

Runner

The local program that calls your assistant.

On this page

What the runner does

The runner is a small Node program you run on your computer or server. It connects using a token for one project, picks up a queued request, asks your assistant and sends the result back. Your assistant’s provider key stays on that machine. TasteCase does not ask you to upload the assistant’s source code.

Commands

  • handshake — checks that the runner can connect. It does not call your assistant or need a model key.
  • run-once — picks up one queued request, runs it and sends back the answer. “No work” means there is no matching request ready.
  • replay — reruns a downloaded test pack for one assistant version. It needs your model connection, but not a TasteCase login.

The runner does not keep running automatically. Run it again for the next queued request. It does not automatically retry assistant calls. The local-development option --allow-loopback-http is not needed for the hosted API.

Expired work and revoked tokens

A runner gets a time-limited claim on a request. If that expires, another claim may pick up the work; an old result cannot overwrite it. Sending the same completed result again is safe, but different content is rejected. Revoking a token stops new connections, claims and uploads.