Skip to main content

The platform at a glance

Request lifecycle

Separate memory from context

Memory is the information your system retains. Context is the information supplied to a model for a particular operation. Keeping these concepts separate makes it easier to retain useful information without repeatedly sending an entire conversation history to the model.

Design principles

Deployment considerations

Your deployment architecture should define the API boundary, credential management, storage configuration, network access, retention policy, backup and recovery strategy, and observability requirements.