diff --git a/content/v3/dynamic-configuration.md b/content/v3/dynamic-configuration.md index 210bdd16..a8a0130b 100644 --- a/content/v3/dynamic-configuration.md +++ b/content/v3/dynamic-configuration.md @@ -25,6 +25,7 @@ url = "https://github.com/spinframework/spin-docs/blob/main/content/v3/dynamic-c%20%20%20-%20[Remote%20Compute%20Provider](#remote-compute-provider)%20%20%20%20%20-%20[%60default%60%20API](#default-api)%20%20%20%20%20-%20[%60open_ai%60%20API](#open_ai-api)+-%20[Outbound%20HTTP%20Runtime%20Configuration](#outbound-http-runtime-configuration)%20%20You%20can%20change%20the%20configuration%20for%20Spin%20application%20features%20such%20as%20[application%20variables](./variables),%20[key%20value%20storage](./kv-store-api-guide),%20[SQL%20storage](./sqlite-api-guide)@@%20-407,3%20+408,18%20@@%20If%20the%20%60api_type%60%20is%20%60default%60,%20Spin%20uses%20its%20own"Cloud GPU" API. This requires #### `open_ai` API If the `api_type` is `open_ai`, Spin uses the [OpenAI API](https://github.com/openai/openai-openapi). This API is offered by some commercial LLM providers. + +## Outbound HTTP Runtime Configuration + +You can control applications' use of outbound HTTP via the runtime configuration file via the `[outbound_http]` section. + +* By default, Spin pools outbound HTTP connections to the same destination. You can turn this off by setting `connection_pooling = false`. +* By default, Spin does not limit the number of concurrent outbound HTTP connections the application may make. You can set a limit by setting `max_concurrent_requests = `. + +For example, the following runtime config section prevents connection pooling and limits the application to 10 concurrent requests: + +```toml +[outbound_http] +connection_pooling = false +max_concurrent_requests = 10 +```