configure adaptive batching for a bentoml runner or api endpoint

Steps

1. Understand that adaptive batching is disabled by default and must be explicitly enabled/configured on the relevant API or runner
2. Use the @bentoml.api decorator's batching configuration to control batch behavior for a given endpoint
3. For a Runnable/runner that supports batching, adaptive batching is enabled automatically once the runner declares batching support, dynamically grouping concurrent run() invocations from multiple processes into one batch execution
4. Configure traffic settings per runner, such as traffic.timeout (how long the runner waits for a model response before timing out) and traffic.max_concurrency (max concurrent requests accepted before erroring)
5. Load-test with concurrent client requests to confirm batches are actually being formed and that traffic.timeout/max_concurrency are sized correctly for your latency budget