Struct tower::buffer::Buffer

pub struct Buffer<T, Request>where
    T: Service<Request>,{ /* private fields */ }

Adds an mpsc buffer in front of an inner service.

See the module documentation for more details.

Implementations

impl<T, Request> Buffer<T, Request>where
    T: Service<Request>,
    T::Error: Into<BoxError>,

pub fn new(service: T, bound: usize) -> Selfwhere
    T: Send + 'static,
    T::Future: Send,
    T::Error: Send + Sync,
    Request: Send + 'static,

Creates a new Buffer wrapping service.

bound gives the maximal number of requests that can be queued for the service before backpressure is applied to callers.

The default Tokio executor is used to run the given service, which means that this method must be called while on the Tokio runtime.

A note on choosing a bound

When Buffer’s implementation of poll_ready returns Poll::Ready, it reserves a slot in the channel for the forthcoming call. However, if this call doesn’t arrive, this reserved slot may be held up for a long time. As a result, it’s advisable to set bound to be at least the maximum number of concurrent requests the Buffer will see. If you do not, all the slots in the buffer may be held up by futures that have just called poll_ready but will not issue a call, which prevents other senders from issuing new requests.

pub fn pair(service: T, bound: usize) -> (Buffer<T, Request>, Worker<T, Request>)where
    T: Send + 'static,
    T::Error: Send + Sync,
    Request: Send + 'static,

Creates a new Buffer wrapping service, but returns the background worker.

This is useful if you do not want to spawn directly onto the tokio runtime but instead want to use your own executor. This will return the Buffer and the background Worker that you can then spawn.

Trait Implementations

impl<T, Request> Clone for Buffer<T, Request>where
    T: Service<Request>,

fn clone(&self) -> Self

Returns a copy of the value.

const fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<T: Debug, Request: Debug> Debug for Buffer<T, Request>where
    T: Service<Request>,
    T::Future: Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T, Request> Service<Request> for Buffer<T, Request>where
    T: Service<Request>,
    T::Error: Into<BoxError>,

type Response = <T as Service<Request>>::Response

Responses given by the service.

type Error = Box<dyn Error + Sync + Send + 'static, Global>

Errors produced by the service.

type Future = ResponseFuture<<T as Service<Request>>::Future>

The future response value.

fn poll_ready(&mut self, cx: &mut Context<'_>) -> Poll<Result<(), Self::Error>>

Returns Poll::Ready(Ok(())) when the service is able to process requests.

fn call(&mut self, request: Request) -> Self::Future

Process the request and return the response asynchronously.