Skip to content

vllm.v1.engine.exceptions

Classes:

EngineDeadError

Bases: VLLMServerError

Raised when the EngineCore dies. Unrecoverable.

str(exc) is the log-oriented message for server logs and offline tracebacks; CLIENT_MESSAGE is what API clients receive.

Source code in vllm/v1/engine/exceptions.py 
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
class EngineDeadError(VLLMServerError):
    """Raised when the EngineCore dies. Unrecoverable.

    `str(exc)` is the log-oriented message for server logs and offline
    tracebacks; `CLIENT_MESSAGE` is what API clients receive.
    """

    ENGINE_DEAD_MESSAGE = (
        "EngineCore encountered an issue. See stack trace (above) for the root cause."
    )
    CLIENT_MESSAGE = "The server had an error while processing your request."

    def __init__(self, *args, suppress_context: bool = False, **kwargs):
        super().__init__(self.ENGINE_DEAD_MESSAGE, *args, **kwargs)
        # Make stack trace clearer when using with LLMEngine by
        # silencing irrelevant ZMQError.
        self.__suppress_context__ = suppress_context

EngineGenerateError

Bases: VLLMServerError

Raised when a AsyncLLM.generate() fails. Recoverable.

Source code in vllm/v1/engine/exceptions.py 
6
7
8
9
class EngineGenerateError(VLLMServerError):
    """Raised when a AsyncLLM.generate() fails. Recoverable."""

    pass