Skip to main content

Responses (Preview)

POST 
/api/v2/inference/:vendor/:model/responses

> 🧪 Preview — This endpoint is in preview and its contract may change.

Creates a model response for the given input using an OpenAI-compatible Responses API. Serenity Cloud models are exposed as OpenAI-compatible endpoints, so you can call them with the OpenAI SDKs by pointing the base URL at this route and passing your Serenity API key as a Bearer token.

When stream is true, the response is delivered as Server-Sent Events (SSE).

Request​

Path Parameters

    vendor stringrequired

    Possible values: [qwen]

    The model vendor. Currently available: qwen.

    model stringrequired

    Possible values: [qwen3.6, qwen3.6-27b, qwen3.6-35b-a3b]

    The model identifier. Currently available models for qwen: qwen3.6, qwen3.6-27b, qwen3.6-35b-a3b. This list grows as models are deployed.

Query Parameters

    stream boolean
    culture string

    Use this param to override the culture of the response. Options: - en (default) - es

Body

required

    input

    object

    required

    agent

    object

    type stringnullable
    name stringnullablerequired
    version stringnullable
    model stringnullable
    instructions stringnullable
    max_output_tokens int32nullable

    reasoning

    object

    effort stringnullable
    summary stringnullable
    store booleannullable
    stream booleannullable
    previous_response_id stringnullable
    temperature doublenullable
    top_p doublenullable
    parallel_tool_calls booleannullable

    metadata

    object

    nullable

    property name* string
    include string[]nullable

    conversation

    object

    id stringnullable

    metadata

    object

    nullable

    property name* string
    background booleannullable
    max_tool_calls int32nullable
    top_logprobs int32nullable
    safety_identifier stringnullable
    prompt_cache_key stringnullable

    prompt

    object

    id stringnullablerequired

    variables

    object

    nullable

    property name* string
    service_tier stringnullable

    stream_options

    object

    include_obfuscation booleannullable
    truncation stringnullable
    user stringnullabledeprecated
    tools undefined[]nullable
    tool_choice nullable

    text

    object

    format

    object

    nullable

    oneOf

    verbosity stringnullable

Responses​

OK

Loading...