Manage a session

• client is an open Rime client.
• microphone yields the PCM16 frames from your capture.
• player is your audio output.

​

Open one session per call

import asyncio

from rimelabs_sdk.realtime import AudioChunk, PCMFormat


async def stream_caller_audio(session, microphone):
    try:
        # Every frame from pickup to hang-up, including silence and speech over Prism.
        async for frame in microphone:
            # sample_rate is your capture's rate: 8000, 16000, 24000, or 48000.
            await session.send_audio(AudioChunk(data=frame, format=PCMFormat(sample_rate=48000)))
    finally:
        await session.close()  # The caller hung up, or the capture failed.


async def handle_call(client, microphone, player):
    async with client.realtime.connect(
        endpoint="wss://prism.api.rime.ai/v1/realtime",
        voice="aurora",
        instructions=(
            "You answer the phone for Juniper Cafe, open 8 a.m. to 4 p.m. every day. "
            "Answer in two or three sentences."
        ),
    ) as session:
        capture = asyncio.create_task(stream_caller_audio(session, microphone))
        try:
            await play_replies(session, player)
        finally:
            capture.cancel()

// Ends the call if work beside the events loop fails.
function background(session, task) {
  task.catch((error) => {
    console.error(error);
    void session.close();
  });
}

async function streamCallerAudio(session, microphone) {
  // Every frame from pickup to hang-up, including silence and speech over Prism.
  for await (const frame of microphone) {
    // sampleRate is your capture's rate: 8000, 16000, 24000, or 48000.
    await session.sendAudio({ data: frame, format: { sampleRate: 48000 } });
  }
  await session.close(); // The caller hung up.
}

const session = await client.realtime.connect({
  endpoint: "wss://prism.api.rime.ai/v1/realtime",
  voice: "aurora",
  instructions:
    "You answer the phone for Juniper Cafe, open 8 a.m. to 4 p.m. every day. " +
    "Answer in two or three sentences.",
});
try {
  background(session, streamCallerAudio(session, microphone));
  await playReplies(session, player);
} finally {
  await session.close();
}

​

Configure a session

• Eagerness: how readily Prism decides that the caller has finished. low cuts in less and replies later, and high replies sooner and cuts in more. medium and auto, the default, use Prism’s standard setting.
• End-of-turn timeout: the silence that ends the turn, even when Prism is not sure that the caller has finished. It runs from 1 to 10 seconds, and the default is 5 seconds.

​

Choose a voice

​

Write instructions for a phone call

​

Update instructions or history during a call

1. Make the change.
2. Cancel the reply that is playing, with cancel in the SDK or response.cancel over the WebSocket API.
3. Report what the caller heard, and report that playback stopped. Stop playback when the caller talks over a reply and Report when a reply finishes playing show how.
4. Ask for a nudge, such as “Tell the caller about the change.”

​

Start from an earlier conversation

# saved_lines holds (role, text) pairs from the earlier call, oldest first.
for role, text in saved_lines:
    await session.add_message(role, text)  # role is "user" or "assistant"

// savedLines holds [role, text] pairs from the earlier call, oldest first.
for (const [role, text] of savedLines) {
  await session.addMessage(role, text); // role is "user" or "assistant"
}

• Past messages: user and assistant messages, as with the SDK.
• Notes: a system message, such as “The caller called back after the line dropped.” The model sees the note at its place in the conversation.
• Past tool calls: a function_call item, and then a function_call_output item with the same call_id. A past call never starts a tool round.

​

What each reply sees

• the caller’s turns. Prism keeps each earlier turn as its transcript.
• Prism’s earlier replies. After an interruption, your playback report keeps only what the caller heard.
• every tool call and its result
• every message that you added

​

Handle long calls

​

Label replies for your logs

{
  "type": "session.update",
  "event_id": "evt_setup",
  "session": {
    "voice": "aurora",
    "instructions": "You answer the phone for Juniper Cafe, open 8 a.m. to 4 p.m. every day. Answer in one or two short sentences.",
    "prism_response_metadata": { "call_id": "juniper-0001", "agent": "front-desk" }
  }
}

{
  "prism_cause": "user_text",
  "prism_input_item_id": "item_a081d2331bc296aa",
  "prism_drain_token": "drn_7ac2a9445f1a17e5",
  "agent": "after-hours",
  "call_id": "juniper-0001"
}

​

End a session