Documentation

LLM extends Message
in package

Generated from protobuf message <code>livekit.SimulationRun.JobMetrics.LLM</code>

Table of Contents

Properties

$conciseness_score  : mixed
judged 0-1: brief enough for voice
$tokens_per_second  : mixed
decode rate, mean
$ttfs_ms  : mixed
time to first sentence — the smallest speakable unit
$ttft_ms  : mixed
time to first token, mean (per-turn in turns)

Methods

__construct()  : mixed
Constructor.
clearConcisenessScore()  : mixed
clearTokensPerSecond()  : mixed
clearTtfsMs()  : mixed
clearTtftMs()  : mixed
getConcisenessScore()  : float
judged 0-1: brief enough for voice
getTokensPerSecond()  : float
decode rate, mean
getTtfsMs()  : int
time to first sentence — the smallest speakable unit
getTtftMs()  : int
time to first token, mean (per-turn in turns)
hasConcisenessScore()  : mixed
hasTokensPerSecond()  : mixed
hasTtfsMs()  : mixed
hasTtftMs()  : mixed
setConcisenessScore()  : $this
judged 0-1: brief enough for voice
setTokensPerSecond()  : $this
decode rate, mean
setTtfsMs()  : $this
time to first sentence — the smallest speakable unit
setTtftMs()  : $this
time to first token, mean (per-turn in turns)

Properties

$conciseness_score

judged 0-1: brief enough for voice

protected mixed $conciseness_score = null

Generated from protobuf field optional float conciseness_score = 4;

$tokens_per_second

decode rate, mean

protected mixed $tokens_per_second = null

Generated from protobuf field optional float tokens_per_second = 3;

$ttfs_ms

time to first sentence — the smallest speakable unit

protected mixed $ttfs_ms = null

Generated from protobuf field optional uint32 ttfs_ms = 2;

$ttft_ms

time to first token, mean (per-turn in turns)

protected mixed $ttft_ms = null

Generated from protobuf field optional uint32 ttft_ms = 1;

Methods

__construct()

Constructor.

public __construct([array<string|int, mixed> $data = null ]) : mixed
Parameters
$data : array<string|int, mixed> = null

{ Optional. Data for populating the Message object.

@type int $ttft_ms
      time to first token, mean (per-turn in turns)
@type int $ttfs_ms
      time to first sentence — the smallest speakable unit
@type float $tokens_per_second
      decode rate, mean
@type float $conciseness_score
      judged 0-1: brief enough for voice

}

clearConcisenessScore()

public clearConcisenessScore() : mixed

clearTokensPerSecond()

public clearTokensPerSecond() : mixed

clearTtfsMs()

public clearTtfsMs() : mixed

clearTtftMs()

public clearTtftMs() : mixed

getConcisenessScore()

judged 0-1: brief enough for voice

public getConcisenessScore() : float

Generated from protobuf field optional float conciseness_score = 4;

Return values
float

getTokensPerSecond()

decode rate, mean

public getTokensPerSecond() : float

Generated from protobuf field optional float tokens_per_second = 3;

Return values
float

getTtfsMs()

time to first sentence — the smallest speakable unit

public getTtfsMs() : int

Generated from protobuf field optional uint32 ttfs_ms = 2;

Return values
int

getTtftMs()

time to first token, mean (per-turn in turns)

public getTtftMs() : int

Generated from protobuf field optional uint32 ttft_ms = 1;

Return values
int

hasConcisenessScore()

public hasConcisenessScore() : mixed

hasTokensPerSecond()

public hasTokensPerSecond() : mixed

hasTtfsMs()

public hasTtfsMs() : mixed

hasTtftMs()

public hasTtftMs() : mixed

setConcisenessScore()

judged 0-1: brief enough for voice

public setConcisenessScore(float $var) : $this

Generated from protobuf field optional float conciseness_score = 4;

Parameters
$var : float
Return values
$this

setTokensPerSecond()

decode rate, mean

public setTokensPerSecond(float $var) : $this

Generated from protobuf field optional float tokens_per_second = 3;

Parameters
$var : float
Return values
$this

setTtfsMs()

time to first sentence — the smallest speakable unit

public setTtfsMs(int $var) : $this

Generated from protobuf field optional uint32 ttfs_ms = 2;

Parameters
$var : int
Return values
$this

setTtftMs()

time to first token, mean (per-turn in turns)

public setTtftMs(int $var) : $this

Generated from protobuf field optional uint32 ttft_ms = 1;

Parameters
$var : int
Return values
$this
On this page

Search results