Race Console Guide

This page provides a guide to the Race entity in the Namirasoft Inference Console. It defines the concepts and configuration fields used when creating and managing Races. Use this guide to understand the purpose and behavior of each setting available during Race configuration.

What Is a Race?

A Race in Namirasoft Inference sends a request to all of its targets at the same time and uses the first response that arrives. Each target is an inferencer, which can be a Model or another routing configuration.

 

A Race is used by supported Namirasoft applications, such as Namirasoft Expert and Namirasoft Job Arranger, in the same way as a Model. When a supported application sends a request, the Race calls every target at once and returns the fastest response.

The Challenge a Race Solves

Response times vary between models and change with load, so choosing one model in advance does not guarantee the fastest reply for every request.

 

Common challenges include:

 

• Variable response times: The fastest model for one request may not be the fastest for the next.
• Waiting on a single model: Sending to one model means waiting for that model, even when another could have replied sooner.
• Latency sensitive work: Some requests need the quickest possible reply, whichever model provides it.

How Namirasoft Inference Solves the Problem

A Race sends each request to all of its targets at once and returns the first response to arrive. This gives you the fastest available reply for every request, without deciding in advance which model will be quickest, and without changing the applications that use the Race.

Overview of Race Fields and Options

Below is a detailed explanation of the fields available when creating or managing a Race. Understanding these fields helps ensure your Race is configured correctly for your requirements.

• ID (String): This is a unique identifier automatically assigned to the Race when it is created. The system uses it to track, reference, and manage this specific Race. This value is auto-generated and cannot be modified.

• User ID (Namirasoft Account’s ID): This is the unique identifier of the Namirasoft Account user who owns this Race. It is used internally for permission control, audit logging, and access management.

• Workspace ID (Namirasoft Workspace’s ID): This is the identifier of the workspace this Race belongs to, as defined in Namirasoft Workspace. A workspace is a shared organizational space where teams group their configurations, projects, and members.

• Name (String): This is a label used to identify this Race in the console. A good name clearly describes its purpose, for example: “Fastest Reply” or “Low Latency Pool”.

• Description (String, optional): An optional note describing this Race and its purpose. It is for your reference and does not affect routing.

• Targets (List): The inferencers this Race calls at the same time. Add one or more targets, each with the following:
  • Type (Enum): The kind of target, one of Model, Load Balancer, Failover, or Race. Because a target can itself be a routing configuration, Races can be combined with other strategies.
  • Target: The specific inferencer, of the chosen Type, that receives the request. Every target is called at the same time, and the first to respond wins.

• Created At (DateTime): This is the date and time when this Race was created. This value is automatically generated and cannot be modified.

• Updated At (DateTime): This is the date and time when this Race configuration was last modified. This value is updated automatically whenever any field is changed.