Model Console Guide

 

This page provides a guide to the Model entity in the Namirasoft Inference Console. It defines the concepts and configuration fields used when creating and managing Models. Use this guide to understand the purpose and behavior of each setting available during Model configuration.

 

What Is a Model?

A Model in Namirasoft Inference is a configuration that defines an AI model and how it is accessed. Each Model specifies a single AI model, the way that model is accessed, either through Namirasoft or through your own key, and the cost limits applied to its use.

 

The model you configure is used by supported Namirasoft applications, such as Namirasoft Expert and Namirasoft Job Arranger. When a supported application needs to use an AI model, it uses the configuration defined in your Model. The content submitted to the model is processed by those applications and the applicable model provider, not by Namirasoft Inference.

 

For information about available models and how access and pricing work, visit the Pricing page.

 

The Challenge in Managing AI Models

Teams that use AI across more than one application face the challenge of managing models, providers, and cost in a consistent way. Without a central place to define how AI is accessed, each application has to be set up on its own, and usage becomes difficult to oversee.

 

Common challenges include:

 

  • Duplicated setup: Each application may require its own model selection and provider configuration, repeating the same work in several places.
  • API key management: Using models directly often requires creating and maintaining a separate account and API key with each provider.
  • Limited cost control: When usage is spread across applications and providers, keeping spending within expected limits becomes difficult.
  • Difficult model changes: Switching to a different model or provider can require reworking each application that uses it.
  • Model selection overhead: Choosing the right model for each use case means comparing options across several providers.

 

How Namirasoft Inference Solves the Problem

Namirasoft Inference addresses these challenges through Models. A Model is an individually configured definition of an AI model and how it is accessed, together with the cost limits applied to its use.

 

Instead of configuring AI separately in every application, you define a Model once in Namirasoft Inference, and supported Namirasoft applications use that configuration when they need a model. You can use Namirasoft provided access without managing an API key, or connect your own provider credential, and you can change the model without reworking the applications that rely on it.

 

Cost limits set on a Model apply automatically, and usage totals are tracked for each Model, giving you visibility and control over how AI is used across Namirasoft applications.

 

Overview of Model Fields and Options

Below is a detailed explanation of the fields available when creating or managing a Model. Understanding these fields helps ensure your Model is configured correctly for your requirements.

 

  • ID (String): This is a unique identifier automatically assigned to the Model when it is created. The system uses it to track, reference, and manage this specific Model. This value is auto-generated and cannot be modified.

 

  • User ID (Namirasoft Account’s ID): This is the unique identifier of the Namirasoft Account user who owns this Model. It is used internally for permission control, audit logging, and access management.

 

  • Workspace ID (Namirasoft Workspace’s ID): This is the identifier of the workspace this Model belongs to, as defined in Namirasoft Workspace. A workspace is a shared organizational space where teams group their models, projects, and members.

 

  • Name (String): This is a label used to identify this Model in the console. A good name clearly describes the Model’s purpose or the AI model it is configured to use. For example: “Production Assistant” or “Fast Everyday Model”.

 

  • Model Company (Enum): This is the provider of the AI model this Model uses. Supported companies are OpenAI, Anthropic, DeepSeek, and Namirasoft (for Namirasoft Squirrel). Selecting the company determines which models are available to choose from.

 

  • Model Name (Enum): This is the specific model, from the selected Model Company, that this Model uses. The available models depend on the chosen company and are displayed in the console.

 

  • Providers (Enum, optional): This field applies when the Model Company is Namirasoft and the Model Name is a Namirasoft Squirrel model. Namirasoft Squirrel can reach a wider set of providers, including ChatGPT, Copilot, Gemini, Claude, Perplexity, MetaAI, DeepSeek, Qwen, Grok, and Mistral. Select one or more providers to limit which are used, or leave the field empty to allow any.

 

  • Model API Key Credential (Credential ID): This field determines how the Model accesses its AI model.
    • Namirasoft Squirrel: Namirasoft Squirrel runs directly on Namirasoft, so no provider credential is needed. Leave this field empty and select a Squirrel model as the Model Name.
    • Namirasoft-provided access: To use a third party model such as Claude, ChatGPT, or DeepSeek without your own provider account, leave this field empty. Namirasoft provides and manages access to the model, and usage is billed through Namirasoft.
    • Bring your own key: To use a third party model through your own provider account, set this field to your provider credential in Namirasoft Credential. The Model then accesses the AI model with your own API key, and usage is billed directly by the provider. See How to obtain and connect your API key. For more information on access and billing, visit the Pricing page.

 

  • Maximum Cost Per Run (Integer): Maximum Cost Per Run limits how much this Model can spend on a single run. Once the limit is reached, the run stops.

 

  • Maximum Cost Per Chat (Integer): Maximum Cost Per Chat limits how much this Model can spend in a single chat session. Once the limit is reached, the session stops accepting new requests.

 

  • Maximum Cost Per Day (Integer): Maximum Cost Per Day limits how much this Model can spend in a single calendar day. Resets automatically at the start of each day.

 

  • Maximum Cost Per Week (Integer): Maximum Cost Per Week limits how much this Model can spend in a single calendar week. Resets automatically at the start of each week.

 

  • Maximum Cost Per Month (Integer): Maximum Cost Per Month limits how much this Model can spend in a single calendar month. Resets automatically at the start of each month.

 

  • Interactions (Integer): The total number of model interactions recorded for this Model. This value is tracked automatically and cannot be modified.

 

  • Total Tokens (Integer): The total number of tokens processed by this Model, combining input and output tokens. This value is tracked automatically and cannot be modified.

 

  • Input Tokens (Integer): The total number of input tokens sent to the model by this Model. This value is tracked automatically and cannot be modified.

 

  • Output Tokens (Integer): The total number of output tokens returned by the model for this Model. This value is tracked automatically and cannot be modified.

 

  • Total Cost (USD): The total cost accrued by this Model, combining input and output cost. This value is tracked automatically and cannot be modified.

 

  • Input Cost (USD): The portion of the total cost attributable to input tokens. This value is tracked automatically and cannot be modified.

 

  • Output Cost (USD): The portion of the total cost attributable to output tokens. This value is tracked automatically and cannot be modified.

 

  • Avg Cost / Interaction (USD): The average cost per interaction, calculated as the total cost divided by the number of interactions. This value is tracked automatically and cannot be modified.

 

  • Created At (DateTime): This is the date and time when this Model was created. This value is automatically generated and cannot be modified.

 

  • Updated At (DateTime): This is the date and time when this Model configuration was last modified. This value is updated automatically whenever any field is changed.


Ready to Configure Your Model or Want to Explore the Console Guide?