Skip to main content
You stop an inferencing deployment to take a fine-tuned model out of service. NexusOne removes the model from the LLM Router and shuts down its server, so requests no longer reach the model.

Prerequisites

Before starting this task, ensure you have the following:
  • Required roles: nx1_finetune_admin, nx1_finetune_user, or nx1_engineer.
  • A previously created inferencing deployment that isn’t stopped or archived.

Stop an inferencing deployment

Perform these steps to stop an inferencing deployment:
  1. Log in to NexusOne.
  2. On the top navigation bar, hover your mouse over AI and then select AutoML & AutoLLM.
  3. Click Fine-tune LLMs (AutoLLM).
  4. Click Inferencing.
  5. Click the three dots at the end of the row for the deployment you want to stop.
  6. Select Stop.
The deployment status changes to stopped. If you no longer need the deployment, then refer to Delete an inferencing deployment.

Additional resources

For a high-level overview of inferencing and how it’s used in NexusOne, refer to Fine-tune LLM.