Manage an Inference API endpoint

Use the Deployments section of Inference API to monitor and manage the model endpoints your organization has created. Each row shows the endpoint status, name, model, region, replica count, recent request count when available, and current hourly cost.

​

Open endpoint details

Open an endpoint’s options menu and select Details. For a running endpoint, the details view can include:

• Endpoint URL
• Model
• GPU and quantization
• Context window
• License
• Region
• Cost so far and current hourly rate
• Replica count
• Requests per hour
• Inter-token latency
• Tokens in and out over 24 hours
• Output speed
• Quick-start snippets for Python, JavaScript, and curl

The information changes with endpoint state. A stopped endpoint shows the information needed to start it again, including its stopped time. A terminated endpoint shows basic historical information and total cost, but no usable endpoint or quick-start snippets. You can also copy the endpoint URL directly from the Deployments list while it is available.

​

Understand endpoint states

The console says starting a model takes about 90 seconds.

​

Stop an endpoint

Use Stop when you want to take an endpoint offline but may need the same configuration again.

1. Open the endpoint’s options menu.
2. Select Stop.
3. Review the confirmation.
4. Select Stop model.

The endpoint stops accepting requests as its replicas shut down. Serving charges pause once the endpoint is stopped.

​

Start a stopped endpoint

1. Open the options menu for a Stopped endpoint, or open its details.
2. Select Start or Start model.
3. Review the confirmation.
4. Select Start model.

The endpoint moves to Starting and begins serving again when it reaches Running. Billing resumes once serving capacity is running. Starting can be blocked when the organization does not have enough credits or the required capacity is unavailable.

​

Retry failed replicas

A Retry action can appear for endpoints that are Partially running or in Error. Retry asks Hivenet to try the failed serving replicas again. Healthy replicas are left alone, so a Partially running endpoint can keep serving while recovery is attempted. Retry does not start an endpoint that you deliberately stopped. Use Start for a Stopped endpoint. If Retry is unavailable or repeatedly fails, see Troubleshoot Hivenet Inference API.

​

Change replica count

When the Edit control is available beside Replicas in endpoint details:

1. Select Edit.
2. Choose the new fixed replica count allowed by the console.
3. Review the updated capacity and price.
4. Select Save.

Increasing replicas can add serving capacity and raises hourly cost. Reducing replicas lowers capacity and cost after the change takes effect. See Manage replicas and capacity for the full scaling behavior.

​

Terminate an endpoint

Use Terminate only when you no longer need the endpoint. Termination is permanent.

1. Open the endpoint’s options menu.
2. Select Terminate.
3. Review the confirmation checklist.
4. Confirm each item to acknowledge that requests will fail, the endpoint URL will no longer be usable, billing will stop when termination completes, and the action cannot be undone.
5. Select Permanently terminate.

After termination:

• The endpoint no longer serves requests.
• Its URL can no longer be used.
• It cannot be started again.
• Serving charges stop once termination is complete.
• The terminated entry remains visible until you clear it.

​

Clear a terminated endpoint

Clear removes an already-terminated entry from the Deployments list.

1. Open the options menu for a Terminated endpoint.
2. Select Clear.
3. Review the confirmation.
4. Select Clear model.

Clearing is only a cleanup action. It does not stop or terminate an endpoint that is still running or stopped.

​

Next steps

• Manage replicas and capacity.
• Understand Inference API billing.
• Troubleshoot Inference API.