Skip to main content
EVO2 40B is a 40-billion-parameter biological foundation model for DNA sequence generation and analysis. This tutorial walks you through creating a custom NIM template, deploying it on a 4 × RTX 4090 instance, and running inference endpoints. Estimated time: 15–20 minutes (includes model download)

​
What you’ll need

  • A Compute with Hivenet medium instance (4 × RTX 4090 GPUs)
  • A valid NVIDIA NGC API key

​
Steps

1

Create the custom NIM template

  • In the Compute console, go to Templates › Create new template. Evo2 40b Guide 1 Pn
  • Give your template a name, then enter the following custom image URL:
    Evo2 40b Guide 2 Pn
  • Add an environment variable called NGC_API_KEY, and set your personal NVIDIA API key as the value. Evo2 40b Guide 3 Pn
  • Click Save.
This container image is based on the official EVO2 40B NIM container and made compatible with Hivenet’s Compute environment.
2

Create a medium instance

  • From the Compute console, select Create new instance.
  • Choose your location.
  • Under Setup, pick 4 × RTX 4090.
  • In Template, select the custom template you just created (e.g. my-evo2-40b-template).
  • Under Connectivity, add your public SSH key (if not already added) and expose HTTPS port 8000.
  • In Instance name, give your instance a name (e.g. my-evo2-40b-instance).
  • Click Create instance and wait until its state changes to Running.
The first start can take several minutes while the image initializes.
3

Use your EVO2-40B model

Once your instance is running, open the Logs panel.The NIM container automatically downloads the model weights (~ 80 GB).You’ll see messages similar to this once it starts serving:

​
Check model health

When the model is ready, test the health endpoint:
You should receive:
You can also check metadata:

​
Run inference

To generate a short DNA sequence example:
Expected response (example):

​
(Optional) Monitor GPU usage

You can SSH into your instance to check GPU activity:
Then run:
Here is an example output:

​
You’ve served EVO2 40B successfully

Your Compute instance is now hosting the EVO2 40B model through a NIM container, ready for inference requests. You can monitor usage directly from the Compute dashboard or SSH into the instance to view live GPU metrics.