Skip to content

Add compute providers to Hydra

Hydra is our internal service for talking to compute providers. Integrating more providers into Hydra increases compute availability. Integrating a new compute provider means creating a new package which provides a new InstanceManagerBackend. Adding a new compute provider involves the following steps within Hydra (and manual verification testing):

  1. Create a Client specific for the provider you want to add
  2. Abstract calling the Client in an InstanceManagerBackend
  3. Integrate the new provider package with creating an InstManager in Hydra's main.go
  4. Add relevant secrets and provider-specific configurations to the deployment workflow of the Hydra service
  5. Configure the desired GPUs in the supported_gpus.yml for each environment

Tip

To test the new provider code by hand, create a simple server with HTTP endpoints. Have those endpoints call the methods of your Client or the InstanceManagerBackend.

Tip

Two steps are easiest to copy: integrating the provider in Hydra's main.go, and configuring Hydra for it. Look at how verda or primeintellect do both.