Skip to main content
For the complete documentation index for agents and LLMs, see llms.txt.

Managing Compute SettingsBeta

Beta
This is coming — this page describes a feature that's still being rolled out and may not be available to you yet.

As an organization admin, use the Compute tab in Organization Settings to choose which instance sizes your organization can use, how many spare instances to keep ready for each size, and which size is the default.

About This Task​

A spare instance lets a new service start on that instance size right away, and it uses compute while it waits. Turning a size on lets services use it. If you keep spare instances at 0 for a size, the first service that needs that size starts one from scratch instead of using a spare.

You must be an organization admin to view and change these settings.

Access Compute Settings​

  1. Click your profile icon and choose Settings.
  2. Go to Organization.
  3. Click the Compute tab.

Update Instance Sizes and Spare Instances​

The Compute tab shows a table with the following columns:

  • Size: The instance size. Your organization can configure Small, Medium, Large, and Extra large instance sizes.
  • Enabled: A switch that turns the instance size on or off for your organization. A size that's turned off isn't available to services.
  • Spare instances: The number of instances of that size we keep running and unassigned, so a new service on that size starts without waiting for a new instance to boot. Hover the info icon next to the column header for details.

To update your settings:

  1. For each instance size, use the Enabled switch to turn it on or off.
  2. For each enabled size, set the number in the Spare instances field. Setting it to 0 keeps the size enabled but doesn't keep any instances ready in advance.
  3. Click Save changes to save your settings.

If loading your current settings fails, an error message appears in place of the table. Click Retry to try loading them again. If a later refresh fails after the table has already loaded, the table and any unsaved changes you made stay visible, and the error message appears above the table.

Turn Off a Size That's in Use​

Turning off an instance size removes its pool of instances. To protect running workloads, you can't turn off a size while any of the following still use it:

  • A deployed service on serverless hosting. Services that are undeployed or on managed hosting don't count.
  • A fleet environment set to that size, even if no service runs in it. Services in an environment run on the environment's size.

When you switch off a size that's in use, a warning titled <Size> is still in use appears below the table. It lists each environment and service on that size, with the workspace of each service. Save changes stays disabled until you switch the size back on or free it.

To free a size so you can turn it off:

  1. In the warning, note the environments and services that use the size.
  2. Move each service or environment to another size, or undeploy the services. To change a service's size, see Scale the Service and Control Cost. To change an environment's size, see Manage Fleet Environments.
  3. Reopen the Compute tab. The list of what uses each size refreshes only when you open the tab, so a stale warning clears after you reopen it.
  4. Turn the size off and click Save changes.

Saving fails if something still uses a size you turned off, for example a service deployed on it after you opened the tab. An error message names what still uses the size, and your settings stay unchanged. A size that was already off never blocks a save.

Set a Default Size​

The Default size is the size we preselect when you create a service in the UI, and the size we use for Studio runs. Until your organization sets a default, everything runs on Medium. Services created through the API without an instance size also use Medium, regardless of the default.

  1. On the Compute tab, make sure the size you want is turned on in the Enabled column. Only enabled sizes appear in the Default size list.
  2. In Default size, select the size you want.
  3. Click Save changes. The message "Your compute settings are saved." confirms the update.

Keep these rules in mind:

  • The Enabled switch for the current default size is locked. To turn that size off, first choose a different default size.
  • If you turn Medium off and haven't chosen a default, the Default size field asks you to choose a size, and you can't save until you do.
  • Clearing Default size returns the default to Medium.