Matching Tasks to Fleets

Instead of specifying hardware details for every task, you can use task profiles in Batch. A task profile is a reusable object that defines the minimum hardware requirements for a task, such as OCPUs, memory, and disk space. For example, you might create a task profile with 4 OCPUs and 16 GB RAM, and another for heavier workloads.

When you submit a task, assign it a task profile. This tells Batch what kind of hardware to allocate, without requiring you to specify a particular fleet.

Batch relies on assignment policies to assign tasks to fleets. Assignment policies are rules that determine how Batch chooses from available fleets for each task.

Assignment policies work in two ways:

• Best-fit Policy: Batch selects the smallest available fleet that meets your task's requirements. If no resources are available in that fleet, the task waits until a slot is available. Tasks aren't moved to larger fleets.
• Flex-fit Policy: If you want more flexibility, Flex-fit allows Batch to assign your task to larger fleets if the smallest one is full. You can set a threshold to control how much larger the alternative fleet can be. If you don't set a limit, Batch uses any available fleet to run your tasks quickly.

If you don't specify a policy, Batch uses Flex-fit with no limits by default.

Batch sorts fleets based on their hardware profiles, including CPU, memory, and then disk. This order ensures that Best-fit and Flex-fit always prioritize smaller, more cost-effective fleets before moving to larger ones.

• Best-fit: Each task is assigned to the small fleet if space is available.
• Flex-fit: If the small fleet is full, tasks are assigned to the medium or large fleet as needed (within any threshold you set).

This scheduling is automatic, and there's no need to manage where each task runs.

Batch automatically matches tasks to the most suitable fleets based on the profiles and policies you select. For more information, see Fleets section in Creating a Batch Context topic.