Resources

Task resources specify the computational limits and requests (CPU, memory, GPU, storage) that will be allocated to each task’s container during execution.

To specify resource requirements for your task, instantiate a Resources object with the desired parameters and assign it to either the resources parameter of the TaskEnvironment or the resources parameter of the override function (for invocation overrides).

Every task defined using that TaskEnvironment will run with the specified resources. If a specific task has its own resources defined in the decorator, it will override the environment’s resources for that task only.

If neither TaskEnvironment nor the task decorator specifies resources, the default resource allocation will be used.

Resources data class

For the full class definition, parameter types, and accepted formats, see the Resources API reference.

The main parameters are:

• cpu: CPU allocation — number, string ("500m"), or (request, limit) tuple.
• memory: Memory with Kubernetes units — "4Gi", or (request, limit) tuple.
• gpu: GPU allocation — "A100:2", integer count, or GPU()/TPU()/Device() for advanced config.
• disk: Ephemeral storage — "10Gi".
• shm: Shared memory — "1Gi" or "auto".

Examples

Usage in TaskEnvironment

Here’s a complete example of defining a TaskEnvironment with resource specifications for a machine learning training workload:

import flyte

# Define a TaskEnvironment for ML training tasks
env = flyte.TaskEnvironment(
    name="ml-training",
    resources=flyte.Resources(
        cpu=("2", "4"),        # Request 2 cores, allow up to 4 cores for scaling
        memory=("2Gi", "12Gi"), # Request 2 GiB, allow up to 12 GiB for large datasets
        disk="50Gi",           # 50 GiB ephemeral storage for checkpoints
        shm="8Gi"              # 8 GiB shared memory for efficient data loading
    )
)

# Use the environment for tasks
@env.task
async def train_model(dataset_path: str) -> str:
    # This task will run with flexible resource allocation
    return "model trained"

Usage in a task-specific override

# Demonstrate resource override at task invocation level
@env.task
async def heavy_training_task() -> str:
    return "heavy model trained with overridden resources"


@env.task
async def main():
    # Task using environment-level resources
    result = await train_model("data.csv")
    print(result)

    # Task with overridden resources at invocation time
    result = await heavy_training_task.override(
        resources=flyte.Resources(
            cpu="4",
            memory="24Gi",
            disk="100Gi",
            shm="16Gi"
        )
    )()
    print(result)

For complete format specifications for each resource type (CPU, memory, GPU/TPU/Device, disk, shared memory), including accepted string formats, request/limit ranges, GPU partitioning, and supported accelerator types, see the Resources API reference.