ndcctools.taskvine Namespace Reference

TaskVine data intensive workflow framework - Python Interface. More...

## Namespaces

namespace | manager
| This module provides the Manager class, which is neede in every TaskVine application.
namespace | task
| This module provides the classes to construct tasks to submit for execution to a TaskVine manager.
namespace | file
| This module provides the File class to represent all inputs and outputs of tasks.
namespace | dask_executor
| This module provides a specialized manager ndcctools.taskvine.dask_executor.DaskVine to execute dask workflows.

## Data Structures

class | DaskVineWarning

## Detailed Description

TaskVine data intensive workflow framework - Python Interface.

TaskVine is a framework for building large scale distributed data intensive applications that run on clusters, clouds, grids, and similar distributed systems. A TaskVine application consists of a main program that creates a Manager object, and then submits Task objects that use File objects representing data sources. The manager distributes tasks across available workers and returns results to the main application.

See the TaskVine Manual for complete documentation.

Recommended import statement:

import ndcctools.taskvine as vine
ndcctools.taskvine
TaskVine data intensive workflow framework - Python Interface.
Definition __init__.py:1

Relevant classes using recommended import statement:

- vine.Manager
- vine.Task
- vine.PythonTask

Severless execution:

- vine.LibraryTask
- vine.FunctionCall

Dask execution:

- vine.DaskVine