New features

From VistrailsWiki
Revision as of 15:58, 17 October 2013 by Remi (talk | contribs)
Jump to navigation Jump to search

This is a list of work-in-progress features, or features that are not on the 2.1 version. See also the list of development branches.

To be released in 2.1

These are in the 2.1 beta and will be released soon.

Core

Bundles [needs work]

Fixed and updated the bundle installation system. It allows to automatically install required Python packages when they are first imported without restarting VisTrails or entering commands.

Supports the 'pip' installer (on both UNIX and Windows), apt (through Python binding) and Fedora (with yum -- binding currently broken, only uses cmd)

Packages

controlflow [ready, needs more documentation]

  • Added some modules: Default, Sum, And, Or
  • Added module While (backported to v2.0)
  • Fold split into Fold and FoldWithModule
  • Fixed product modules, now have ElementwiseProduct, Dot and Cross

(new) parallelflow [ready, documented]

Provides a way to execute modules or groups on an IPython cluster, via a Map module. Also has IPython UI to set it up, and an API to use IPython in other modules.

Documented in the users' guide. First implemented in Oct, 2012 by Fernando.

Note that it becomes obsolete with multithreaded-interpreter although a lot of code was reused.

Could benefit from the 'spawn-vistrails' effort.

(new) tabledata [ready, undocumented]

A package allowing to load CSV files and NumPy arrays, to display them as a table and to convert between datatypes.

(new) BatchQ-PBS ("JobSubmission") [work in progress, undocumented]

Task submitting package using BatchQ.

Still work in progress.

Other features

These features are not in the 2.1 beta and probably won't make it to the release. They are on different branches

Core

Parallel execution [work in progress, documented]

(branches: multithreaded-interpreter, multithreaded-interpreter-target-seletion)

Changes to the interpreter allowing the parallel execution of modules in a pipeline.

This is opt-in for modules and thus doesn't break modules that use thread-unsafe code. Supports threads, multiprocessing and IPython clusters.

Replaces parallelflow.

New subworkflows (design phase)

See SubworkflowsDesign