Difference between revisions of "New features"

From VistrailsWiki
Jump to navigation Jump to search
(Add "new" marker for packages that were completely absent in 2.0)
 
(15 intermediate revisions by 2 users not shown)
Line 1: Line 1:
This is a list of work-in-progress features, or features that haven't been released in a 2.0.x version.
This is a list of work-in-progress or unreleased features. See also the [[Development Branches|list of development branches]].*


== Core ==
== Features not on v2.1 branch ==


=== vistrails prefix [ready] ===
These features are on master but not on the v2.1 branch. (v2.1..master)
'vistrails.' prefix added to package names.


This allows to use VisTrails as a library, it obsoletes the "init_for_library.py" hack.
=== Packages ===


=== Multi-line string parameters [ready] ===
Tabledata now has writer modules, BuildTable, Microsoft Excel support, JSON, join/select/project
The parameter editor allows to enter multi-line strings. It can be toggled between single-line and multi-line mode.


=== Bundles [needs work] ===
SQL package now uses SQLAlchemy. COMPATIBILITY: not compatible, because now returns a Table.
Fixed and updated the bundle installation system. It allows to automatically install required Python packages when they are first imported without restarting VisTrails or entering commands.


Supports the 'pip' installer (on both UNIX and Windows), apt (through Python binding) and Fedora (with yum -- '''binding currently broken, only uses cmd''')
GMaps package


=== Automatic conversion [ready, documented] ===
RemoteQ package
Connecting incompatible ports is possible if a Converter subclass exists for these specific types.


Documented in the users' guide.
HTTPDirectory, SSHDownloader, URLEncode, URLDecode, Cross, StringFormat, ReadFile


=== Enumeration for module ports [ready, demonstrated for PythonCalc] ===
=== Improved module/parameter/widget configuration APIs ===
It is possible to declare the possible values on a module's input port; the UI then shows a combobox.


=== [[multithreaded-interpreter|Parallel execution]] [work in progress, undocumented] ===
rename-api, ???
Changes to the interpreter allowing the parallel execution of modules in a pipeline.
 
=== Allows default values to be set by Python value ===
 
=== Associate with .vt and .vtl files on Linux ===
 
=== Schema and migrations for startup.xlm ===
 
=== Don't leak temporary files ===
 
=== Suspending modules and the job monitor ===
 
=== Package upgrades get chained ===
 
=== Automatic loops and streaming ===
 
???
 
=== Keeps input/output port of unconnected port when ungrouping ===
 
=== Allows reloading a disabled package ===
 
=== Export cells in different formats ===
 
=== Exporting version tree to graphviz DOT format ===
 
=== Control parameters ===


This is opt-in for modules and thus doesn't break modules that use thread-unsafe code. Supports threads, multiprocessing and IPython clusters.
???


Replaces parallelflow.
=== Debugger for code or package issues ===


=== Pausing/cancelling execution [ready, documented] ===
=== Output modules ===
In users' guide.


== Packages ==
???


=== controlflow [ready] ===
=== Module Parmeter Widgets ===
* Added some modules: Default, Sum, And, Or
* Added module While (not merged in, branch optimize-module)
* Fold split into Fold and FoldWithModule
* Fixed product modules, now have ElementwiseProduct, Dot and Cross


=== (new) parallelflow [ready, documented] ===
== Other features ==
Provides a way to execute modules or groups on an IPython cluster, via a Map module. Also has IPython UI to set it up, and an API to use IPython in other modules.


Documented in the users' guide. First implemented in Oct, 2012 by Fernando.
These features are not on master yet but rather on different branches. (--branches --not master)


Note that it becomes obsolete with multithreaded-interpreter although a lot of code was reused.
=== Core ===


=== (replaces pylab) matplotlib [ready, examples exist] ===
==== [[multithreaded-interpreter|Parallel execution]] [work in progress, documented] ====
Replaces pylab with a better interface (specialized modules autogenerated from matplotlib's docstrings).
''(branches: multithreaded-interpreter, multithreaded-interpreter-target-seletion)''


Lots of examples in examples/matplotlib/
Changes to the interpreter allowing the parallel execution of modules in a pipeline.


=== (new) tabledata [ready] ===
This is opt-in for modules and thus doesn't break modules that use thread-unsafe code. Supports threads, multiprocessing and IPython clusters.
A package allowing to load CSV files and NumPy arrays, to display them as a table and to convert between datatypes.


=== (new) BatchQ-PBS ("JobSubmission") [work in progress, undocumented] ===
Replaces parallelflow.
Task submitting package using [https://github.com/troelsfr/BatchQ BatchQ].


Still work in progress.
==== New subworkflows (design phase) ====
See [[SubworkflowsDesign]]

Latest revision as of 13:41, 1 October 2014

This is a list of work-in-progress or unreleased features. See also the list of development branches.*

Features not on v2.1 branch

These features are on master but not on the v2.1 branch. (v2.1..master)

Packages

Tabledata now has writer modules, BuildTable, Microsoft Excel support, JSON, join/select/project

SQL package now uses SQLAlchemy. COMPATIBILITY: not compatible, because now returns a Table.

GMaps package

RemoteQ package

HTTPDirectory, SSHDownloader, URLEncode, URLDecode, Cross, StringFormat, ReadFile

Improved module/parameter/widget configuration APIs

rename-api, ???

Allows default values to be set by Python value

Associate with .vt and .vtl files on Linux

Schema and migrations for startup.xlm

Don't leak temporary files

Suspending modules and the job monitor

Package upgrades get chained

Automatic loops and streaming

???

Keeps input/output port of unconnected port when ungrouping

Allows reloading a disabled package

Export cells in different formats

Exporting version tree to graphviz DOT format

Control parameters

???

Debugger for code or package issues

Output modules

???

Module Parmeter Widgets

Other features

These features are not on master yet but rather on different branches. (--branches --not master)

Core

Parallel execution [work in progress, documented]

(branches: multithreaded-interpreter, multithreaded-interpreter-target-seletion)

Changes to the interpreter allowing the parallel execution of modules in a pipeline.

This is opt-in for modules and thus doesn't break modules that use thread-unsafe code. Supports threads, multiprocessing and IPython clusters.

Replaces parallelflow.

New subworkflows (design phase)

See SubworkflowsDesign