Lab notes - Revision history

Juliana: /* Installation */

2014-02-06T02:52:24Z

Installation

← Older revision		Revision as of 02:52, 6 February 2014
Line 36:		Line 36:
	1. Start VisTrails		1. Start VisTrails

	2. Go to Preferences -> Module Packages and enable HTTP_new, tabledata_new, and gmaps packages		2. Go to Preferences -> Module Packages and enable HTTP_new, tabledata_new, and gmaps packages (in this order!)

	Here's the example we will use: http://vgc.poly.edu/~dakoop/mta_example/mta.vt		Here's the example we will use: http://vgc.poly.edu/~dakoop/mta_example/mta.vt

Juliana at 02:40, 6 February 2014

2014-02-06T02:40:24Z

← Older revision		Revision as of 02:40, 6 February 2014
Line 32:		Line 32:


	To install the packages, copy them to ~/.vistrails/userpackage and unzip. ~~Then~~ you ~~have to~~ enable ~~the~~ packages in VisTrails:		To install the packages, copy them to ~/.vistrails/userpackage and unzip. On MacOS, the .vistrails directory is located in ~<your_username>. On Windows, the .vistrails folder is in the users %HOMEPATH% directory. Now, you can enable these packages in VisTrails:

	1. Start VisTrails		1. Start VisTrails

Juliana: /* Installation */

2014-02-06T02:37:33Z

Installation

← Older revision		Revision as of 02:37, 6 February 2014
Line 27:		Line 27:
	1. Start VisTrails		1. Start VisTrails

	2. Go to Preferences and disable the HTTP and tabledata packages		2. Go to Preferences -> Module Packages and disable the HTTP and tabledata packages

	3. Quit the system		3. Quit the system
Line 36:		Line 36:
	1. Start VisTrails		1. Start VisTrails

	2. Go to Preferences and enable HTTP_new, tabledata_new, and gmaps packages		2. Go to Preferences -> Module Packages and enable HTTP_new, tabledata_new, and gmaps packages

	Here's the example we will use: http://vgc.poly.edu/~dakoop/mta_example/mta.vt		Here's the example we will use: http://vgc.poly.edu/~dakoop/mta_example/mta.vt

Juliana: /* Installation */

2014-02-06T02:36:40Z

Installation

← Older revision		Revision as of 02:36, 6 February 2014
Line 24:		Line 24:

	Before you install these packages:		Before you install these packages:

	1. Start VisTrails		1. Start VisTrails

	2. Go to Preferences and disable the HTTP and tabledata packages		2. Go to Preferences and disable the HTTP and tabledata packages

	3. Quit the system		3. Quit the system


	To install the packages, copy them to ~/.vistrails/userpackage and unzip. Then you have to enable the packages in VisTrails:		To install the packages, copy them to ~/.vistrails/userpackage and unzip. Then you have to enable the packages in VisTrails:

	1. Start VisTrails		1. Start VisTrails

	2. Go to Preferences and enable HTTP_new, tabledata_new, and gmaps packages		2. Go to Preferences and enable HTTP_new, tabledata_new, and gmaps packages

Juliana: /* Installation */

2014-02-06T02:36:09Z

Installation

← Older revision		Revision as of 02:36, 6 February 2014
Line 18:		Line 18:

	You will need 3 packages to run the example:		You will need 3 packages to run the example:
	http://vgc.poly.edu/~dakoop/mta_example/HTTP_new.zip		* http://vgc.poly.edu/~dakoop/mta_example/HTTP_new.zip
	http://vgc.poly.edu/~dakoop/mta_example/tabledata_new.zip		* http://vgc.poly.edu/~dakoop/mta_example/tabledata_new.zip
	http://vgc.poly.edu/~dakoop/mta_example/gmaps.zip		* http://vgc.poly.edu/~dakoop/mta_example/gmaps.zip


Line 37:		Line 37:

	''Now, you are ready to go!''		''Now, you are ready to go!''







	=== Acknowledgments ===		=== Acknowledgments ===
	This example was provided by [http://vgc.poly.edu/~dakoop/ Dr. David Koop].		This example was provided by [http://vgc.poly.edu/~dakoop/ Dr. David Koop].

Juliana at 02:35, 6 February 2014

2014-02-06T02:35:52Z

← Older revision		Revision as of 02:35, 6 February 2014
Line 11:		Line 11:

	=== Installation ===		=== Installation ===

			You will need to install VisTrails 2.1.1 to run this example.

			You can download the system from http://www.vistrails.org/index.php/Downloads.
			Select the link that matches your operating system.

			You will need 3 packages to run the example:
			http://vgc.poly.edu/~dakoop/mta_example/HTTP_new.zip
			http://vgc.poly.edu/~dakoop/mta_example/tabledata_new.zip
			http://vgc.poly.edu/~dakoop/mta_example/gmaps.zip


			Before you install these packages:
			1. Start VisTrails
			2. Go to Preferences and disable the HTTP and tabledata packages
			3. Quit the system


			To install the packages, copy them to ~/.vistrails/userpackage and unzip. Then you have to enable the packages in VisTrails:
			1. Start VisTrails
			2. Go to Preferences and enable HTTP_new, tabledata_new, and gmaps packages

			Here's the example we will use: http://vgc.poly.edu/~dakoop/mta_example/mta.vt
			After you download, load it into VisTrails.

			''Now, you are ready to go!''







	=== Acknowledgments ===		=== Acknowledgments ===
	This example was provided by [http://vgc.poly.edu/~dakoop/ Dr. David Koop].		This example was provided by [http://vgc.poly.edu/~dakoop/ Dr. David Koop].

	~~You will need to install VisTrails 2.1.1 to run this example. You can download the system from http://www.vistrails.org/index.php/Downloads.~~

	~~Select the link that matches your operating system.~~

Juliana: /* Provenance and Reproducibility */

2014-02-06T02:26:24Z

Provenance and Reproducibility

← Older revision		Revision as of 02:26, 6 February 2014
Line 11:		Line 11:

	=== Installation ===		=== Installation ===


			=== Acknowledgments ===
			This example was provided by [http://vgc.poly.edu/~dakoop/ Dr. David Koop].

	You will need to install VisTrails 2.1.1 to run this example. You can download the system from http://www.vistrails.org/index.php/Downloads.		You will need to install VisTrails 2.1.1 to run this example. You can download the system from http://www.vistrails.org/index.php/Downloads.

	Select the link that matches your operating system.		Select the link that matches your operating system.

Juliana: /* The Problem: Analyzing MTA Fare Data */

2014-02-06T02:25:36Z

The Problem: Analyzing MTA Fare Data

← Older revision		Revision as of 02:25, 6 February 2014
Line 8:		Line 8:
	=== The Problem: Analyzing MTA Fare Data ===		=== The Problem: Analyzing MTA Fare Data ===

			The Wall Street Journal published a story in 2011 that examined MetroCard usage as the cost of fares changed. The original work was created by Albert Sun and Andrew Grossman and published at http://graphicsweb.wsj.com/documents/MTAFARES1108/ on October 17, 2011. To do this, they used the publicly available fare data from the Metropolitan Transportation Authority (MTA). Their results were an interesting snapshot of usage patterns in the six months before and after the fare change. Because this data is made available on a weekly basis, it is possible to analyze more recent data as it becomes available. In addition, we can restrict views to specific lines or compare different ranges of time. As we will see, by using VisTrails, it becomes much easier to do these types of explorations.

	=== Installation ===		=== Installation ===

Juliana: /* Provenance and Reproducibility */

2014-02-06T02:24:17Z

Provenance and Reproducibility

← Older revision		Revision as of 02:24, 6 February 2014
Line 6:		Line 6:
	Today, we will use [http://www.vistrails.org VisTrails], an open source data analysis and visualization system that systematically captures provenance as a user explores data using computational processes. We will discuss the benefits of provenance, in particular, the ability to reproduce results and re-use knowledge.		Today, we will use [http://www.vistrails.org VisTrails], an open source data analysis and visualization system that systematically captures provenance as a user explores data using computational processes. We will discuss the benefits of provenance, in particular, the ability to reproduce results and re-use knowledge.

	=== The ~~Example~~: Analyzing MTA Fare Data ===		=== The Problem: Analyzing MTA Fare Data ===


			=== Installation ===

			You will need to install VisTrails 2.1.1 to run this example. You can download the system from http://www.vistrails.org/index.php/Downloads.

			Select the link that matches your operating system.

Juliana: Created page with '== Provenance and Reproducibility == Data exploration is inherently a trial-and-error process -- as well formulate and test hypothesis, we often need to follow many different li…'

2014-02-06T02:22:26Z

Created page with '== Provenance and Reproducibility == Data exploration is inherently a trial-and-error process -- as well formulate and test hypothesis, we often need to follow many different li…'

New page

== Provenance and Reproducibility ==

Data exploration is inherently a trial-and-error process -- as well formulate and test hypothesis, we often need to follow many different lines of reasoning, use different tools, explore multiple parameter value combinations. It is not uncommon to arrive at an interesting result and not remember the exact path that took you there.
Therefore, it is important to maintain detailed ''provenance'' of the steps followed, data and parameter values used. This is particularly important for Big Data, where complex processes and data are used.

Today, we will use [http://www.vistrails.org VisTrails], an open source data analysis and visualization system that systematically captures provenance as a user explores data using computational processes. We will discuss the benefits of provenance, in particular, the ability to reproduce results and re-use knowledge.

=== The Example: Analyzing MTA Fare Data ===