2009
04.14

Splash Screen allows for quit

Finally I added a quit button to the splash screen allowing you to quit the Cyberintegrator at the splash screen. This was something I always wanted to be able to do but was to lazy to add.

2009
04.08

Unstable build is broken

I’m in the process of doing some refactoring in the code. There will not be any visible new things for the Cyberintegrator but this should hopefully make things easier to maintain in the future. This refactoring means that the current unstable build is really unstable and should probably not be used. Hopefully later this week I’ll post an update that it is fixed.

2009
03.26

compiling cyberintegrator

To compile cyberintegrator from source code you can use the following:

1) check out from svn the automatic build project
svn co https://svn.ncsa.uiuc.edu/svn/cyberintegrator/trunk/hudson.build
2) copy the following as a script which should enable building of cyberintegrator. You might have to edit build.sh to point to your eclipse location.

export SVNPRODUCT="edu.uiuc.ncsa.cyberintegrator.rcp"
export PRODUCT="Cyberintegrator.product"
export FEATURELIST="edu.uiuc.ncsa.cyberintegrator.samplecontext"
#export CONFIGS="win32,win32,x86"
export CONFIGS="linux,gtk,x86_64"

sh ./build.sh

3) make sure you have zest installed in eclipse (help->software updates search for zest)
4) install svn pde build from http://sourceforge.net/projects/svn-pde-build/

2009
03.10

Cyberintegrator Server

You can now set properties for the engine used inside the Cyberintegrator server. Create a file called server.properties in the Cyberintegrator server folder. In this properties file you can set the following properties (same as a ThreadedEngine):

queue the file that contains the queue.
workers the number of worker threads (parallel steps execution).
onejvm should same JVM be used for the executors.

2009
03.10

DataView speedup

During the NEES demo I noticed that with large amounts of data it takes a while to generate the dataview, esp when updating tags etc. I spend some time to improve the performance of it. It will now less frequent do a full refresh (which can be done manually using F5). This should show a dramatic update in speed for the DataView. These changes will be pushed into the ToolView as well.

2009
03.10

Updates category

My plan is to try an write more frequent updates about what has happened. Some of the updates might be related to a jira tasks others might be updates that I did while working on the Cyberintegrator.

2009
02.10

Cyberintegrator 2.0 beta 1

We have left the alpha stage and entered the beta stage with Cyberintegrator. One of the major changes that is now in Cyberintegrator is a new way of selecting what context to work with. You will see this at login time, a new combo box has been added to let you pick the context you want to work with. You can also add a new context definition at this time. In the cyberintegrator you can now see what context you are working with at the bottom in the status line, and from the File menu you can now quickly switch from one context to the next. The preferences to set up a context have been removed.

Instead of a step failing it is now possible for just a few outputs to be marked as failed. Allowing steps to continue whos inputs are not failed. Following is a list of all issues resolved in beta 1.

Bug

  • [CBI-124] – mimemap should have a default ext for a mime type
  • [CBI-217] – when changing type of data remove preview
  • [CBI-259] – if output does not exist mark as failed
  • [CBI-288] – Matlab Executor Fails with "engEvalString didn’t work" Error
  • [CBI-290] – double click on attribute allows editing
  • [CBI-298] – Failure running command line tools
  • [CBI-299] – Adding more inputs pushes output out of view
  • [CBI-300] – Editing previous version of tool should make version highest
  • [CBI-301] – show version of tool in step info view
  • [CBI-302] – inconsitency between show all versions of tool/show only latest
  • [CBI-303] – refresh on tools view if preferences for show all has changes
  • [CBI-308] – need a minor version for edits if the major version has not changed.

Improvement

  • [CBI-116] – use org.eclipse.ui.window.newWindow to open new window
  • [CBI-128] – Feedback on what repository is currently used
  • [CBI-130] – Keep track of multiple locations for each type of context
  • [CBI-207] – Drag-And-Drop ability from data to inputs
  • [CBI-280] – execute in executor should only throw AbortException and FailException
  • [CBI-305] – steps should show info if failed
  • [CBI-309] – let user specify max size to download

New Feature

  • [CBI-85] – Support for multiple context of the same type (multiple local stores)
  • [CBI-89] – browse for executable in external executor
  • [CBI-97] – Vocabulary.Dc.DATE and Vocabulary.Dc.CREATOR need to be used
  • [CBI-296] – When re-executing workflow need ability to check outputs of each step before continuation

Sub-task

  • [CBI-281] – mark failed outputs external executor
  • [CBI-282] – mark failed outputs cyberintegrator executor
  • [CBI-283] – mark failed outputs human executor
  • [CBI-284] – mark failed outputs java executor
2008
10.16

Cyberintegrator 2.0 Alpha 7

Over the last two weeks I have been working on the Cyberintegrator to fix numerous bugs that were introduced during the conversion of the context. Please update to this version if you use alpha 6.

One new feature that is introduced is the ability to save a whole context.

Following is a list of all issues resolved in alpha 7.

Improvement

  • [CBI-58] – Console view
  • [CBI-108] – Make Workflow view into a form
  • [CBI-287] – namespace of subjects needs to be tag not http

New Feature

  • [CBI-257] – import / export of context
  • [CBI-278] – Engines need to notify of context changes
2008
09.26

Cyberintegrator 2.0 alpha 6

You can now download Cyberintegrator 2.0 alpha 6. This version includes a major rewrite of the way information is stored in context. As always you should not have to worry about this, the Cyberintegrator will automatically convert your data to the new version. However with this major change I would like to advice you to back up your context. To do this start your current installation of Cyberintegrator and go to Window->Preferences. Select Tupelo Preferences and next Tupelo Context. Check to see what context you are using, if using the local context go to the preferences for the local context and copy the directory this points to. Other contexts can be backed up but not as easy. The next release of Cyberintegrator will have a simple method to allow you to export/import a complete context.

The external executor is now capable of handling tools that have inputs that can appear multiple times, for example when combining images into a single image it was necessary before to create a tool that takes 2 inputs, merge those 2 inputs and rerun the tool with the output generated by the previous step and another image. To merge N images this would requre N-1 steps. Now the tool can specify that certain inputs can appear more than once. Now this requires 1 step to merge N images.

There is a new preference page that allows you to change the engines available to the Cyberintegrator as well modify the settings for the Cyberintgrator engines. There is now also a remote execution engine that allows you run steps on a remote machine. This requires the Cyberintegrator Server to be installed, as well as the use of a shared context.

Following is a list of all issues resolved in alpha 6.

Bug

  • [CBI-152] – Multiple predicates names overlap in Zest graph viz
  • [CBI-192] – external tool runs as background process
  • [CBI-244] – Importing Large Amounts of Data
  • [CBI-247] – Exporting Workflows with tools
  • [CBI-258] – exporting when dataset selected
  • [CBI-261] – matlab needs to differentiate between number and string
  • [CBI-262] – When editing a cyberintegrator tool, the additional resource files somehow migrate over to the spot with the tool definition files.
  • [CBI-264] – export people with tool/workflow/data
  • [CBI-265] – when logging in with name add type
  • [CBI-274] – import/export is missing start/end time of step
  • [CBI-277] – Using Parameters with Tools

Improvement

  • [CBI-45] – Remote Executor Service
  • [CBI-143] – Make data state more descriptive
  • [CBI-236] – start matlab once
  • [CBI-260] – need to use lists instead of collections
  • [CBI-263] – H2 Context
  • [CBI-279] – allow to select a single engine as the default engine

New Feature

  • [CBI-145] – Allow user to specify how many threads are used by the engine
  • [CBI-170] – Enable drag-and-drop executables into the tool pane and then bring up the wizard for specifying the inputs/outputs/parameters
  • [CBI-214] – Data Types in input output
  • [CBI-225] – Default file type during import
  • [CBI-239] – need to export annotations
  • [CBI-243] – save figures
  • [CBI-266] – Engine preference page

Task

  • [CBI-196] – disable automatic conversion of context
  • [CBI-235] – When importing workflow, tool/data might exist already in context

Sub-task

  • [CBI-267] – multiple inputs for external executor
  • [CBI-269] – convert parameters from collection to list
  • [CBI-270] – convert inputs from collection to list
  • [CBI-271] – convert outputs from collection to list
  • [CBI-272] – convert steps from collection to list
  • [CBI-285] – mark failed outputs matlab executor
2008
08.15

Cyberintegrator 2.0 alpha 5

You can now download Cyberintegrator 2.0 alpha 5. One of the new features in this version of the Cyberintegrator is the inclusion of a new executor, Human executor. This executor can be used to have the user perform an action, for example ask the user to take a picture and upload the image, or ask the user to run a tool that can not be encapsulated as a tool in the Cyberintegrator.

As of this version the Cyberintegrator is build using eclipse 3.4. This allowed us to add status messages at the bottom of the Cyberintegrator. This will show you who you are logged in as, as well as the number of jobs that are queued for the local engine and are running.

Following is a list of all issues resolved in alpha 5.

Bug

  • [CBI-119] – should allow for null parameter
  • [CBI-121] – import of zip file as data should trigger import data with metadata first.
  • [CBI-191] – need intro screen to clarify some concepts
  • [CBI-202] – TAG and "Open in new window" are always disabled in context view
  • [CBI-216] – Java Wizard Null error
  • [CBI-220] – Exception
  • [CBI-222] – When selecting input/outputs in java tool wizard, the wizard will not allow you to remove one by itself.
  • [CBI-224] – Adding *.jars to Cyberintegrator Tools
  • [CBI-226] – Unable to run CyberintegratorTool with Parameters
  • [CBI-229] – Editing Command Line Tools
  • [CBI-230] – Cyberintegrator’s java executor does not know how to differentiate between text/plain and application/xml mimetype.
  • [CBI-232] – UUID Error on Workflow Import
  • [CBI-233] – UUID Error on Tool Import
  • [CBI-234] – Unable to edit or remove parameters in Matlab tool creation
  • [CBI-240] – add option to wait for tool
  • [CBI-241] – Tupelo Browser is non-functional
  • [CBI-242] – Selecting "Tupelo View" is not easily accessible from the workspace.
  • [CBI-245] – PermGen out of memory when creating a Cyberintegrator tool
  • [CBI-246] – When importing a command line tool, Cyberintegrator resets the paths in any and all outputs set.
  • [CBI-248] – Increase Default Java Heap Size
  • [CBI-249] – Unhandled event loop exception thrown when running Cyberintegrator tool
  • [CBI-250] – Import and creation of tools unavailable on OS X (jaxb issue)
  • [CBI-252] – Unable to Execute C.I. Tools
  • [CBI-254] – Command Line Tool error
  • [CBI-255] – Unhandled event loop exception thrown when running Command Line tool in build #447
  • [CBI-256] – Showing the version numbers of tools in the export wizard

Improvement

  • [CBI-99] – Improve java executor wizard
  • [CBI-177] – adding attributes only allows adding predicate
  • [CBI-189] – demo context workflow is anonymous
  • [CBI-227] – Tupelo interface for tools
  • [CBI-237] – call script instead of executing each line
  • [CBI-238] – Add application/xml
  • [CBI-251] – if local context don’t stage data

New Feature

  • [CBI-82] – engine should show state of step, number of steps in queue in status line
  • [CBI-140] – Ability to remove tag
  • [CBI-208] – Runtime reporter / timer
  • [CBI-228] – steps should have abort state
  • [CBI-253] – Rename Data

Task

  • [CBI-8] – Human Executors