SCOREBOT CHANGELOG

Scorebot v1.02

1.02 -- 09-APR-2007

Bug Fixes

Reporting Team Mismatch on Competition Index Page Fixed. The competition index page did not match up suite score breakdowns and total scores with the correct team.

Basic Report Generation Fixed. If there was more than one team, the reporter would crash when trying to generate a basic report.

Scoring Language Assignment Fixed. The assignment operator for the scoring language now works.

Minor Fixes. A number of minor details were fixed. Specifically, if the code in a scoring rule changed, the GUI would not prompt the user to save changes before opening a new file or exiting.

New Functionality

Report Now Includes Graphs. The reporter now creates a number of graphs in PNG format to accompany its HTML output. The main page template now displays a chart which shows each team's total score over time. It also has a chart which displays each suite's score over time. Each team's index page also has a chart showing their scores on each suite of time.

Tweaks and Minor Upgrades

Performance Improvements. Some code improvements to facilitate better performance (avoiding the creation of new objects for Integer, Double, Boolean, and String classes, map iteration, etc.).

Reporter Progress Bar. This progress bar used to track the number of teams complete. It now also tracks the index page instead of showing 100% complete after finishing each team but before the index page was actually generated.

1.01 -- 02-APR-2007

Bug Fixes

Recompilation Fixed. If scores were recompiled multiple times without closing the program between runs, then results from the previous run were being re-used. This has been fixed so that each time scores are compiled, it starts from scratch as it should.

Multiple Team Reporting Fixed. The report for each team was just a copy of the report for the last team. This was occurring because the NTP was being reconfigured for each team (i.e. putting in its team name and IPs) but this overwrote the previous teams' info. This process was done before computing stats, so it caused this bug. This was fixed by giving each team a deep copy of the actual NetworkTestPackage before reconfiguring it for each team.

URL Retrieval 'url' Option Changed. Web's file integrity check now takes just a path to a file on the webserver vice an entire URL. The actual URL which will be requested is now created as the concatenation of "http://", the IP address of the web server, "/", and the page being requested (the last part being the part the user specifies). The old test did not use the IP address specified by the user. If the specified port for the web service is 443, then "https://" will be used instead of "http://". The name of the option is now "path_to_file" vice "url".

File Lock Problem Fixed. Files are now closed when they are done being input or output. (This means they can be edited or deleted while the program runs now ... and that extra open file handles aren't hanging around).

Team Template in Recently Used Menus Fixed. If a team template was opened (Auditor, Scorer, Tester), the filename was set to its NTP's filename. This caused the shortcut for open recently used files menu to open the NTP instead of the team template. Now the actual filename specified is saved.

Auditor's Reporting Buttons Disabled Fixed. The reporting buttons were only being enabled when a TestEvent was selected. This has been fixed -- they are enabled whenever a file is loaded now. If clicked when no items are checked, then it warns the user that no items have been modified.

Auditor Crash on Select All + Action Fixed. When the entire tree was selected, the Auditor would crash if an action was performed on the selected events (e.g. report time changed/set/unset or the event(s) were removed). This has been fixed.

Basic Code Problems Fixed. If a Test Item's name was changed, any Basic Rule's which used that name continued to use the old name. Any rule's which use a Test Item whose name is changed are now automatically updated to use the new name. Also, the combo box of test item names and results are now updated as appropriate. If the test item being examined is changed., the results combo box is now updated to reflect the results which may be returned by the test in the newly selected Test Item.

New Functionality

Audit En Masse. The Auditor previously could only audit one result at a time. This has been improved so that once one result has been audited, you can apply (e.g. copy) its audited value and comment to all other checked items. The application can be limited to either all checked items which were generated by the same test (e.g. Resolve Hostname, Ping, etc.) or by the same test item (the things which run some sort of test which are defined by the user in the Configurer). Each of the different application buttons has a tooltip which shows the name of the currently selected test / test item.

Recompile Scoring from Auditor. The Auditor now has a menu 'Recompile Scoring' under 'Actions' which allows the Auditor's user to easily recompile scoring. This is useful since score recompilation needs to be done to have accurate score events whenever a result is audited or removed.

Keywords. Ability to specify special keywords in option values which get replaced by actual values: $IP, $PORT.

Tweaks and Minor Upgrades

File Change Check Improved. The process which checks to see if the file currently being edited now prompts the user to see if they want to save changes or not only if the file has been changed, and always if the file has been changed. Previously, an imperfect method which didn't work as well was being used.

Competition Name Specification. The competition name is now stored in the NTP.

Time Fields May Now Have Units. Fields on the ConfigurerGUI which require a period of time as input (e.g. min/max interval, time between reps, and time period length for rule thresholding based on time) now allow users to input some value and (optionally) the unit of time which that represents. Though many fields are in terms of seconds, this allows users to easily enter values in terms of minutes, hours, or days too.

Basic Rule Improved. The number of results to check and the minimum number of results to accept now have minimum values of 1. Also, the minimum number of results to accept cannot be greater the number of results being checked; if the user enters a value which is too large, it is reduced to the maximum allowed value. Also, if the number of results to check is 1, then the mimium number of results to accept field is hidden since its only valid value is one (which it will be automatically set to).

Use Unique Results Now True by Default. The option for a rule to use unique results is now true by default. This option, which prevents a given rule from using the same results multiple times, seems like it will usually be true.

Option Value Requirements Relaxation. Options which don't require values are no longer forced to have values (Email's Sendmail's subject and body, SMB's Read File's expected_value, and Web's File Integrity Check's expected_value).

Tester Now Checks Time Ranges to Run. The tester now checks to see when the NTP's time ranges to run are for each Test Item. If they are all in the past, then it warns the user and then exits. If there are some in the future but none including the current time, then the user is warned, but the Tester will just wait until that time comes.

Main GUI Open Report Buttons. The main GUI now has buttons to open up each of the different report types with the user's default browser.

Main GUI Launch Adjusted. If a .xml filename is used to launch Scorebot, then it will be opened in the Main GUI.

Main GUI Auditor Button Adjusted. The Main GUI used to always launch the Auditor with the current NTP (or the NTP which the current template was based on). It doesn't make sense to look at score events associated with the "team" specified by an NTP being used as a template because it won't have any results for the template NTP by itself. Now the Main GUI will launch the Auditor and automatically load the current NTP or the current team template if one of those is the Active Configuration type. If a competition template is loaded, the GUI is just launched and the most recently used file will be opened.

Default Output Locations. The results, scoring, and reporting information for a team is now stored in the folder compName/teamName/ vice teamName/. Reports are now output to compName/report/xy vice compName/ by default on the Main GUI. x is either A or L (all or limited) and y is either B or F (basic or full).

Min/Max Value Representation on Reports. If score thresholds are set in the Configurer to have no minimum or maximum, then those fields' values are shown as "no minumum" and "no maximum" (respectively) vice showing the minimum/maximum integer value that the JVM could handle.

Title text adjusted. Title for the manual test scheduler dialog has been fixed (was "Generate Event", now "Manually Schedule a Test").

Distinction between 'Selected' and 'Checked'. The Auditor is now makes a distinction (in the text it displays) between "selected" and "checked" events. The "selected" event is the event whose row is highlighted in the tree (only one at a time can be selected). The "checked" event(s) are the events which are actually checked in the tree. This may or may not include the selected event, and may not have any events at all or every event.

Help Menu More Helpful. Added shortcuts in the Help menu on all GUIs to launch the changelog.htm file and the user's manual (scorebot_manual.pdf). A more informative about dialog was also created.

1.00 -- 30-MAR-2007: Initial Presentation