Your e-Business Quality Partner eValid™ -- Automated Web Quality Solution
Browser-Based, Client-Side, Functional Testing & Validation,
Load & Performance Tuning, Page Timing, Website Analysis,
and Rich Internet Application Monitoring.
© Copyright 2000-2008 by Software Research, Inc.

eValid -- EVALUATING: Performance Testing

Getting Started

System Requirements
Architecture
Installation
GUI Basics
Preferences
Files
User Manual
Getting Help
License Key Issues
eValid Usage Issues

Performance Testing
Basic Concepts
Using Timers
Alarms
Timing Example
Tuning Example
Monitoring Example

Getting Started

System Requirements

What are the System Requirements for eValid?

Do I need to have I.E. installed?

Yes, eValid requires the presence of at least Internet Explorer 5.5 as eValid makes use of the libraries contained within I.E.

Architecture

What is a important about eValid?

The advantages of using eValid are:

Installation

How do I install eValid?
Follow the steps outlined below in order to successfully install eValid:
  1. Double Click on the eValid installer (eValid6.exe) if you have downloaded the program from our website or insert the eValid CD in your CD ROM drive and double click the eValid install icon.
  2. The "Welcome to the Install Shield Wizard for eValid" page is displayed. Click "Next" to proceed.
  3. Carefully review the eValid "SOFTWARE PRODUCT LICENSE AGREEMENT". Click on "Yes" if you agree to the terms and conditions of the license.
  4. Select a directory where eValid will be installed. The default setting will install eValid in "C:\Program Files\Software Research". Click "Browse" to install in another location.
  5. Choose the appropriate options for your eValid installation. Click "Next".
  6. As soon as eValid completes the installation, review the installation results. Click "Next".
  7. Click "Finish".

GUI Basics

How do I start recording a test?

To start recording a test, follow these simple steps:
  1. Click on the red button on the upper right hand side of eValid -or- Access the eValid menu (Record > Start Recording) -or- By pressing F4 to start recording.
  2. You will be prompted to enter a name for the test you are about to create.
  3. Perform a series of actions in the site you are testing.
  4. Stop recording by pressing the Stop button on the upper right hand side of eValid
    -or-
    Press F4 to stop recording.
How do I play back my script?

To start playing back a test, follow these simple steps:

  1. Press the play button on the upper right hand side of eValid
    -or-
    Access the eValid menu (Playback > Start Playback)
    -or-
    Press the F6 key.

Preferences

How do I access the eValid Preferences?

Use one of two ways to open the eValid Preferences:

  1. Press Ctrl + F2.
  2. Click on the eValid menu, select "Settings", choose the appropriate preferences desired.

How do I access and control the cache manager?

Use one of two ways to open the eValid Preferences:

  1. Press F2.
  2. Click on the eValid menu, select "Settings", and choose the Cache Manager.

Can I save different sets of preferences?

You can save a specific set of option from the eValid Profile Manager. Follow the steps below in order to save your settings to a profile.

  1. Select the options that you want to be included in the profile.
  2. Click on Profiles.
  3. Check Save Profile.
  4. Enter a unique name for the profile you are creating.
  5. Click on "OK".
  6. Click on "Save" to apply the changes.

Files

What are evs/evl files?

  1. An evs file is the test that is produced from the recording.
  2. An evl file is a Load Test that is created to include the original script file (*.evs).

Where did I save the script I recorded?

By default, the script is saved under the eValid Project/Group directory unless otherwise specified in the preferences.

What other files are produced by eValid?

Other files produced by eValid are the Event Log, Error Log, Performance Log, the Timing Log and the LoadTest Log.

User Manual

Where do I find the eValid User Manual?

The eValid User Manual can be accessed through eValid by clicking (Help > Documentation > User Manual).

Is there a local copy of the eValid User Manual?

As eValid continually evolves, we are also continually updating the user manual to reflect changes made in the product making it unsuitable to include local copies.

Is there a hardcopy version of the manual?

A PDF Document of the Online User Manual is available for downloading.

Getting Help

Do I have to pay for Technical Support?

Users doing an EVAL of eValid are entitled to limited free product related Technical Support. However, users who use REVENUE keys must be subscribed to maintenance support to access Technical Support.

How do I reach Technical Support?

You can reach eValid Technical Support by sending us email using the eValid menu (Help > E-mail Tech Support) or by giving us a call at 1-800-942-SOFT. If you're having trouble with a script or a recording simply send us a copy of the script and our Technical Support Staff will be glad to help you out.

License Key Issues

I get an error saying "Unable to locate evalid.lic. Identify license file to process?” How do I resolve this?

Make sure that your license key is in the proper directory as well as the eValid executable.

I get an invalid, corrupted, or expired license message. How can I resolve this?

Make sure that your license is still valid by opening it in a text editor and checking the expiration date. Do not alter anything in the license file as the key is encrypted.

For support with you current license, send us your details using the eValid menu (Help > E-mail Tech Support).

My license file seems to be valid but I still keep on getting the invalid, corrupted or expired message. What else can I do?

If you had a previous installation of eValid and had it installed in a different location other than the default location, follow these simple steps to correct this issue (or have your System's Administrator perform the equivalent changes):

  1. Using "regedit" the Registry Editor.
  2. Open "My Computer > HKEY_CURRENT_USER > Software > ...
  3. Continue to Open "Software Research > eValid > eV_Section_Zero".
  4. Look for the eValid entry:
    LicenseFile=%PATH%
  5. Modify and remove the current path and any related values of the eValid license file properties accordingly.
  6. Click "OK" and exit the Registry Editor.
  7. Run eValid again.

eValid Usage Issues

Can I use eValid as a regular browser?

Yes, eValid can be used normally as a browser.

Can I use eValid with other versions of Windows?

As a full featured test enabled web browser, we have only tested eValid with Windows 2000/XP. We cannot guarantee accurate results or proper operation from running eValid in operating systems not mentioned above.

Performance Testing: Timing/Tuning/Advanced Application Monitoring

Basic Concepts

What is the importance of Timing & Tuning?

Timing and Tuning a page is important for users who are concerned about the performance of their site. Timing a site or pages from a site enables the user to measure response times for each page allowing the user to make the appropriate changes to enhance the Websites performance.

What is the importance of Advanced Application Monitoring?

Advanced Application Monitoring allows the user to be able to observe the current state of the site to be able to track page availability and reduce downtimes created by pages that are not responsive or inaccessible.

Using Timers

What are Timers?

Timers are a series of commands in eValid to measure rendering time in the browser from pages recorded in the script.

How are Timers used?

To accurately measure page timings, a timer command is added before and after each URL in the script. For accurate results, cache management should be disabled to ensure that all page components are downloaded and not rendered from the cache.

Alarms

What are Alarms?

The Alarm command available in eValid enables the user to quickly identify pages that exceeds the specified threshold in the command. It also allows the user to quickly address such problems since the alarm pinpoints exactly which page is faulty without going through the entire log file.

How are Alarms used in eValid?

The Alarm command in eValid can be used to generate customized messages in the log files whenever the specified time threshold is exceeded. Additionally, an Alarm can be configured to automatically send a notification email in case an alarm is set off.

Can you provide me with an example to create an Alarm?

To create a simple Alarm script, follow these simple steps:

  1. Start your Recording.
  2. Navigate around the site.
  3. Insert an "OvertimeAlarm" command after the specific URL to be timed. If the specific page exceeds the threshold specified in the Alarm command, a message will be written to the log.
  4. Repeat step 3 for other URL's.

Timing Example

How can I create Timings from my site?

To create timings for your site, follow these simple steps:

  1. Start your Recording.
  2. Insert a "ResetTimer" command.
  3. Navigate to the site you want to measure for timings.
  4. Insert an "ElapsedTime" command.
  5. Stop Recording.
  6. Open the eValid menu preference (Settings > Record/Play Preferences).
  7. Go to the (Record/Play Prefs > Project/Log Management > Log Output) section.
  8. Check "Simple" or "Standard" Log output.
  9. Playback the script.

The playback should produce a simple Timing logfile showing the total time it took for the page to be downloaded and rendered.

How can I create detailed Timings from my site?

To create detailed timings for your site, follow these simple steps:

  1. Start your Recording.
  2. Insert a "ResetTimer" command.
  3. Navigate to the site you want to measure for timings.
  4. Insert an "ElapsedTime" command.
  5. Repeat Steps 2 to 4.
  6. Stop Recording.
  7. Open the eValid menu preference (Settings > Record/Play Preferences).
  8. Go to the (Record/Play Prefs > Project/Log Management > Log Output) section.
  9. Check "Detailed" Log output.
  10. Playback the script.

The playback should produce a detailed Timing logfile showing the total time it took for the page to be downloaded and rendered including the individual download times of the components of the page.

Can you provide me with an example of timing a site?

An excerpt from a timing script:

ResetTimer
InitLink "http://www.yahoo.com/"
ElapsedTime
Wait 5000
ResetTimer
GotoLink "http://www.cnn.com/" ""
ElapsedTime

Tuning Example

How can I tune my site?

Follow these steps to create a tuning script for your site:

  1. Start your Recording from the page you want to tune.
  2. Insert the "ResetTimer" command.
  3. Navigate to the page you want to fine tune.
  4. Insert the "ElapsedTime" command.
  5. Stop Recording.
  6. Play back the script 10 times using the "Run Multiple" playback option available available in eValid. You can set the number of runs in the eValid menu preferences (Settings > Record/Play Preferences).
  7. Using the (Record/Play Prefs > Playback > Multiple Playbacks 'n' value).
  8. Use the Log Charts to compare each playback time for the page and make the appropriate changes.

Can you provide me with an example for page tuning?

Here is an example of a page tuning evs script:

InitLink "http://www.mysite.com/"
ElapsedTime
ResetTimer
FollowLink 63 "" "http://www.mysite.com/1" ""
ElapsedTime
ResetTimer
FollowLink 42 "" "http://www.mysite.com/3" ""
ElapsedTime

Monitoring Example

How can I monitor my site?

eValid user's can monitor their site by setting up eValid to run at every designated time. The script that eValid executes should contain Alarm commands to measure the timings for each page being monitored. If the times exceed the threshold specified in the Alarm, a message is written in the logs or you can send an email report to the email address provided.

Can you provide me with an Advanced Application Monitoring example?

Below is an example of a monitoring script set to run every 30 minutes:

WaitModMM 30
Wait 2000
InitLink "http://www.mysite.com/"
ElapsedTime
OvertimeAlarm 2000 "Alarm Message " "http://www.yourcgiscripthere.com" "you@youremail.com" 2
Wait 2000
ResetTimer
FollowLink 63 "" "http://www.mysite.com/1" ""
ElapsedTime
OvertimeAlarm 2000 "Alarm Message " " http://www.yourcgiscripthere.com" "you@youremail.com" 2
Wait 2000
ResetTimer
FollowLink 42 "" "http://www.mysite.com/3" ""
ElapsedTime
OvertimeAlarm 2000 "Alarm Message " "http://www.yourcgiscripthere.com" "you@youremail.com" 2