Page Comparison

Charlotte is Bamboo build task for running Selenium IDE scripts (Selenese). Creating Selenese is simple, however running them on a continues integration server is always a challenge. Up until now. Charlotte is meant to make running these scripts in Atlassian's Bamboo CI Server a breeze. Here is how: 

Configuration

There are a variety of ways you can setup your build plans depending on a number of variables. In this page, we will demonstrate how to setup Charlotte in a simplistic manner. You may interpret this setup to suit your needs. 

1. First checkout your code containing your Selenese scripts from your source control. 

2. Add Charlotte task to your build job. 
   
   

    

    

    

    

    

    

    

    

    

   
   

    

   
   
   
   
   
   

3. Since every Bamboo job runs in parallel, we recommend running a separate job for every browser type and OS you intend to test. This will hasten your test runs as well as separate results for each browser you test. See below. 
   
   
4. Configure Charlotte as shown below. 
   1. Task Description: Optional description for what the instance of this task is meant to do. 
   2. Selenese Test Suite or Test Case: Requires name of the file checkout of your source repository that Charlotte is going to run. 
   3. Base URL: Optional URL of the your application to be tested. This gives you the option to overwrite the base url in your Selenese scripts created by your selenium IDE. Most often this points to your local URL. By overwriting this url, you can run the same scripts against your dev, test or pre-production environments.  
   4. Driver: Select the driver of the browser you would like to run your tests against. Charlotte will automatically install these drivers in your Bamboo agent with the exception of Safari which requires an installed extension in the browser. 
      • Selenese Runner: Select the latest version of the runner. This is what runs your tests. Browsers such as Firefox upgrade often. Some times these Firefox upgrades may break your tests. When they do, check to see if this dropdown has a newer version. Charlotte will automatically update the dropdown to the latest version unless your add-on maintenance has expired. 
   5. Build JDK: Select JDK to user to run the tests. Charlotte supports JDK 1.7 and above.
   6. Run options: Selenese runner has lots of options to help tune your Selenium run. Expand the Command Line Options area under the text field to see what options are available for you. 
   7. Working sub directory: If your Selenese scripts are in a different directory than your checked out files, you can configure the path of the directory in this field. 
      
5. Requirements and Capabilities: Once Charlotte is configured, you can target which OS the job will run on by refining your requirements. On the requirements page, you can select the OS detected by Charlotte when the plugin was first installed.

Results

Once your build is complete, Bamboo will publish the results in two formats. 

1. Charlotte format 
   
2. JUNIT format. 

The Charlotte format will display each test case that ran separately.  Charlotte displays total number of tests that ran, passed, failed as well as tests with errors. Charlotte will also show screen shots of the html pages that failed the tests. When clicked, the screenshot expands to fill you browser page. On all failures, Charlotte will highlight in red font all test assertions that failed.