Behavior Driven Testing¶

As editlive is a Interface component, a BTD approach is used for testing it.

This gives this project the following benefits:

Writing test is really easy. Non-programmers could almost write them.
It tests the client and the backend at the same time, like a real user would
It allow real world testing in multiple browsers (but currently only in Firefox and Chrome are tested)

Travis CI is used as build server. Not only you can see the current build status and the complete history, but you can see the build status of branches and pull requests.

The test suite is a mix of Lettuce, Selenium and Splinter.

Lettuce¶

Lettuce makes writing the test cases and scenarios very easy

Features¶

Feature: Manipulate strings
  In order to have some fun
  As a programming beginner
  I want to manipulate strings

  Scenario: Uppercased strings
    Given I have the string "lettuce leaves"
    When I put it in upper case
    Then I see the string is "LETTUCE LEAVES"

Steps¶

from lettuce import *
@step('I have the string "(.*)"')
def have_the_string(step, string):
    world.string = string

@step('I put it in upper case')
def put_it_in_upper(step):
    world.string = world.string.upper()

@step('I see the string is "(.*)"')
def see_the_string_is(step, expected):
    assert world.string == expected, \
        "Got %s" % world.string

For more information about using Lettuce with Django consult the Lettuce documentation.

Splinter¶

From its website: “Splinter is an open source tool for testing web applications using Python. It lets you automate browser actions, such as visiting URLs and interacting with their items.“

from splinter import Browser
browser = Browser()
# Visit URL
url = "http://www.google.com"
browser.visit(url)
browser.fill('q', 'splinter - python acceptance testing for web applications')
# Find and click the 'search' button
button = browser.find_by_name('btnK')
# Interact with elements
button.click()
if browser.is_text_present('splinter.cobrateam.info'):
    print "Yes, the official website was found!"
else:
    print "No, it wasn't found... We need to improve our SEO techniques"
browser.quit()

For more infos about Splinter.

Selenium¶

From its website: “Selenium automates browsers. That’s it. What you do with that power is entirely up to you. Primarily it is for automating web applications for testing purposes, but is certainly not limited to just that. Boring web-based administration tasks can (and should!) also be automated as well.“

For more infos about Selenium.

Running the tests¶

See the Testing and development environment documentation for an example of how to quickly setup a testing and development environment.

With Google Chrome¶

cd example_project/

export BROWSER="CHROME"
./run-tests

With Google Firefox¶

export BROWSER="FIREFOX"
./run-tests

Note: Google Chrome is used as default.

Test command arguments¶

If you have special arguments to pass to the test runner you will have to use the full command:

python manage.py harvest

To test a single feature:

python manage.py harvest test_app/features/date.feature

Excluding applications:

python manage.py harvest -A myApp1,myApp2

For a complete argument documentation, please refer to this section of the Lettuce documentation.

Manual tests¶

The example_project can also be used to perform manual tests.

While in the virtualenv, use the command ./run-server. It accepts arguments as usual.

Open the dev server url, an index of the tests should show up.

If you click on a test it will bring you to a page with an URL like this: http://127.0.0.1:9999/test/char/.

You can pass arguments to the editlive instance using GET parameters: http://127.0.0.1:9999/test/char/?class=fixedwidth&width=80&template_filters=upper.