JAX2007: Testing with Selenium

I’ve attended the session Testing with Selenium at the JAX conference in the hope to finally understand how it is possible to do professional test automation of web application with this tool.

If you’re interested by test automation, particularly in web area, you will often see people without relevant experience in the domain telling you why such or such tool is great or why you should do this or that. The reason is probably because it is really easy to understand the subject: the goal is “just” to automate what you would do manually on a website. The problem is that even if the question is simple, really good answers are more complicated.

Here we had a typical case of a speaker having no real experience in this area and acting just like a tool vendor. He didn’t say anything about maintainability and his XPath examples weren’t maintainable at all (one had even a missing tbody but this may happens while preparing a slide). Nothing either about scripts generated by a recorder and how carefully they should be considered and finally he avoided my question about his own experience by telling how many tests exist in his company.

Otherwise a few remarks have been interesting:

  • “tests should be made very late, once the application has nearly no change”
    Hmmm, why do you test in this case?
  • “[Selenium’s goal is] test automation for end user” and in the same talk the speaker presented how to use JSPs to dynamically generate the html containing the tests and showed why using Selenium RC is the best choice. Not really coherent.
  • No load testing possible currently because “we want to kill one Mercury product at a time!”
    This is perhaps the explanation: if Selenium’s reference is a product like Mercury’s QTP, then it has no chance to be really useful for really professional test automation projects!

All in one, this session just confirmed my diagnostic on Selenium: it may be useful in some special cases but otherwise it doesn’t allow to create what I call professional tests, ie. tests that are easy to create, cheap to maintain and to extend, that fit in the development process and provide helpful reports when a failure occur.

Advertisements

JAX2007: WebTest Session

I’ve presented, together with Dierk K├Ânig, a session on Test automation of Web Application using WebTest at the JAX conference in Wiesbaden (Germany) on 26.04 (session description in German: here).

We’ve had between 150 and 200 attendees although it was early in the morning and at the last conference day. We’ve presented what is important in test automation of web application, the problems that arise, what should be taken into account to write tests that are easy to maintain and of course why WebTest is a really good choice (the best one! ;-)) to accomplish this task (the slides will be available on WebTest web site next week). According to the reactions we had, people enjoyed it. Dierk even received congratulations from a woman while waiting for his coffee later on the day!

Let’s start

Until recently I thought that a blog was nothing for me… and now I’ve mine too.

The main subjects of my posts will probably be WebTest, HtmlUnit and test automation of web application in general as well as Groovy.

The main language will be English. This means my not-really-perfect-but-hopefully-understandable English with a French accent and a touch of German.

Now let’s see how long it takes before my blog receives the first comments.

PS: thanks to Daniel Gredler who recommended me to use WordPress and whom I stole the style for this blog.