Skip to main content

BDD is over-rated

Over the past few years, I have tried to justify the use of a BDD (Behavioral Driven Development)  framework to express my tests, but not once have been able to say BDD has helped me address a  problem which writing tests the non BDD way would not have addressed. I do understand the value BDD brings to the table, but in most projects that I have implemented BDD on, we have tried to provide a solution (BDD) to a problem that does not exist.

Let me try and explain. Lets look at the key benefits of expressing tests the BDD way (There could be more)
  • Collaboration between Business and Development
  • Ubiquitous Domain Language
  • Focus on the behavior of the application
Now, more often than not unless your business is co-located with the team, collaboration is not the easiest.

The value BDD brings here, is the business validating our understanding by reading our tests expressed in the Given When Then format (BDD) and providing feedback, as BDD expresses the behavior of the system in a language that fits the domain.

However, time with the business is minimal and most has to be made of the little time we get with them. Having to validate our understanding on what needs to be delivered, the priorities etc take up most time, but asking the business to read our automated tests is something I have found difficult to get buy in on.

 In spite of trying to explain the value BDD brings to the table, the business would not consider this as an important task. And finally, the team ends up writing BDD tests, which is an additional abstraction layer which needs to be maintained.

I have tried on many projects to get the business to validate our understanding of what needs to be tested by sending across our BDD tests, but without much success of the real values BDD actually provides. These days, BDD is used just because it is the IN THING and everyone is doing it, so why shouldn't I do it? I have been able to successfully express my tests in a very domain specific language without having to use BDD and also maintaining the key principle of automated testing "Separate Intent from Implementation".

I would use BDD only if my business is co-located and these BDD tests are used by the business to validate that the story is "Done".

Comments

  1. I agree that BDD has become way to liberally applied due to popularity, although my experience has led me to a different conclusion about when it is most useful. If Dev teams and stakeholders are co-located there should be no physical barriers to prevent you from creating an agile working environment. Why would you want to promote detailed formal documentation over fluid face to face conversation? Trust me, stakeholders will be much more readily available for the later. What I would say is that the principles off BDD should still be invoked here, "give me an example" is a statement I use all the time. On the flip side, if your stakeholders are located off site, you can't do Agile, no arguments, you just can't. Sure you can do screen sharing and conference calls etc, but that all has to be pre-arranged and kills the fluidity. Ultimately you end depending upon more documentation for referencing requirements because you can't get that info immediately from the horse’s mouth. If you have to document requirements, do so using BDD, arrange those conference call, capture those requirements together using specification by example and then implements those test, so that you can show those requirements passing.

    ReplyDelete

Post a Comment

Popular posts from this blog

How does one decide what to automate?

A question that has been troubling me for years is how much to automate. We all like to achieve maximum coverage and build a robust safety net where possible in order to give us confidence about the system under test. Given there is ample time i would like to automate almost everything, but in the real world, this isn't possible. This is when we introduced the concept of Value and Cost for a test scenario. Every test scenario would be assigned either of these attributes. Lets call the attribute automation classification High Value - Low Cost High Value - High Cost Low Value - Low Cost Low Value - High Cost What this translates into is we are associating business value and cost to automate to every scenario. So, when a test scenario is of high business value and the cost to automate it is low, then this becomes our ideal automation candidate. You would like to start automating all test scenarios that fit into the High Value - Low Cost category first. See picture below If tim...

Test your services and not your UI

As a tester, i have spent more than 6 years trying to automate tests at the UI layer. As years passed, better automation frameworks evolved resulting in writing more manageable and maintainable code, but the only thing that wasn't getting better was the cost of maintaining these tests, especially when the no. of tests were 500+. There are multiple reasons why i feel creating an automated regression suite of tests at the UI layer is not good. Some of them are Limitations on what the tool can do Time taken to execute these tests leading to longer feedback loop Success rate of tests is not 100% due to latency issues Change in UI and UI flow resulting in an increase in cost to maintain UI tests On the other hand, testing business logic without having to deal with the dumb UI was a concept that a friend of mine at ThoughtWorks, Chirag Doshi introduced to me. He sent me couple of blog links written by Alex Verkhovsky about why is it so hard to do functional test automation at th...