Case study: Pensions and insurance company
During the analysis phase, we discovered that the testing team was using only manual testing of deliverables employing a limited amount of data.
A very good thing was that although the testers had no skills in code writing they were very open to understand and implement complex interrogations in a database architecture.
The main goal was to develop a test automation solution that would check all the following conditions:
- to be easily customizable – using as test data database queries
- to be easy to use by the client’s testing team: it was important that the testers could add or revise test scenarios even without developement skills
- the coverage of the test scenarios had to be the highest possible for all the different technologies and data sources that were being used
- to be a dynamic solution that would rely on the extensive information and logic stored in the databases and also on the customizations supported by the testing framework.
The biggest challenge was to create a custom automated testing framework. At that moment, our approach was quite rarely used in the industry and there was little to no documentation. We wanted the testing framework to „teach itself” various paths to follow based on the data stored in the database. We also used a bit of reverse engineering in order to ensure advanced testing.
The second challenge was to make this special automated testing framework easy to use and augument by the client’s testing team.
We created a testing framework for the web interface of both the internal and external applications. The framework was specially designed for this client using Selenium Webdriver and was written in Java.
In order to test the content of the web application, pdf files and emails we figured out a way of generating the expected content based on static text and dynamic data collected from the database at runtime. Afterwards we compared the content of the tested application with the one generated by the automated testing framework.
For all the applications that are being tested using this particular framework, the testing time has been reduced from days or even weeks to only several hours. The number of testing scenarios has also increased from 5-10% to 90% coverage.
After the implementation of the automated testing framework, the tasks of the testing team consisted only in testing possbile edge cases and creating new database queries for the new functionalities.