Wednesday, June 17, 2009

Simple Things Do Matter :)


I had to check a fix provided by a programmer to solve an issue.
I had to replace two files- One an .exe and the other .ini file.
Once I replaced the files, changed the contents of the files to suit my test and went through the steps to reproduce the issue, the issue was still reproducible.

So, I sent an email to the programmer that the issue is not resolved and the fix does not solve the issue. He wanted to have a look at my machine and try the scenario once.

Before handing over the control to the programmer, I copied the two files which were part of the test. This way I can compare the files after the programmer has completed his test.
The programmer was in Germany and was accessing the machine. I could not see what actions he was carrying out on the machine.

After ten minutes, I got a reply to that email that the issue is solved. Please re-test to confirm.

I was surprised and then along with my manager wanted to carry out the test. Before conducting the test, I wanted to compare the current file(after programmer conducted the test) and the file used by me to conduct the initial test.

And surprisingly, the contents were slightly different.
The initial file had 'Timer: 5:00:00 PM' and the new file had 'Time: 5:00:00 PM'.

Also, the programmer asked me to include an additional step so that the issue is resolved.
The additional step was to exit the service and run the .exe so that it may re-read the contents of the modified .ini file. I had not run the .exe after modifying the .ini file.

I replied back to him that the contents were changed and also the additional step was missed. These were the two reasons why I was able to reproduce the issue and he wasn't.

Learnings:

1. It is always safe to have a backup of files before and after conducting the test. Again it depends on what value this step adds to the overall mission. In my case, If I had not compared with the original file, there was very little chance that this issue would have been fixed before the customer found it.

2. Programmers have a natural tendency to fix issues on the fly. It is by nature that they fix issues and they do not consider it important to inform the tester about the changes. In my case, it turned out to be 100% true. The programmer never informed me about the change of text to 'Time' from 'Timer'.

3. I must have paid a bit more attention and come to the conclusion that the .exe must have been run to re-read from the .ini file. This taught me to relate the interaction between files & application to the tests I conduct using those files.

Simple things like having a backup of important files helped me find an important issue before it knocked the customer's door :)







Leia Mais…

Wednesday, April 15, 2009

Should I cross the road now ?



Last week, I was lucky to have captured this image live.

This is about a traffic signal: Not the movie, this is about the signalling device used to control traffic. On one of the main roads near my residence, the traffic signal displayed one of the rare-to-be-seen visuals.

As seen in the image, this seems to be a signal to guide the pedestrian.


I would expect only one image to be displayed at this traffic signal.

Either the

'Red Pedestrian' meaning: Do not Cross now
or
'Green Pedestrian' meaning: It is safe to cross now
should have been displayed.
I was waiting at the other end of the traffic light and waiting for it to turn 'Green'.


And I was surprised at what I saw for the next 128 seconds.
Both the 'Red Pedestrian' and the 'Green Pedestrian' images were displayed simultaneously next to each other.

Then it turned to 'Green' image for few seconds and alternated between the 'Green' and 'Red' image after a set time interval.
I was not able to observe that 'two images at once' visual. :( [Not reproducible ?]
After a week long observation, I could not see this visual again.
Even after observing the signal continuously for 11 hours (10am - 9pm), the same scenario was not displayed.

My question to all the readers and their friends: How costly is it to miss this bug?


First of all, do you agree that it(display of two images simulataneously) is a bug?
Was this Race Condition not covered during testing?
Was this risk too costly to be avoided in the first place?
Was this risk covered and yet not fixed?

Few questions...

Leia Mais…