Friday, September 19, 2008
Presubmit testing at Google
Here is an interesting blog post from Marc Kaplan, test engineering manager at Google, on their strategy of running what they call 'presubmit tests' -- tests that are run automatically before the code gets checked in. They include performance tests, and they compare the performance of the new code with baselines from the previous week, then report back nice graphs showing the delta. Very cool.
Subscribe to:
Post Comments (Atom)
-
Here's a good interview question for a tester: how do you define performance/load/stress testing? Many times people use these terms inte...
-
Update 02/26/07 -------- The link to the old httperf page wasn't working anymore. I updated it and pointed it to the new page at HP. Her...
-
I've been using dnspython lately for transferring some DNS zone files from one name server to another. I found the package extremely us...
1 comment:
We do something similar in my group at Nuance. There all the tests must pass before you can check in, including the performance tests (takes about 30-40min on a slow single proc machine). Usually any change you make affects at least one test baseline so its not a onerous as it sounds.
The accuracy tests are a bit different as they run on the grid and take much longer. Those are run for releases (about 4 a month).
We have gotten some flack in the past about being so strict about our testing and commit policies. Every so often we are forced to give an 'under the table' release to a researcher, and without exception this had come back to haunt them. Not sure why they keep thinking its a good idea...
Post a Comment