blogs
Software Test and Performance Conference East - 2007
Submitted by Donald Foss on Sat, 2007-09-29 18:50.See me at STPConEast2007
continue reading "Software Test and Performance Conference East - 2007"
TWAI load testing session
Submitted by Donald Foss on Tue, 2007-03-27 10:54.I want to thank everyone who came today. Below are links to the sample test plan and load testing reports that I mentioned during the session.
If you have any comments or questions on the session, feel free to email them to either of us.
Donald E. Foss
The worst thing you can do to your home page -- don't slow it down on purpose!
Submitted by Donald Foss on Thu, 2007-03-01 13:43. FundamentalsThis one will be short, because there simply isn't that much to say. Your home page is one of the most important pages on your site in terms of the visitor's experience. If your site requires registration, authentication or identification, nearly all users must go through this page. It is the proverbial front door to your site and application.
On a recent load test, the test had to be aborted after 9 minutes, while they were only at 25% of the planned total load level of 385,000 sessions per hour. They were using a LAMJ architecture, and each home page hit generated a long running SQL query. Even very patient users, who are tolerant to slowdowns and errors, will not stick around if the home page takes several minutes. However, this site didn't even do that! After 2 minutes into the test, the pages simply said "
continue reading "The worst thing you can do to your home page -- don't slow it down on purpose!"
Goal metrics - one of the worst ever
Submitted by Donald Foss on Mon, 2006-12-04 00:21.If you've ever heard me speak, you've probably heard me talking about how we need to stop thinking about concurrent users, except for a very small number of circumstances. However, a few weeks ago I came across a goal metric much, much worse than concurrent users. This customer was still using BroadVision and wanted to achieve a certain number of Active Sessions in BroadVision (shudder).
CMG 2006
Submitted by Donald Foss on Sun, 2006-12-03 12:25.I'm here at CMG 2006 in Reno, Nevada. Below are links to presentations that I am either presenting, or my colleagues are presenting.
Non-linear scaling
Submitted by Donald Foss on Sun, 2006-11-19 20:26.Non-linear scaling
Although I take it as a given, not everyone understands that applications do not scale linearly, no matter how much we wish that they did. If the application performs well with 10,000 user sessions per hour in the QA environment with 2 application servers, it may not work well in production with 100,000 user sessions per hour and 20 application servers. One example of this behavior has recently come to my attention.
Fundamentals - load test in a production-like environment
Submitted by Donald Foss on Mon, 2006-11-13 08:24. FundamentalsOne of the keys to a realistic load test is to test on the same infrastructure and equipment that you will be utilizing in production. The corollary is to make sure that any scheduled jobs that run during production run during the test, and jobs that only run at off-peak times do NOT run during the test. Friday night we were testing a site that started to fail at the 50% load level. Their web servers were not especially busy, and their application servers were only moderately loaded. The culprit? Rsync and other batch jobs running to replicate content and perform routine site maintenance. The system administrators had to kill a number of processes and put the cron jobs on hold. The data for that load level was largely useless.
continue reading "Fundamentals - load test in a production-like environment"
Performance testing for Web 2.0
Submitted by Donald Foss on Thu, 2006-11-02 13:09.Performance testing for Web 2.0 is similar in some ways to regular web testing, but quite different in other ways. This blog will discuss some of the ways that Web 2.0 is different in testing aspects from pre-Web 2.0 sites, and how they should be tested differently. I'll also talk about traditional web load testing, common problems, and load testing pitfalls.
