Software Information

Making The Decision To Automate Your Software Testing


Not every software testing project can or should be automated. Before your department accepts a new test automation project, you should establish a process by which projects are reviewed and either accepted or rejected. This can be done with a simple Test Automation Acceptance Checklist.

Repeatable Test Cases with Static Data

The true cost benefit of test automation is achieved only when the same scripts are executed multiple times. The first execution is very expensive because it includes the one-time cost of the automation tools and 100% of the Test Automation engineer's time. When the scripts are executed again, the cost of test automation declines sharply. The tool has already been purchased and the scripts have already been coded. If there have been changes in the application, the scripts may require maintenance before being executed. Maintenance on minor software updates should be minimal.

Because test automation is only successful when the scripts can be executed multiple times, only application which require the same test cases to be executed with the same data are good candidates for automation. For example, a mortgage application that needs to be regression tested on a weekly basis could be a good candidate for test automation. Script maintenance is minimal and the scripts can enter a mortgage application using the same group of test data in a fraction of the time it would take a manual tester to test the same functionality.

On the other hand, a mortgage origination system, which cannot use the same test data for each iteration would not be a good automation candidate. Due to the nature of mortgage systems, data could be staged in various states of approval or rejection, based on the current data and the departments who have already processed their part of the mortgage application. If the script cannot easily figure out what data to enter in the software, it is not a good automation candidate.

Another problem with automating this type of complex system is that the test environment often contains a sampling of production data that is refreshed on a periodic basis. Sometimes this can be overcome by rebuilding the test data when the test environment is refreshed. The feasibility of rebuilding test data on a regular basis depends on the complexity of the application. You will have to make that decision on a case-by-case basis.

Application or Environmental Stability

Environmental stability is crucial to a successfully automating a software testing project. Scripts cannot be coded in a timely manner if the application environment is unavailable, experiences frequent down-times, or excessive defects and errors.

Little or No Application or Environment Downtime

It takes longer to write scripts than it does to manually test the same functionality. Most automation tools are watered down version of C or Visual Basic, which means that writing automated scripts is essentially programming and takes adequate time and specialized skills. Unlike manual test cases, which can sometimes be written based off requirements and mock-ups, automated tools require the actual application. When a test environment is unavailable, automation engineers cannot create scripts, which prolongs the project and ends up costing more.

Excessive downtime can consist of any of the following:

Unstable Environment
Lack of Infrastructure Support
Frequent Application Updates
Buggy Code

Effects of Environment Instability on Script Development and Execution

When an application or environment is unstable, scripting progress is dramatically slowed or stopped altogether. In some cases, it's possible to continue scripting, but this may causes more work at a later date. For example, if you are scripting in buggy code, you may have to script around error messages and the scripts will have to be revised at a later date. Or, you may only be able to create scripts to a certain point and finish them at a later date. To help avoid and decrease environment instability, read the chapter on Service Level Agreements.

Timely Defect Fixes

Application defects do not have to be detrimental to an automated software testing project. When defects are fixed in a timely manner, scripting can continue without significant downtime. When estimating an automated testing project, it's always best to add some buffer time that will accommodate for defect reporting and revisions.

When defect fixes take an excessive amount of time to resolve and are causing the automated software testing project to be delayed, it's time to pull together a meeting. Invite all the major players and discuss the root of the problem and what everyone can to improve the situation. Maybe development is spending too much time trying to reproduce the problem and having your automation team enter better description would help them turn the defect fixes around faster. Maybe you can work together to classify defects and establish reasonable fix times for each classification. For example, a Critical defect needs to be fixed that day while a High defect needs to be fixed with in 24 hours.

Responsive Contact Person

When your team takes on a new automated testing project, you will need a contact person. This person is responsible for making sure you have the business requirements and answering questions about how the application works. This will not be his or her main job, so you will need to make sure he or she is responsive. If you cannot get adequate business requirements, test data, or questions answered, your automation project will not be successful.

Copyright 2004. Danna Henderson. All Rights Reserved.

Danna Henderson has helped many organizations automate their software testing with WinRunner. For information on creating robust, data driven scripts, and successful automated testing, visit WinRunner Experts.


MORE RESOURCES:

Callidus Software Slips To Wider Q4 Loss
NASDAQ
(RTTNews.com) - Callidus Software Inc. (CALD) reported a fourth-quarter net loss of $3.6 million or $0.11 per share, wider than last year's loss of $1.5 million or $0.04 per share. Last year, results included $1.4 million of stock-based compensation ...
Callidus Software Announces Fourth Quarter and Full Year 2011 ResultsMarketWatch (press release)
Callidus Software, Inc. (CALD) Reports In-Line Q4 EPS; Guides Q1 RevsStreetInsider.com (subscription)

all 12 news articles »


Guidance Software stock jumps after strong 4Q
CBS News
(AP) NEW YORK — Shares of Guidance Software Inc. rose to their highest level in more than three years Wednesday on strong fourth-quarter results and an upbeat outlook. THE SPARK: After the market closed on Tuesday, Guidance reported net income of $2.3 ...
Guidance Software to Acquire CaseCentralBusiness Wire (press release)
Guidance Software buys CaseCentral for eDiscovery one-two punchFierceContentManagement
Guidance Software Acquires CaseCentralsocalTech.com
Los Angeles Business Journal
all 9 news articles »


Marin Software Promotes Brian Marin and Ed Stevenson to Global Positions
MarketWatch (press release)
SAN FRANCISCO, CA, Feb 08, 2012 (MARKETWIRE via COMTEX) -- Marin Software, provider of the leading online advertising management platform for advertisers and agencies, today announced the promotions of Brian Marin to Vice President, Global Services and ...

and more »


Moxie Software Sponsors Free, Live Webinar on Canon's Best Practices for Field ...
MarketWatch (press release)
Moxie Software, Inc., the Enterprise Social Software Company, today announced it is sponsoring a free, live webinar discussing Canon's Best Practices for Field Service: The New Face of Customer Satisfaction. John Ragsdale, TSIA's vice president of ...

and more »


Latitude Software and PaymentVision Offer Integrated Debt Collection and ...
MarketWatch (press release)
GAITHERSBURG, Md., Feb 08, 2012 (BUSINESS WIRE) -- Latitude Software, an Interactive Intelligence Group Inc. company /quotes/zigman/5694010/quotes/nls/inin ININ +0.25% , and PaymentVision have partnered to offer an integrated debt collection and ...

and more »


Jive Software Q4 Loss Widens Despite Higher Revenues - Update
NASDAQ
(RTTNews.com) - Enterprise social networking company Jive Software Inc. (JIVE) on Tuesday reported a loss for the fourth quarter that widened from last year as higher costs and expenses offset strong revenue growth. The latest quarterly results are the ...
Jive Software to Present at the Goldman Sachs Technology & Internet Conference ...MarketWatch (press release)
Jive Software reports fourth-quarter lossSan Francisco Chronicle
Jive Financials Show Social Software MomentumInformationWeek
Forbes -TalkinCloud (blog) -RTT News
all 52 news articles »


BMC Software Sells $500 Mln 10-Yr Bonds at 4.316%
Wall Street Journal
By Patrick McGee Of DOW JONES NEWSWIRES NEW YORK (Dow Jones)--BMC Software Inc. (BMC) completed a $500 million sale of 10-year bonds in the US credit markets Wednesday, according to a person familiar with the deal. The 4.25% coupon bonds were priced to ...

and more »


iWay Software and UBM Global Trade Partner to Automate Legacy Processes for ...
MarketWatch (press release)
NEW YORK, NY, Feb 08, 2012 (MARKETWIRE via COMTEX) -- iWay Software from Information Builders, an innovator of enterprise integration solutions, today announced that UBM Global Trade, a worldwide provider of proprietary data, news, and other content ...

and more »


CNET

Google Offers Mobile Chrome Browser for New Android Software
BusinessWeek
7 (Bloomberg) -- Google Inc., seeking to get more of its desktop-computer software onto mobile devices, introduced a test version of its Chrome Web browser for the latest Android operating system. The browser, first unveiled in 2008, will be available ...
Google launches Chrome for Android BetaInquirer
Adobe confirms no Flash for Chrome on AndroidComputerworld
Google releases Chrome beta for AndroidTechnology Spectator

all 509 news articles »


GigaOm

Akamai Acquires Website Performance Company Blaze Software
TechCrunch
After scooping up rival Cotendo for $268 million recently, content delivery and web services giant Akamai is making another acquisition today—Blaze Software. Blaze's technology helps accelerate speed of Websites, and optimizes load times while cutting ...
Akamai scoops up Canadian software outfitBoston Herald
Akamai Technologies Buys Blaze Software - Quick FactsNASDAQ
Akamai Acquires Venture-Backed Blaze SoftwareTechFinance
Xconomy -Sacramento Bee
all 92 news articles »

Google News

Home | Site Map

Powered By: Free Work At Home Business Opportunity!

© 2006