Professional Documents
Culture Documents
May 6, 2009
ExEcuT i V E S u M MA ry
Agile development practices continue to spread across development functions in technology companies. When technology companies adopt Agile practices in the development organization, these changes have ripple effects on other departments whose work is tied to the development cycle such as QA, product management, marketing, sales, support, consulting, and business development. As our survey of technology companies shows, Agile can inspire improvements in how technology companies operate, even if they dont pay much attention to the effect on relationships between development teams and the rest of the organization. To reach the full potential of Agile and to avoid the potential pitfalls of these unintended consequences, companies need more conscious, dedicated efforts around the adoption of Agile across product-related functions.
n oT E S & rE S o u rcE S
Forrester surveyed 229 technology industry professionals in a variety of roles to determine the effects Agile has on company agility. To supplement the survey data, Forrester interviewed 24 technology companies.
2009, Forrester Research, Inc. All rights reserved. Unauthorized reproduction is strictly prohibited. Information is based on best available resources. Opinions reflect judgment at the time and are subject to change. Forrester, Technographics, Forrester Wave, RoleView, TechRadar, and Total Economic Impact are trademarks of Forrester Research, Inc. All other trademarks are the property of their respective companies. To purchase reprints of this document, please email clientsupport@forrester.com. For additional information, go to www.forrester.com.
AGIlE TUNES THE ENGINE, BUT THE REST OF THE CAR NEEDS AN UPGRADE Agile development methodologies can revolutionize how development teams build new products and services. While these methods may create ripple effects in any organization, the consequences of going Agile are most profound in technology companies.1 For this study, Forrester surveyed and interviewed technology industry professionals in a variety of roles including quality assurance (QA), product management, support, consulting, sales, and marketing many of which were not directly involved with the development process. Our data provides a snapshot of Agile adoption, its benefits and costs, and its contribution to success at both a departmental and company level.
Development remains the engine that powers technology companies. Whether the company
focuses on products or services, the development team generates the core value that customers seek.
The line from development to the customer is never perfectly straight. Other groups are
responsible for marketing, selling, supporting, and implementing the technology. Reaching the customer more quickly and successfully, therefore, hinges on working relationships among many groups in technology companies.
Changing the engine affects the rest of the machine. Forresters research into Agiles effect
on technology companies shows that, without any conscious effort to use Agile adoption in development as an excuse or inspiration to make related changes in the company, Agile does have a significant effect on the operations of technology companies.
For technology vendors, Agile methodologies need to improve more than the engine. These
organizational changes may define the next stage of the Agile movement, deliberately using the Agile development as the starting point for changes to the company more broadly. The goal of this next Agile wave would be increasing technology companies responsiveness to market threats and opportunities.
Agile development naturally leads to Agile engagement. If the goal is to shorten the path
between development and the customer, Agile must evolve to become more than just a set of development-centric guidelines. The smooth, efficient engagement of all the relevant moving parts in a technology company is necessary to reach the original goal of Agile.
AGIlE METHODOlOGIES HAvE FOCUSED MORE ON THE ENGINE THAN THE CAR Just as a car is a system of interlocking parts the transmission, steering column, electrical system, etc. a technology company is a system of interlocking organizational and procedural components. While the basic principle of changes to the engine affect the entire car might seem obvious,
May 6, 2009
Agile techniques have not normally taken the consequences of Agile adoption for other business functions into account. To date, the Agile methodologies themselves, such as Scrum, XP, and DSDM, have focused primarily on the development teams and not on their relationships with the rest of the company. In Agile, adaptive project planning spread over short iterations replaces the traditional waterfall methods, which opt for longer releases requiring more upfront planning. User stories replace traditional feature lists. New disciplines, such as continuous integration, become part of the development process. Ultimately, the success of Agile is the degree to which these changes improve the speed and quality of the development teams output. Several years after the publication of the Agile Manifesto, Agile is now successful enough to start devoting more attention to these downstream effects.2 Even if the Agile Manifesto did not provide a comprehensive guide to changes outside the development team, the Manifesto implied that the scope of Agiles goals covered the entire organization, not just one department (see Figure 1).
Figure 1 The Agile Manifesto implies changes beyond Development
Goal of the Agile Manifesto Our highest priority is to satisfy the customer through early and continuous delivery of valuable software. Implied changes beyond the development function Collecting and analyzing customer issues through product management, sales, support, and other customer-facing groups. Building a collective early-warning system among development, marketing, and other groups to identify important market shifts. Working with business development to recruit partners to ll in technology gaps faster and more e ectively than the vendor can address them. Arranging regular customer feedback in person through product management or virtually through additions to the company Web site, such as innovation management and community sites.
Welcome changing requirements, even late in development. Agile processes harness change for the customers competitive advantage.
Business people and developers must work together daily throughout the project.
At regular intervals, the team re ects on how to Handling these assessments across departments to take become more e ective, then tunes and adjusts into account the downstream e ects of Agile adoption its behavior accordingly. (for example, marketings ability to handle more frequent product launches).
53565 Source: Forrester Research, Inc.
May 6, 2009
As Agile further diffuses into technology companies, business decision-makers face serious questions about the changes it generates. In technology companies that adopt Agile development practices, what changes naturally occur? Do other groups, outside of development, view the Agile experiment with the same degree of enthusiasm? Does Agile change anything about the inbound information that guides product and service decisions or the outbound information about these products and services that other groups consume? Does Agile have any impact on development decision-making or on the companys ability to execute in tandem to deliver new products and services? Fortunately, theres still time to answer these questions. Agile enjoys serious momentum, but most development teams believe that they are far from finished with their implementation of Agile (see Figure 2).
Figure 2 For Most, The Agile Journey is not Finished
How complete is your implementation of Agile? Our implementation of Agile failed 4% We have a mature implementation of Agile methods 35%
We are still evaluating Agile and have not yet begun to adopt it 17% We have just started adopting Agile methods 17%
We are midway in our adoption of Agile 33% Base: 241 technology industry professionals in a variety of roles, including but not limited to development (percentages do not total 100 because of rounding) Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
May 6, 2009
WHAT HAPPENS IF YOU ONlY UPGRADE THE ENGINE? When development teams go Agile, some changes in the operations of the larger company are inevitable. Our research shows that, when aggregated, these changes are positive. However, these adjustments are accidental, and not every technology team successfully makes these changes. In any case, they represent only the side effects of Agile development, which are far smaller than the full potential of Agile engagement. Agile Shortens Release Cycles During our interviews, we discovered that technology vendors use Agile to break up a single release into smaller, more manageable iterations. Two-thirds of technology companies report that their product cycles have shortened as a consequence of adopting Agile in development (see Figure 3).
Figure 3 Faster iterations usually lead To More Frequent releases
Has Agile changed the frequency of product releases? Less frequent 3%
No change 30%
Base: 216 technology industry professionals in a variety of roles, including but not limited to development Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
May 6, 2009
These organizations see Agile as a way to make more frequent midcourse corrections. Whether or not the company releases a new version of a product with each iteration, the shorter cycles make it easier to adjust to changing customer demands and market realities. According to the companies we interviewed, shorter cycles also make releases more predictable. By reducing the complexity of the release, managers can more accurately estimate when the work will be completed. Once again, we are focusing on the development team. As important as these benefits are, technology companies are looking for other returns on the Agile investment, too. If technology companies dont take concrete steps to harmonize Agile development cycles across both development and delivery, such as marketing and support, they may not be able to fully harness Agiles benefits. For example, even the best marketing team can execute only so many demandgenerating campaigns each year assuming that each iteration produces something that is new, different, or valuable enough to market. Shorter Trips Make It Easier To Understand Where Everyone Is Going To move at Agile speed, technology companies need to collect, filter, and feed information in to the development process. This inbound information includes critical details like customer business problems, use cases, integration challenges, and adoption realities. However, development is not the only consumer of this information. This information is vital to both development and delivery and to harmonizing both business functions. A growing, shared mosaic of market and customer information, to which every group contributes and which every group consumes, lowers the risk of all groups making bad decisions, not just the development team. Fortunately, according to our survey data, Agile development does create some compulsion to better transmit and share information. Technology industry professionals and not just those involved directly in the development process believe that Agile increases companywide access to critical market and customer information (see Figure 4).
May 6, 2009
No change 40%
Base: 216 technology industry professionals in a variety of roles, including but not limited to development (percentages do not total 100 because of rounding) Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
These improvements are significant, but detailed analysis shows that they fall short of the company-level Gestalt that technology vendors would like to achieve. Some interviewees, while acknowledging that Agile improved the scale of inbound market and customer information, noted that the scope of these improvements usually is uneven. For example, some vendors indicated that internal product training was easier to develop and assimilate when each, more frequent release featured more targeted functional improvements. However, many teams struggle to convert the artifacts of the development process, such as user stories, into deliverables for external consumption. For instance, the index card-sized chunks of information drafted within development for development dont easily translate into product collateral and demos. But You Still Need To Chart The Route Our research shows that Agile generates some improvements to outbound information and activities in technology companies. The degree to which the entire company can execute, in sync, a new product or service release is one of the most important tests of this outbound work. The stakes are high, maximizing the revenues, market share, or other business goods from the new technology brought to market. Unfortunately, the pitfalls are all too familiar, such as the gap of weeks or months between the actual release and the ability of some groups to fully market, sell, implement, or support the technology.
May 6, 2009
The improvements on the outbound side are roughly the same as those on the inbound side, if not slightly smaller (see Figure 5). This result is hardly surprising. The degree to which various groups share an understanding of the product or service strategy behind a release will limit, in practice, how well these groups can implement their parts of that strategy. (This assumes, of course, that the strategy was realistic or accurate in the first place). Agile Marginally Improves Working Relationships Both inbound and outbound activities are the proving ground for the relationships among groups. If the relationship between two groups is bad, any activities that require the participation of both groups can only achieve limited success. For example, if marketing and development dont trust each other, activities such as new product training and reviews of product marketing collateral are likely to suffer. Our research shows that the unintended ripple effects of Agile only marginally improve the relationships between development and other groups. Without deliberate efforts to build on the opportunities that Agile adoption presents, the following rule applies:
Before adopting Agile. The closer to the development process another group is, the better
the quality of their relationship with development. For example, QA is a direct participant in development, while sales has only a distant relationship to this process (see Figure 6-1).
After adopting Agile. The amount of improvement in the relationship between development
and another group is, again, a function of how close that group is to the development process (see Figure 6-2).3
Base: 216 technology industry professionals in a variety of roles, including but not limited to development (percentages do not total 100 because of rounding) Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
May 6, 2009
Product management Product development/ engineering QA Executive management Business development Marketing Operations Support Documentation Sales Consulting
6-2 Since your adoption of Agile, how has this working relationship changed? 5 much better 4 3 no change 2 1 much worse 39% 39% 34% 23% 23% 16% 17% 17% 17% 15% 11% 13% 21% 18% 18% 17% 16% 17% 41% 28% 26% 23% 27% I dont work with this group N= 2% 25% 6% 156 2% 30% 3% 124 3% 30% 5% 210 3% 40% 5% 207 2% 53% 9% 206 48% 6% 9% 206
Product management Product development/ engineering QA Executive management Business development Marketing Operations Support Documentation Sales Consulting
53% 6% 5% 213 2% 53% 7% 213 45% 8% 2% 52% 2% 12% 215 14% 214 29% 196
Base: technology industry professionals in a variety of roles, including but not limited to development Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
May 6, 2009
10
14% 9% 8%
Base: 241 technology industry professionals in a variety of roles, including but not limited to development Source: December 2008 Global Agile Company Online Survey
53565 Source: Forrester Research, Inc.
AGIlE DEvElOPMENT CREATES THE NEED FOR AGIlE ENGAGEMENT Agile development techniques can provide real benefits to technology companies. However, the ability to reap these benefits at a company level will remain limited as long as technology vendors treat Agile as strictly the development teams concern. To return to our automotive analogy, continued enhancements to an engine will result in marginal improvements to the cars performance. Without upgrading the drivetrain, components like the differential set a hard limit on how fast the car can run. Worse, a faster car without more responsive steering is a potential death trap for anyone driving it. These questions of company-level benefits and efficiencies follow familiar economic principles: Continued investment in only one aspect of a firms performance eventually reaches the point of diminishing marginal returns (see Figure 8).
May 6, 2009
11
Agile Expands The Democracy Of Good Ideas While other aspects of the relationships between development and other groups may see little or no improvement, one element changes dramatically. Agile increases the degree to which outsiders inform and influence decisions made within the development team. It might seem easy to dismiss these results, as most Agile methodologies include the voice of the customer some procedural or organizational change designed to give customers a greater say over the final product. While Agile teams might follow these guidelines for example, by recruiting some representative users to provide regular feedback they might be congratulating themselves for listening to advice that they dont actually follow. However, our survey results depict changes in product decision-making that are much harder to dismiss. Agile contains no voice of the rest of the company, but our data clearly shows that groups outside of the development team play a greater role in product and service decisions (see Figure 7).4 Equally striking is the one group that plays a smaller role in these decisions executive management. Agile teams work at too fast a pace and in too independent a fashion for executives to micromanage them. Executives still retain the power to set strategic direction, shape the product vision, and programmatically intervene at key decision-making junctures, but they cannot haphazardly jump into and stomp on low-level (but potentially high-value) discussions of topics like feature priorities and design options.
May 6, 2009
12
Development only
Benefits
53565 Source: Forrester Research, Inc.
Agile Engagement Builds On Agile Development The whole point of improving a cars performance is to reach a particular destination the finish line in a race; home and the office during the daily commute faster and more reliably. Similarly, Agile as originally conceived had its own destination in mind: delivering value to the customer. While Agile development improves some aspects of performance, the next stage requires Agile engagement. Other groups in the company, not just the development team, must engage in the same process. Inevitably, this means changes to how these different organizational components interact with the engine of development. For example, some gears connecting development and marketing rotate according to the speed of product launches. The Agile development team might be capable of producing several small releases each year. However, even the best marketing team has a limited number of opportunities to craft new product messages and get the attention of the intended audience, including both existing customers and prospects. Nevertheless, running development at a higher speed can improve overall performance in other ways. More frequent iterations that dont necessarily get released nonetheless provide the marketing team with several iterations of functional code, each of which can be the raw material needed for collateral, demos, and other marketing deliverables.
May 6, 2009
13
Ultimately, these improvements and accommodations shorten the distance between development and the customer. However, these improvements are only possible if a technology vendor treats this process as a companywide engagement. Agile Engagement Introduces New Requirements Agile engagement changes many practical elements of Agile adoption (see Figure 9). As the scope expands, the measures of success change. Just as engine RPMs cant tell you the actual top speed or fuel efficiency of a car, technology vendors must craft other metrics to capture how well the Agile tune-up is succeeding at a company level. As the number of components increases, so too must the number of tools needed to upgrade and tune them.
Figure 9 Agile Development Versus Agile Engagement
Agile development Scope The development team, plus groups that work most directly with it (QA, documentation, etc.) Ambition Improvements to the process and output of development teams. Metrics Measures of development team performance, such as length and predictability of release schedules, amount of code refactoring, and amount of working code checked in. Delivery Products and services, on a more rapid schedule. Agile engagement The functions that provide and manage pathways from product to customer, including marketing, sales, service, and support. Improvements to the ability of the company to respond to market opportunities and threats. Measures of company-level capabilities and behaviors, such as the ability to change business plans and reporting relationships to achieve company goals. Overall value to the customer, which depends on the actions of support, sales, marketing, and other groups, not just the contents of product releases or service o erings. Based on estimates, such as sales forecasts, of how product and service decisions contribute to company goals. Support the actions within other groups and, in many cases, the working relationships among development and other groups. Examples include CRM win/loss data that can inform product decisions and Web 2.0 technologies that can improve the speed and e ectiveness with which product information circulates through the company.
Source: Forrester Research, Inc.
Investment Based on estimates, such as use cases, of how product and service decisions contribute to overall product quality or completeness. Tools Support the actions of the development team, such as project management, application life-cycle management, and automated testing and deployment.
53565
May 6, 2009
14
r E c o M M E n D AT i o n S
Pick an acute problem to fix during Agile engagement. For example, lets suppose that
customer-facing parts of the company, such as sales and support, do not receive full training on a new product until six to nine months after its launch. here is an opportunity to deal with an urgent need while at the same time demonstrating to the company what the Agile company imperative is all about.
Reward improvements. if you dont give employees incentives for participating in Agile
engagement, they will continue to focus on executing according to the priorities of their own departments. To continue our example, someone within or close to the product team, such as a product manager, needs to see tangible benefits to increasing the diffusion of product knowledge immediately after the release. if not, product training might continue to take the form of show up and throw up presentations that dont provide much information to sales, marketing, support, consulting, and other groups.
Change the metrics. At the same time that you change rewards, you probably also need to
change how you measure the behavior being rewarded. For example, technology companies usually measure post-release company readiness by activities that should increase readiness but may not. rather than counting the number of 1-hour Webinars that product managers or product marketers delivered, companies might instead survey support, consulting, sales, and other groups to see how much they really understand about the new releases.
Include your customers. Just as the voice of the customer needs to be included in Agile
development, it also plays a critical role in Agile engagement. For example, what sort of post-launch product knowledge is it important that salespeople have? improved product training for sales might equip salespeople with a lot of facts that arent really what customers want to hear about the value of new product releases and service offerings.
May 6, 2009
15
W h AT i T M E A n S
SUPPlEMENTAl MATERIAl Methodology Forrester drew data from its December 2008 Global Agile Company Online Survey, which surveyed 229 technology industry professionals in a variety of roles to determine the effects Agile has on company agility. We also interviewed the following vendors, as well as three that did not wish to be named. Companies Interviewed For This Document Affiliated Computer Services (ACS) BMC Software Borland Software Clickability Danube Technologies IBM Kaiser Permanente KANA Software Liberty Mutual Insurance Company Lumeta OutSystems Protegra Quest Software Rally Software Development Sabre Holdings Serena Software Singularity Limited Sybase ThoughtWorks VersionOne XDx
May 6, 2009
16
ENDNOTES
1
By Agile, we mean the entire spectrum of iterative development methodologies inspired by the Agile Manifesto. In early 2008, Forrester estimated that approximately one-sixth of all software development teams had adopted Agile, in some form, to some extent. See the February 6, 2008, Enterprise Agile Adoption In 2007 report. For the complete Agile Manifesto, visit Manifesto for Agile Software Development (http://agilemanifesto. org).
We assigned the following scores to each response about the quality of the relationship: very bad = 1; moderately bad = 2; neither good nor bad = 3; moderately good = 4; very good = 5. We asked our respondents to rate the importance of various internal groups in the decision-making process. For the sake of simplicity, we have provided the percentage of respondents who indicated that particular groups played a moderate or substantial role in product decisions.
May 6, 2009
Forrester Research, Inc. (Nasdaq: FORR) is an independent research company that provides pragmatic and forwardthinking advice to global leaders in business and technology. Forrester works with professionals in 19 key roles at major companies providing proprietary research, consumer insight, consulting, events, and peer-to-peer executive programs. For more than 25 years, Forrester has been making IT, marketing, and technology industry leaders successful every day. For more information, visit www.forrester.com.
53565