| Requirement No (In RD) | Requirement | Test Case No |
| | | |
Showing posts with label Test Metrics Matrix. Show all posts
Showing posts with label Test Metrics Matrix. Show all posts
Tuesday, January 20, 2009
Traceability Matrix
How and When to determine Metrics From Application?
How do you determine metrics for your application?
Objectives of Metrics are not only to measure but also understand the progress to the Organizational Goal.
The Parameters for determining the Metrics for an application:
· Duration
· Complexity
· Technology Constraints
· Previous Experience in Same Technology
· Business Domain
· Clarity of the scope of the project
One interesting and useful approach to arrive at the suitable metrics is using the Goal-Question-Metric Technique.As evident from the name, the GQM model consists of three layers; a Goal, a Set of Questions, and lastly a Set of Corresponding Metrics. It is thus a hierarchical
structure starting with a goal (specifying purpose of measurement, object to be measured, issue to be measured, and viewpoint from which the measure is taken). The goal is refined into several questions that usually break down the issue into its major components. Each question is then refined into metrics, some of them objective, some of them subjective. The same metric can be used in order to answer different questions under the same goal. Several GQM models can also have questions and metrics in common, making sure that, when the measure is actually taken, the different viewpoints are taken into account correctly (i.e., the metric might have different values when taken from different viewpoints).
When do you determine Metrics?
When the requirements are understood in a high-level, at this stage, the team size, project size must be known to an extent, in which the project is at a "defined" stage.
Objectives of Metrics are not only to measure but also understand the progress to the Organizational Goal.
The Parameters for determining the Metrics for an application:
· Duration
· Complexity
· Technology Constraints
· Previous Experience in Same Technology
· Business Domain
· Clarity of the scope of the project
One interesting and useful approach to arrive at the suitable metrics is using the Goal-Question-Metric Technique.As evident from the name, the GQM model consists of three layers; a Goal, a Set of Questions, and lastly a Set of Corresponding Metrics. It is thus a hierarchical
structure starting with a goal (specifying purpose of measurement, object to be measured, issue to be measured, and viewpoint from which the measure is taken). The goal is refined into several questions that usually break down the issue into its major components. Each question is then refined into metrics, some of them objective, some of them subjective. The same metric can be used in order to answer different questions under the same goal. Several GQM models can also have questions and metrics in common, making sure that, when the measure is actually taken, the different viewpoints are taken into account correctly (i.e., the metric might have different values when taken from different viewpoints).
When do you determine Metrics?
When the requirements are understood in a high-level, at this stage, the team size, project size must be known to an extent, in which the project is at a "defined" stage.
Diffrent Types Of Metrics
*******Each Of the Metrics Are Explained In the Previous Posts....With Formula & Description ....Plz Check Out******
Most General Metrics are:
1)Requirements Management
2)Project Management
3)Testing & Review
4)Peer Reviews
5)Other Metrics
Defect Metrics are:
1)Defect Density
2)Test effectiveness
3)Defect Removal Efficiency
4)Defect Distribution
Some Metrics are:
1)Schedule Variance (SV)
2)Defect Removal Efficiency (DRE)
3)Overall Review Effectiveness (ORE)
4)Overall Test Effectiveness (OTE)
5)Effort Variance (EV)
6)Cost Variance (CV)
7)Size Variance
8)Productivity on Review Preparation – Technical
9)Number of defects found per Review Meeting
10)Review Team Efficiency (Review Team Size Vs Defects Trend)
11)Review Effectiveness
12)Total number of defects found by Reviews
13)Defects vs. Review effort – Review Yield
14)Requirements Stability Index (RSI)
15)Change Requests by State
16)Requirements to Design Traceability
17)Design to Requirements Traceability
18)Requirements to Test case Traceability
19)Test cases to Requirements traceability
20)Number of defects in coding found during testing by severity
21)Defects – Stage of origin, detection, removal
22)Defect Density
Most General Metrics are:
1)Requirements Management
2)Project Management
3)Testing & Review
4)Peer Reviews
5)Other Metrics
Defect Metrics are:
1)Defect Density
2)Test effectiveness
3)Defect Removal Efficiency
4)Defect Distribution
Some Metrics are:
1)Schedule Variance (SV)
2)Defect Removal Efficiency (DRE)
3)Overall Review Effectiveness (ORE)
4)Overall Test Effectiveness (OTE)
5)Effort Variance (EV)
6)Cost Variance (CV)
7)Size Variance
8)Productivity on Review Preparation – Technical
9)Number of defects found per Review Meeting
10)Review Team Efficiency (Review Team Size Vs Defects Trend)
11)Review Effectiveness
12)Total number of defects found by Reviews
13)Defects vs. Review effort – Review Yield
14)Requirements Stability Index (RSI)
15)Change Requests by State
16)Requirements to Design Traceability
17)Design to Requirements Traceability
18)Requirements to Test case Traceability
19)Test cases to Requirements traceability
20)Number of defects in coding found during testing by severity
21)Defects – Stage of origin, detection, removal
22)Defect Density
Defect Density - Metric
Defect Density
Description
This metric provides the analysis on the number of defects to the size of the work product
Formula
Defect Density = [Total no. of Defects / Size (FP / KLOC)] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
Calculated from
· Defects List
· Bug Report
Description
This metric provides the analysis on the number of defects to the size of the work product
Formula
Defect Density = [Total no. of Defects / Size (FP / KLOC)] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
Calculated from
· Defects List
· Bug Report
Defects (Stage of origin, detection, removal) - Metric
Defects – Stage of origin, detection, removal
Description
This metric provides the analysis on the number of defects by the stage of origin, detection and removal.
Formula
· Number of Defects
· Stage of origin
· Stage of detection
· Stage of removal
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Bug Report
Description
This metric provides the analysis on the number of defects by the stage of origin, detection and removal.
Formula
· Number of Defects
· Stage of origin
· Stage of detection
· Stage of removal
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Bug Report
Number of defects in coding found during testing by severity - Metric
Number of defects in coding found during testing by severity
Description
This metric provides the analysis on the number of defects by the severity
Formula
· Number of Defects
· Number of defects of low priority
· Number of defects of medium priority
· Number of defects of high priority
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Bug Report
Description
This metric provides the analysis on the number of defects by the severity
Formula
· Number of Defects
· Number of defects of low priority
· Number of defects of medium priority
· Number of defects of high priority
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Bug Report
Test cases to Requirements traceability - Metric
Test cases to Requirements traceability
Description
This metric provides the analysis on the number of test cases matching requirements Vs the number of test cases not matching requirements
Formula
· Number of Requirements
· Number of Test cases with matching Requirements
· Number of Test cases not matching Requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Test Case Specification
Description
This metric provides the analysis on the number of test cases matching requirements Vs the number of test cases not matching requirements
Formula
· Number of Requirements
· Number of Test cases with matching Requirements
· Number of Test cases not matching Requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Test Case Specification
Requirements to Test case Traceability - Metric
Requirements to Test case Traceability
Description
This metric provides the analysis on the number of requirements tested Vs the number of requirements not tested
Formula
· Number of Requirements
· Number of Requirements Tested
· Number of Requirements not Tested
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
· Test Case Specification
Description
This metric provides the analysis on the number of requirements tested Vs the number of requirements not tested
Formula
· Number of Requirements
· Number of Requirements Tested
· Number of Requirements not Tested
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
· Test Case Specification
Design to Requirements Traceability
Design to Requirements Traceability
Description
This metric provides the analysis on the number of design elements matching requirements to the number of design elements not matching requirements
Formula
· Number of Design elements
· Number of Design elements matching Requirements
· Number of Design elements not matching Requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
Description
This metric provides the analysis on the number of design elements matching requirements to the number of design elements not matching requirements
Formula
· Number of Design elements
· Number of Design elements matching Requirements
· Number of Design elements not matching Requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
Requirements to Design Traceability - Metric
Requirements to Design Traceability
Description
This metric provides the analysis on the number of requirements designed to the number of requirements that were not designed
Formula
· Total Number of Requirements
· Number of Requirements Designed
· Number of Requirements not Designed
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
Description
This metric provides the analysis on the number of requirements designed to the number of requirements that were not designed
Formula
· Total Number of Requirements
· Number of Requirements Designed
· Number of Requirements not Designed
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· SRS
· Detail Design
Change Requests by State - Metric
Change Requests by State
Description
This metric provides the analysis on state of the requirements
Formula
· Number of accepted requirements
· Number of rejected requirements
· Number of postponed requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Change Request
· Software Requirements Specification
Description
This metric provides the analysis on state of the requirements
Formula
· Number of accepted requirements
· Number of rejected requirements
· Number of postponed requirements
Metric Representation
· Number
Calculated at
· Stage completion
Calculated from
· Change Request
· Software Requirements Specification
Requirements Stability Index (RSI) - Metric
Requirements Stability Index (RSI)
Description
This metric gives the stability factor of the requirements over a period of time, after the requirements have been mutually agreed and baselined between Ivesia Solutions and the Client
Formula
· RSI = 100 * [ (Number of baselined requirements) – (Number of changes in requirements after the requirements are baselined) ] / (Number of baselined requirements)
Metric Representation
· Percentage
Calculated at
· Stage completion and Project completion
Calculated from
· Change Request
· Software Requirements Specification
Description
This metric gives the stability factor of the requirements over a period of time, after the requirements have been mutually agreed and baselined between Ivesia Solutions and the Client
Formula
· RSI = 100 * [ (Number of baselined requirements) – (Number of changes in requirements after the requirements are baselined) ] / (Number of baselined requirements)
Metric Representation
· Percentage
Calculated at
· Stage completion and Project completion
Calculated from
· Change Request
· Software Requirements Specification
Defects vs. Review effort( Review Yield ) - Metric
Defects vs. Review effort – Review Yield
Description
This metric will indicate the effort expended in each stage for reviews to the defects found
Formula
· Defects / Review effort
Metric Representation
· Defects / Review effort
Calculated at
· Completion of Reviews
Calculated from
· Peer Review Report
· Peer Review Defect List
Description
This metric will indicate the effort expended in each stage for reviews to the defects found
Formula
· Defects / Review effort
Metric Representation
· Defects / Review effort
Calculated at
· Completion of Reviews
Calculated from
· Peer Review Report
· Peer Review Defect List
Total number of defects found by Reviews - Metric
Total number of defects found by Reviews
Description
This metric will indicate the total number of defects identified by the Review process. The defects are further categorized as High, Medium or Low
Formula
Total number of defects identified in the Project
Metric Representation
· Defects per Stage
Calculated at
· Completion of Reviews
Calculated from
· Peer Review Report
· Peer Review Defect List
Description
This metric will indicate the total number of defects identified by the Review process. The defects are further categorized as High, Medium or Low
Formula
Total number of defects identified in the Project
Metric Representation
· Defects per Stage
Calculated at
· Completion of Reviews
Calculated from
· Peer Review Report
· Peer Review Defect List
Review Effectiveness - Metric
Review Effectiveness
Description
This metric will indicate the effectiveness of the Review process
Formula
Review Effectiveness = [(Number of defects found by Reviews) / ((Total number of defects found by reviews) + Testing)] * 100
Metric Representation
· Percentage
Calculated at
· Completion of Review or Completion of Testing stage
Calculated from
· Peer Review Report
· Peer Review Defect List
· Bugs Reported by Testing
Description
This metric will indicate the effectiveness of the Review process
Formula
Review Effectiveness = [(Number of defects found by Reviews) / ((Total number of defects found by reviews) + Testing)] * 100
Metric Representation
· Percentage
Calculated at
· Completion of Review or Completion of Testing stage
Calculated from
· Peer Review Report
· Peer Review Defect List
· Bugs Reported by Testing
Review Team Efficiency (Review Team Size Vs Defects Trend) - Metric
Review Team Efficiency (Review Team Size Vs Defects Trend)
Description
This metric will indicate the Review Team size and the defects trend. This will help to determine the efficiency of the Review Team
Formula
· Review Team Size to the Defects trend
Metric Representation
· Ratio
Calculated at
· Monthly
· Completion of Review
Calculated from
· Peer Review Report
· Peer Review Defect List
Description
This metric will indicate the Review Team size and the defects trend. This will help to determine the efficiency of the Review Team
Formula
· Review Team Size to the Defects trend
Metric Representation
· Ratio
Calculated at
· Monthly
· Completion of Review
Calculated from
· Peer Review Report
· Peer Review Defect List
Number of defects found per Review Meeting - Metric
Number of defects found per Review Meeting
Description
This metric will indicate the number of defects found during the Review Meeting across various stages of the Project
Formula
· Number of defects per Review Meeting
Metric Representation
· Defects / Review Meeting
Calculated at
· Monthly
· Completion of Review
Calculated from
· Peer Review Report
· Peer Review Defect List
Description
This metric will indicate the number of defects found during the Review Meeting across various stages of the Project
Formula
· Number of defects per Review Meeting
Metric Representation
· Defects / Review Meeting
Calculated at
· Monthly
· Completion of Review
Calculated from
· Peer Review Report
· Peer Review Defect List
Productivity on Review Preparation(Technical) - Metric
Productivity on Review Preparation – Technical
Description
This metric will indicate the effort spent on preparation for Review. Use this to calculate for languages used in the Project
Formula
For every language (such as C, C++, Java, XSL, etc…) used, calculate
· (KLOC or FP ) / hour (* Language)
*Language – C, C++, Java, XML, etc…
Metric Representation
· KLOC or FP per hour
Calculated at
· Monthly
· Build completion
Calculated from
· Peer Review Report
Description
This metric will indicate the effort spent on preparation for Review. Use this to calculate for languages used in the Project
Formula
For every language (such as C, C++, Java, XSL, etc…) used, calculate
· (KLOC or FP ) / hour (* Language)
*Language – C, C++, Java, XML, etc…
Metric Representation
· KLOC or FP per hour
Calculated at
· Monthly
· Build completion
Calculated from
· Peer Review Report
Size Variance - Metric
Size Variance
Description
This metric gives the variation of actual size Vs. the estimated size. This is calculated for each project stage wise
Formula
· Size Variance = [(Actual Size – Estimated Size) / Estimated Size] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
· Project Completion
Calculated from
· Estimation sheets for estimated values in Function Points or KLOC
· Actual size
Description
This metric gives the variation of actual size Vs. the estimated size. This is calculated for each project stage wise
Formula
· Size Variance = [(Actual Size – Estimated Size) / Estimated Size] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
· Project Completion
Calculated from
· Estimation sheets for estimated values in Function Points or KLOC
· Actual size
Cost Variance (CV) - Metric
Cost Variance (CV)
Description
This metric gives the variation of actual cost Vs the estimated cost. This is calculated for each project Stage wise
Formula
· CV = [(Actual Cost – Estimated Cost) / Estimated Cost] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
Calculated from
· Estimation sheets for estimated values in dollars or rupees, for each activity within a given stage
· Actual cost incurred
Description
This metric gives the variation of actual cost Vs the estimated cost. This is calculated for each project Stage wise
Formula
· CV = [(Actual Cost – Estimated Cost) / Estimated Cost] * 100
Metric Representation
· Percentage
Calculated at
· Stage completion
Calculated from
· Estimation sheets for estimated values in dollars or rupees, for each activity within a given stage
· Actual cost incurred
Subscribe to:
Posts (Atom)
RSS Feed (xml)
