Test WG(测试工作组)Release V1.0版本质量目标和测试准入/结束判断依据 #test


liuhui@pmlabs.com.cn
 

Hi all,
ReleaseV1.0的版本质量指标和测试准入/结束判断依据已在相应Test Plan中,参见https://gitee.com/edgegallery/community/blob/master/Test%20WG/Test%20Release/EdgeGallery%20R1.0%20Test%20Plan.md
指标 目标值 备注
需求完成率 90% 实际完成的需求个数/计划完成的需求个数
遗留DI 10 1、本迭代发现的不影响本迭代只影响下个迭代的问题,也要计入本迭代的遗留DI中;2、本迭代发布时说明遗留问题的影响及对策,版本经理同意后可特例发布;" ∑(提示问题个数0.1+一般问题个数1+严重问题个数3+致命问题个数10)
严重及以上问题数 ≤1 严重≤1,致命0;∑(严重问题个数+致命问题个数)
开源软件禁选 0 开源软件禁选个数为0
代码静态检查告警 0 代码静态检查告警个数(findbugs、stylecheck、dependency check、PWD)
测试用例执行率 90% 计划执行的测试用例数/实际执行的测试用例数
单元测试代码覆盖率 >=50%  
- Starting Criteria for Iterative test excution
    - 完成本次迭代的详细设计/架构更新Complete detail design/architecture updating for current iteration        
    - PTL确认所有task关闭(PTL confirm )all tasks in current iteration are closed
    - PTL确认gitee门户外部bug类问题关闭(PTL confirm) bugs(vital/blocked in current iteration ) out of gitee are all closed
    - PTL确认所有新开发代码都有自动化测试用例(PTL)confirm all recently developed code has autotest cases
    - PTL确认项目完成开发者自验证(PTL confirm)complete self-verification of project
    - PTL确认代码许可证合规扫结果(PTL confirm)licenses for 3rd-party components are all scanned and their compliance is ensured
    - 近1天镜像自动构建成功率100% daily build for last 1 days is all succeeded【First Iteration】
    - 近1天镜像CICD成功率100% daily build for last 1 days is all succeeded【Second Iteration】  
    - 近1天镜像CICD成功率100%(含自动测试) daily build for last 1 days is all succeeded【Third Iteration】

- Ending Criteria for test execution in Final Iteration

    - PTL确认bug单关闭(PTL confirm) vital/blocked bugs are all closed
    - 所有测试活动完整,测试通过 all test activities are completed and test results are passed
    - 无阻塞性及严重性问题遗留 No blocked or vital problems/bugs are left。
    - 确认所有依赖软件都在本地库中 confirm all dependent softwares are all stored locally
    - PTL确认满足单元测试覆盖率>=50%要求(PTL confirm) satisfy code coverage rate for unit test
    - PTL确认三方件归一化扫描结果(PTL confirm) 3rd-party components  are all scanned and have consistent versions

如有建议或意见,可随时在gitee或邮件中反馈。
Best Regards

刘辉 Dr. LIU Hui
未来网络-工业互联网 智能边缘计算
网络通信与安全紫金山实验室
EdgeGallery开源社区

Join main@edgegallery.groups.io to automatically receive all group messages.