Versions Compared

Old Version 79

changes.mady.by.user Dan Xu

Saved on

compared with

New Version 80

changes.mady.by.user Dan Xu

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

1.3 cvp.0.3.0 (2017/7/21)

1.3.1 Docker images used:

opnfv/dovetail:cvp.0.3.0 (commit ID 7ed1cf189676693d84c9d48bb964c178b16bae76)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.3.0 (commit ID 4e0b74b0141e3ae5d250006f3d75fcc880738cc9)

1.3.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.3.0
  1. Add docs about vping test cases (test scope and test specification)
  2. Add 2 vping test cases (vping.tc001->vping_userdata, vping.tc002->vping_ssh) into proposed_tests
  3. Bugfix: Build docker image failed because of lacking of packages
  4. Add resiliency.tc001 into proposed_tests
  1. None
  2. DOVETAIL-446
  3. DOVETAIL-475
  4. DOVETAIL-474
  1. https://gerrit.opnfv.org/gerrit/#/c/36253/
  2. https://gerrit.opnfv.org/gerrit/#/c/37853/
  3. https://gerrit.opnfv.org/gerrit/#/c/38573/
  4. https://gerrit.opnfv.org/gerrit/#/c/38713/
opnfv/yardstick:danube.3.1NoneNoneNone
opnfv/functest:cvp.0.2.0NoneNoneNone
opnfv/testapi:cvp.0.3.0
  1. Add Linux Foundation ID as account provider
  2. Upload multi results in one time
  3. Submit results to CVP to review
  4. Results are grouped by test id
  5. Add details for each test
NoneNone

 

1.4 cvp.0.4.0 (2017/8/4)

1.4.1 Docker images used:

opnfv/dovetail:cvp.0.4.0 (commit ID a8d7665ca783684bc10d7c3dbbc606e30f083bc7)

opnfv/yardstick:danube.3.1

opnfv/functest:cvp.0.2.0 (commit ID 3d03bbcfc45d00d4ce995d8aabff5808accb0687)

opnfv/testapi:cvp.0.4.0

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

1.4.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.4.0
  1. Bugfix: wrong command in function 'check_https_enabled'
  2. Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool
  3. Create a tar file for all logs
  4. Add tempest test cases into proposed_tests
  5. Fix testapi base_url for public_url
  6. Add user guide for results operations on web
  7. Add nginx to host static files
  1. DOVETAIL-482
  2. DOVETAIL-480
  3. DOVETAIL-479
  4. DOVETAIL-478
  5. None
  6. DOVETAIL-471
  7. DOVETAIL-485
  1. https://gerrit.opnfv.org/gerrit/#/c/39393/
  2. https://gerrit.opnfv.org/gerrit/#/c/39221/
  3. https://gerrit.opnfv.org/gerrit/#/c/38891/
  4. https://gerrit.opnfv.org/gerrit/#/c/38835/
  5. https://gerrit.opnfv.org/gerrit/#/c/38823/
  6. https://gerrit.opnfv.org/gerrit/#/c/38065/
  7. https://gerrit.opnfv.org/gerrit/#/c/39489/
opnfv/yardstick:danube.3.1Bugfix: cannot run task if without yardstick.conf in danubeYARDSTICK-776https://gerrit.opnfv.org/gerrit/#/c/38955/
opnfv/functest:cvp.0.2.0
  1. Remove functest repo and only python module have been installed
  2. Functest Docker image will not host any OS images
  3. Add a dedicated file to configure extra params in tempest.conf

  1. FUNCTEST-836

  2. None

  3. FUNCTEST-860

  1. https://gerrit.opnfv.org/gerrit/#/c/35813/
    https://gerrit.opnfv.org/gerrit/#/c/36163/
  2. https://gerrit.opnfv.org/gerrit/#/c/37373/
  3. https://gerrit.opnfv.org/gerrit/#/c/39019/
opnfv/testapi:cvp.0.4.0
  1. log browsing in directory style
  
opnfv/bottlenecks:cvp.0.4.0   

 

1.5 cvp.0.5.0 (2017/8/18)

1.5.1 Docker images used:

opnfv/dovetail:cvp.0.5.0 (commit ID 474795c11c556dcd325559853fe7ed436a69418c)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:nginx.cvp.0.5.0

1.5.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.5.0
  1. Merge addendum doc and workflow doc
  2. Update user guide docs
  3. Remake aarch64 patch for Dovetail container
  4. Remove some tempest test cases that are not too common
  5. Add additional Tempest API test cases into test case tempest.tc005
  6. persist db file in host for mongo container
  7. add nginx to host static files
  8. add a sample tempest_conf.yaml file into userconfig
  9. Add a patch to set ha SLA to be 30 seconds
  10. Modify logs
  11. Bugfix: the config files in useeconfig will cover user's config
  12. Bugfix: functest only keeps the last test case's log
  13. Bugfix: pre_condition cmds is just executed once
  14. Bugfix: No cirros-0.3.5-x86_64-disk.img
  15. Merge all test specification docs about test area tempest and defcore
  1. None
  2. DOVETAIL-493
  3. ARMBAND-286
  4. None
  5. DOVETAIL-495
  6. DOVETAIL-488
  7. DOVETAIL-485
  8. DOVETAIL-484
  9. DOVETAIL-496
  10. DOVETAIL-498
  11. DOVETAIL-492
  12. DOVETAIL-490
  13. DOVETAIL-489
  14. DOVETAIL-487
  15. DOVETAIL-431
    DOVETAIL-473

  1. https://gerrit.opnfv.org/gerrit/#/c/35161/
    https://gerrit.opnfv.org/gerrit/#/c/34643/
  2. https://gerrit.opnfv.org/gerrit/#/c/40369/
  3. https://gerrit.opnfv.org/gerrit/#/c/39073/
  4. https://gerrit.opnfv.org/gerrit/#/c/40963/
  5. https://gerrit.opnfv.org/gerrit/#/c/40745/
  6. https://gerrit.opnfv.org/gerrit/#/c/39851/
  7. https://gerrit.opnfv.org/gerrit/#/c/39489/
  8. https://gerrit.opnfv.org/gerrit/#/c/39463/
  9. https://gerrit.opnfv.org/gerrit/#/c/41251/
  10. https://gerrit.opnfv.org/gerrit/#/c/41285/
  11. https://gerrit.opnfv.org/gerrit/#/c/40733/
  12. https://gerrit.opnfv.org/gerrit/#/c/40051/
  13. https://gerrit.opnfv.org/gerrit/#/c/39925/
  14. https://gerrit.opnfv.org/gerrit/#/c/39719/
  15. https://gerrit.opnfv.org/gerrit/#/c/34649/
    https://gerrit.opnfv.org/gerrit/#/c/39389/
    https://gerrit.opnfv.org/gerrit/#/c/37989/
    https://gerrit.opnfv.org/gerrit/#/c/39459/
    https://gerrit.opnfv.org/gerrit/#/c/39585/
    https://gerrit.opnfv.org/gerrit/#/c/39223/
    https://gerrit.opnfv.org/gerrit/#/c/39229/
    https://gerrit.opnfv.org/gerrit/#/c/39227/
    https://gerrit.opnfv.org/gerrit/#/c/38379/
    https://gerrit.opnfv.org/gerrit/#/c/39225/

 

 

opnfv/yardstick:danube.3.2NoneNoneNone
opnfv/functest:cvp.0.5.0NoneNoneNone
opnfv/testapi:cvp.0.5.0   
opnfv/dovetail:nginx.cvp.0.5.0   

1.6 cvp.0.6.0 (2017/9/8)

1.6.1 Docker images used:

opnfv/dovetail:cvp.0.6.0 (commit ID 0aacdceeeac62333651ec5440fb32af965c7689e)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:web.cvp.0.6.0

opnfv/dovetail:api.cvp.0.6.0

1.6.2 Updates and problems found and fixed in this version

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.6.0
  1. Tag dovetail with cvp.0.7.0
  2. Disable get DB schema in Dockerfile
  3. Bugfix: sdnvpn test cases failed due to wrong module
  4. Support to run mandatory or optional test cases separately
  5. add api&web services for cvp
  6. Don't generate tar file when run without pushing results to DB
  7. Make Yardstick log level can be set by CLI
  8. Update the script for building local DB and testapi
  9. Bugfix: tar results dir cannot be parsed by web portal
  10. Replacing references to "DefCore"
  11. Updating the test specification document with iterative inprovements
  12. Dovetail tool replaces defcore with osinterop
  13. Clearer structuring current and future test scope of CVP addendum
  14. Adding a stub document for a CVP reviewer guide
  15. Clarify criteria for testcase inclusion as running in Functest/CI And additional clarifications
  16. add more information for the Identity testcases in the refstack
  17. Doc: update user guide due to add new test cases and features
  1. DOVETAIL-516
  2. None
  3. DOVETAIL-510
  4. DOVETAIL-505
  5. DOVETAIL-512
  6. DOVETAIL-511
  7. DOVETAIL-506
  8. DOVETAIL-507
  9. DOVETAIL-508
  10. DOVETAIL-499
  11. DOVETAIL-352
  12. DOVETAIL-499
  13. None
  14. DOVETAIL-408
  15. DOVETAIL-477
  16. DOVETAIL-431
  17. DOVETAIL-493
  1. https://gerrit.opnfv.org/gerrit/#/c/43575/
  2. https://gerrit.opnfv.org/gerrit/#/c/43565/
  3. https://gerrit.opnfv.org/gerrit/#/c/43393/
  4. https://gerrit.opnfv.org/gerrit/#/c/43109/
  5. https://gerrit.opnfv.org/gerrit/#/c/43411/
  6. https://gerrit.opnfv.org/gerrit/#/c/43407/
  7. https://gerrit.opnfv.org/gerrit/#/c/42981/
  8. https://gerrit.opnfv.org/gerrit/#/c/43231/
  9. https://gerrit.opnfv.org/gerrit/#/c/43131/
  10. https://gerrit.opnfv.org/gerrit/#/c/41601/
  11. https://gerrit.opnfv.org/gerrit/#/c/32499/
  12. https://gerrit.opnfv.org/gerrit/#/c/42205/
  13. https://gerrit.opnfv.org/gerrit/#/c/41241/
  14. https://gerrit.opnfv.org/gerrit/#/c/33851/
  15. https://gerrit.opnfv.org/gerrit/#/c/38763/
  16. https://gerrit.opnfv.org/gerrit/#/c/34649/
  17. https://gerrit.opnfv.org/gerrit/#/c/40369/
opnfv/yardstick:danube.3.2NoneNoneNone
opnfv/functest:cvp.0.5.0NoneNoneNone
opnfv/testapi:cvp.0.5.0
  1. [cvp-web]correct dockerfile
  2. [cvp-web]remove useless docker-compose yaml
  3. [cvp-web]remove workflow on homepage
  1. DOVETAIL-515
  2. DOVETAIL-514
  3. DOVETAIL-513
  1. https://gerrit.opnfv.org/gerrit/#/c/43555/
  2. https://gerrit.opnfv.org/gerrit/#/c/43529/
  3. https://gerrit.opnfv.org/gerrit/#/c/43527/
opnfv/dovetail:web.cvp.0.6.0   
opnfv/dovetail:api.cvp.0.6.0   

1.7 cvp.0.7.0 (2017/9/29)

1.7.1 Docker images used:

opnfv/dovetail:cvp.0.7.0 (commit ID 043ef2dad58c3aef0ea91cf3063dc9deb6f40bd9)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9)

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:web.cvp.0.7.0

opnfv/dovetail:api.cvp.0.7.0 

1.7.2 Updates and problems found and fixed in this version

 

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.7.0
  1. Tag dovetail with cvp.0.8.0
  2. Fixing references and layout in the docs.
  3. Updating test case requirements document
  4. Term refstack is mentioned in dovetail Testing User Guide
  5. Add dovetail tool CLI document
  6. Cvp application form
  7. Use functest clean module to do the sdnvpn resources cleanup
  8. SDNVPN test cases resources left may effect the next test cases
  9. Add testsuite cvp.0.8.0 for Beta tests
  10. Bugfix: the sdnvpn DB initialization information lacks two test cases
  11. Bugfix: build docker image failed
  1. DOVETAIL-536
  2. DOVETAIL-521
  3. None
  4. DOVETAIL-519
  5. DOVETAIL-509
  6. None
  7. DOVETAIL-524
  8. DOVETAIL-524
  9. DOVETAIL-528
  10. DOVETAIL-535
  11. DOVETAIL-534
  1. https://gerrit.opnfv.org/gerrit/#/c/46155/
  2. https://gerrit.opnfv.org/gerrit/#/c/44497/
  3. https://gerrit.opnfv.org/gerrit/#/c/42291/
  4. https://gerrit.opnfv.org/gerrit/#/c/44859/
  5. https://gerrit.opnfv.org/gerrit/#/c/44919/
  6. https://gerrit.opnfv.org/gerrit/#/c/42455/
  7. https://gerrit.opnfv.org/gerrit/#/c/45319/
  8. https://gerrit.opnfv.org/gerrit/#/c/45283/
  9. https://gerrit.opnfv.org/gerrit/#/c/45483/
  10. https://gerrit.opnfv.org/gerrit/#/c/46103/
  11. https://gerrit.opnfv.org/gerrit/#/c/46101/
opnfv/yardstick:danube.3.2NoneNoneNone
opnfv/functest:cvp.0.5.0NoneNoneNone
opnfv/testapi:cvp.0.5.0
None
None
None
opnfv/dovetail:web.cvp.0.7.0
  1. [web-cvp]Direct drill-down for failed tests
  2. [web-cvp]Additional columns in ‘My Results’
  3. [web-cvp]share result by email
  4. [web-cvp]failed to build docker image due to setuptools version
  5. [web-cvp]add a api to fecth logs of backend api
  6. [web-cvp]fix api&web service in dockerfiles
  7. [web-cvp]missing files in web sites
  8. [web-cvp]osinteros is counted as optional test case
  9. [web-cvp]failed to expand test results
  1. DOVETAIL-531
  2. DOVETAIL-532
  3. DOVETAIL-529
  4. DOVETAIL-526
  5. DOVETAIL-525
  6. DOVETAIL-523
  7. DOVETAIL-522
  8. DOVETAIL-518
  9. DOVETAIL-517
  1. https://gerrit.opnfv.org/gerrit/#/c/45757/
  2. https://gerrit.opnfv.org/gerrit/#/c/45943/
  3. https://gerrit.opnfv.org/gerrit/#/c/45709/
  4. https://gerrit.opnfv.org/gerrit/#/c/44913/
  5. https://gerrit.opnfv.org/gerrit/#/c/44907/
  6. https://gerrit.opnfv.org/gerrit/#/c/44555/
  7. https://gerrit.opnfv.org/gerrit/#/c/44545/
  8. https://gerrit.opnfv.org/gerrit/#/c/43713/
  9. https://gerrit.opnfv.org/gerrit/#/c/43709/
opnfv/dovetail:api.cvp.0.7.0

 

1.8 cvp.0.8.0 (2017/10/25)

1.8.1 Docker images used:

opnfv/dovetail:cvp.0.8.0 (commit ID 73f332fc513f184513be483db6a108bd3c7b7d9b)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9) 

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:web.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)

opnfv/dovetail:api.cvp.0.8.0 (commit ID 3617b6958c4c44678d64c05e669b50e427fc45f8)

1.8.2 Updates and problems found and fixed in this version

 

ImageUpdates and problems found and fixedJIRAGerrit
opnfv/dovetail:cvp.0.8.0
  1. Remove obsolete developer documents
  2. Add test case name into tempest testspecification docs
  3. Update the user guide environment diagrams
  4. Modify reference to online mode
  5. Get hardware info of SUT
  6. Get SUT's endpoint info
  7. Minor docs change to test docs integration
  8. Bugfix: Failed to build local DB on Centos
  9. Tag dovetail cvp.0.9.0
  1. DOVETAIL-539
  2. DOVETAIL-530
  3. DOVETAIL-538
  4. DOVETAIL-533
  5. DOVETAIL-540
  6. DOVETAIL-546
  7. None
  8. DOVETAIL-548
  9. DOVETAIL-550
  1. https://gerrit.opnfv.org/gerrit/#/c/46215/
  2. https://gerrit.opnfv.org/gerrit/#/c/46197/
  3. https://gerrit.opnfv.org/gerrit/#/c/46185/
  4. https://gerrit.opnfv.org/gerrit/#/c/46051/
  5. https://gerrit.opnfv.org/gerrit/#/c/46409/
  6. https://gerrit.opnfv.org/gerrit/#/c/46501/
  7. https://gerrit.opnfv.org/gerrit/#/c/46701/
  8. https://gerrit.opnfv.org/gerrit/#/c/46547/
  9. https://gerrit.opnfv.org/gerrit/#/c/46829/
opnfv/yardstick:danube.3.2NoneNoneNone
opnfv/functest:cvp.0.5.0NoneNoneNone
opnfv/testapi:cvp.0.5.0NoneNoneNone
opnfv/dovetail:web.cvp.0.8.0
  1. [web-cvp] Trigger an email when admin submit an application form
  2. [cvp-web] Show some SUT hardware info in 'My Results'
  3. [cvp-web] Show SUT endpoint in web page
  4. Remove approve / no approve options for reviewers
  5. Distinguish results shared or submitted from a tester
  6. Bugfix: remove redundancy line
  1. DOVETAIL-542
  2. DOVETAIL-541
  3. DOVETAIL-547
  4. DOVETAIL-544
  5. DOVETAIL-545
  6. None
  1. https://gerrit.opnfv.org/gerrit/#/c/46357/
  2. https://gerrit.opnfv.org/gerrit/#/c/46405/
  3. https://gerrit.opnfv.org/gerrit/#/c/46405/
  4. https://gerrit.opnfv.org/gerrit/#/c/46511/
  5. https://gerrit.opnfv.org/gerrit/#/c/46511/
  6. https://gerrit.opnfv.org/gerrit/#/c/46551/
opnfv/dovetail:api.cvp.0.8.0

 

1.9 cvp.0.9.0 (2017/11/8)

1.9.1 Docker images used:

opnfv/dovetail:cvp.0.9.0 (commit ID 84d413ec0d980d4d0b80bf77bc35fffb063cf686)

opnfv/yardstick:danube.3.2 (commit ID e9338f29a70a38a5838498adf79ec91f92d085d1)

opnfv/functest:cvp.0.5.0  (commit ID 13067de652d6ccdcfc85f0f5e65841b644d9a6e9) 

opnfv/bottlenecks:cvp.0.4.0 (commit ID 3592f9016821a603930ebda7f4112abf732e6750)

opnfv/testapi:cvp.0.5.0 

opnfv/dovetail:web.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)

opnfv/dovetail:api.cvp.0.8.0 (commit ID c70193d65811a8a2a3b50fdad5463bca3643e219)


2. Running by CI

in order to make the dovetail tool  more stable, the dovetail has been integreated in the CI for daily running.

...