OPNFV Iruya release note for Functest

Abstract

This document contains the release notes of the Functest project.

OPNFV Iruya Release

Functest deals with functional testing of the OPNFV solution. It includes test cases developed within the project, test cases developed in other OPNFV projects and it also integrates test cases from other upstream communities.

OpenStack

The internal test cases are:

  • connection_check
  • tenantnetwork1
  • tenantnetwork2
  • vmready1
  • vmready2
  • singlevm1
  • singlevm2
  • vping_ssh
  • vping_userdata
  • cinder_test
  • tempest_smoke
  • tempest_horizon
  • odl
  • tempest_neutron
  • tempest_cinder
  • tempest_keystone
  • tempest_heat
  • tempest_telemetry
  • rally_sanity
  • refstack_compute
  • refstack_object
  • refstack_platform
  • tempest_full
  • tempest_scenario
  • tempest_slow
  • patrole
  • tempest_barbican
  • networking-bgpvpn
  • networking-sfc
  • tempest_octavia
  • rally_full
  • rally_jobs
  • vmtp
  • shaker
  • cloudify
  • cloudify_ims
  • heat_ims
  • vyos_vrouter
  • juju_epc

Kubernetes

The internal test cases are:

  • k8s_smoke
  • k8s_conformance

Release Data

Project functest
Repository branch stable/iruya

Version change

Key changes

  • update testcases and containers to OpenStack Stein and to Kubernetes v1.15.4
  • switch to Python 3.6 as default Python version (Python 2.7 is still supported)
  • add tempest_slow, octavia, refstack_object and refstack_platform
  • add new Rally scenarios verifying Barbican and Swift
  • allow running Rally without any external network
  • fix the last resource leaks in the upstream projects (Tempest and Neutron Tempest plugin)
  • run all unit tests and all linters via CircleCI

Key benefits

  • the enduser can easily deploy its own Functest toolchains in few commands
  • everyone can pick stable Functest rolling releases (latest included)
  • Functest can verify VIM in production even on Raspberry PI
  • all testcases can run in parallel (tested with 4 executors in our gates)
  • no remaining resources detected in our gates after multiple runs

Code quality

  • pylint: 10.00/10
  • code coverage: 70%