CHANGES
=======

0.50
----

* Skip testcases by any env var
* Improve dependency management

0.42
----

* Remove Feature logger
* Check shell scripts via bashate

0.41
----

* Create a static method to configure logger

0.40
----

* Update to stable/queens
* Updated from global requirements
* Exclude doc/reveal.js from perm
* Updated from global requirements
* Check README.rst by doc8
* Check API doc via doc8
* Ignore output dirs and files
* Fix software names (uppercase letters)
* Update Xtesting presentation
* Publish xtesting presentation

0.31
----

* Fix regex when INSTALLER_TYPE is unset
* Update api/index.rst

0.24
----

* Add classifiers (pypi)
* Add README.rst (pypi)
* Add a travis-ci config file
* Add build.sh for functest-xtesting
* Add tags support using include options

0.23
----

* Add py3 support in samples

0.22
----

* Return all status when running tiers

0.21
----

* Stop filtering the project when calculating results
* Remove Functest-related env vars
* Leverage on tags for all versions

0.2
---

* Set universal wheels
* Ensure py27 and py35 supports
* Add mandatory package infos (PyPI)
* Switch from /home/opnfv/functest to /var/lib/xtesting
* Remove obsolete Alpine packages
* Publish Dockerfile and samples
* Fully cover tier_builder.py
* Remove all OpenStack operations in vnf.py
* Rename all Functest refs to Xtesting
* Clean all OpenStack related modules
* Raise exceptions when SDN_CONTROLLER_IP is None
* Stop raising keystoneauth1 exceptions in odl unit tests
* Remove openstack utils
* Fix KeyError of OS_AUTH_URL
* Switch to snaps in orchestra testcases
* Fix default identity version in conf_utils
* Set Energy default values to None
* Switch to $REPO in travis-ci jobs
* Print env vars and env_file
* Automatically download defcore.txt
* Update Functest to meet last snaps updates
* Use functest repo variable
* Switch from CONST to CONF
* Use constants for Functest config file
* Print stdout and stderr when calling commands over SSH
* Unify security group operations
* Leverage of snaps creds to get the right region name
* Create a second user in cloudify_vrouter
* Remove deprecated monkey patches
* Remove last CONST.__getattribute__()
* Manage region in cloudify_ims.py
* Fix credentials in cloudify_vrouter
* Generate tempest verification report (HTML)
* Disable orchestra_clearwaterims in functest-vnf
* Precise Tempest tests list
* Enhance variable manipulation in tempest
* Remove one debug print
* Mock additional methods related to OpenStackFlavor
* Add suffixes in vnf keypair names
* Get properly env vars or their default values
* Add suffixes to OpenStack resource names
* Fix typos in cloudify_ims
* Stop reading SDN_CONTROLLER env var
* Removed os_utils and fully switched to snaps
* Stop reading NODE_NAME in tempest and refstack
* Enable doctor-notification
* Only filter boot_server_from_volume_and_delete via scenario
* Remove INSTALLER_IP from Functest
* Enhance variable manipulation in rally
* Test vnf in all os-nosdn-nofeature scenarios
* Temporarily disable doctor-notification
* Remove obsolote env var IS_CI_RUN
* Improve the way of getting env values
* Improve the way of setting values in CONST
* Simplify functest/cli/commands/cli_env.py
* Read env vars instead of using CONST in API
* Export env vars instead of CONST in refstack
* Fix the config of fixed_network_name in tempest
* Enable invalid-name warnings in tempest modules
* Export env vars via os.environ in test_openstack_utils.py
* Export env vars via os.environ in test_cli_env.py
* Decrease log level in Energy messages
* Run all daily testcases if CI_LOOP is unset
* Read the env file only if exists
* Ensure logging is disabled when unit testing feature
* Unlink robotframework from constants
* Fix pylint errors/warnings in tempest modules
* Remove one obsolete var
* Unlink feature from constants
* Unlink vnf from constants
* Unlink run_tests from constants
* Unlink Energy from functest utils and constants
* Move get_dict_by_test() into run_tests.py
* Conform with OpenStackUser.get_os_creds() in juju_epc
* Get neutron endpoint via snaps in odl
* Move source_credentials() into run_tests.py
* Refactor tempest resource manager
* Add variablefile as possible robot.run() args
* Revert "Temporary disable one unstable snaps test"
* Temporary disable one unstable snaps test
* Remove dns server from juju_epc config
* Fix rally cinder volume attach scenarios
* Disable orchestra_* testcases
* Stop printing data sent to DB
* Fix docstrings
* Switch to the readthedocs theme for api docs
* Remove yamllint from upper-constraints.txt
* Add build_sphinx section in setup.cfg
* Blacklist Quotas.nova_update_and_delete test
* Increase Rally full criteria
* Add modules docstrings in snaps
* Update results printed in configguide.rst
* Fix links in configguide.rst
* Fix JujuEpc prepare() and deploy_orchestrator()
* Do not use shell to execute commands in tempest
* Stop setting ext net in config
* Rename a common credential file for OS and K8S
* Install vEPC dependencies in Dockerfile
* Fix a typo in docstring
* Add tempest and rally in functest-features
* Use snaps_utils to get credentials in tempest
* Removal of deprecated SNAPS-OO classes in juju_epc
* Fix pylint errors/warnings in rally
* Remove duplicated code related to snaps creds
* Fix pylint errors about refstack
* Enable epc unit tests
* Fix the connect issue when checking deployment
* Create subnet and net within the same project
* Fix warnings in all snaps-related modules
* Fix pylint errors in several utils modules
* Avoid duplicating get_parameter_from_yaml
* Fix last Pylint error in Functest
* Refactor rally report generation
* proper instance status handling
* Fix pylint warnings/errors in cli
* Delete functest_vacation.py
* Disable all missing-docstring warnings in unit tests
* Partially rewrite test_run_tests.py
* Fully test and cover functest/ci/tier_*
* Move push_results_to_db to TestCase
* Configure password for the user in vnf
* Fix Rally output retrieval
* Update set of region identity attribut
* Build functest-parser for arm64 via travis-ci
* Switch to absolute paths in Dockerfiles
* Delete the updated Alpine image
* Build vnf and restapi containers for ARM
* Fix tempest error on Apex
* Introduce Euphrates main changes
* Remove the judgement of OS_ENDPOINT_TYPE
* Modify cmd for parser
* Remove the obsolete configs in config yaml
* Configure physical_network when creating network
* Disable keystone v2 if keystone v3 is available
* Update Alpine to 3.7
* Execute feature command by subprocess directly
* Config physical network when creating tempest net
* Clean base images only if 1 container was built
* Clean Docker images after builds
* Dynamic region name of juju cloud
* Add Docker build opts
* Add euphrates as a docker tag to the release notes
* Update cirros image to 0.4.0
* Enable orchestra testcases for Daisy only
* Suggest to pull manifests instead of arch tags
* Remove logger_test_results
* Fix typos in test_details.rst and test_overview.rst
* Get auth token when checking deployment
* Remove openstack_[clean,snapshot]
* Delete TestCase.create_snapshot()
* Blacklist rally ceilometer scenarios
* Remove OSGCTestCase
* Switch to public keystone endpoint
* Enforce a versioned public identity endpoint
* Filter out orchestra for ssl enabled deployments
* Inject all envs in openrc into CONST
* [vyos_vrouter] Support https endpoints
* Improve the pylint score of functest-core
* Change the name of flavor and disabled ssh-hostname verification
* Fix yamllint errors in functest/api
* Add missing character to aarch functest conf file
* All patching config files in memory
* Ensure that all energy modules are fully covered
* Update release notes for Euphrates 5.1
* Add python3 support in cli
* Add python3 support in energy
* Mock time.sleep() to decrease test duration
* Add python3 for Functest utils
* vEPC tests with juju as an VNF manager
* Set the ram of flavor 1024
* Add Python3 support in functest/ci
* Fix yaml format errors in vnf
* Pull functest-core when only building childs
* Assign heat_stack_owner role to the new user
* Remove the config of promise
* Fix the yamllint errors in functest/ci
* Fix pylint errors of vping
* Create a tox env to check yaml files
* Adjust timeouts in Vnfs
* Reorder Vnf testcases
* Stop updating test_db_url in config file by env var
* Filter installers for cloudify_vrouter
* Skip modifying creds if Variables.robot is missing
* Update documentation of Functest
* Force Framework to be fully covered
* Remove one obsolete test in test_odl.py
* Cover vnf.prepare()
* Fix the doc of snaps test
* Fully cover vnf
* Create RobotFramework class
* Remove os_utils call from cloudify ims and vrouter
* Enable Doctor testcase for F-release
* Enable baro_tests testcase for F-release
* Fix relative imports in cloudify_ims_perf
* Remove iniparse and urllib3 dependencies
* Remove _set_others() from config
* Fix how tier_handler is imported
* Remove openstack utils calls in rally and tempest
* Remove prepare_env
* Removal of deprecated SNAPS-OO classes
* Fix "Broken pipe" IOErrors of rally run
* Fix the way of getting endpoint port
* Fix rally db issue
* Enable sdnvpn testcase for F-release
* Support to specify the valid external network name
* Check external network
* Update documentation for Functest
* Enable sfc testcase for F-release
* Remove Domino and Promise testcases
* Updated from global requirements
* Remove the tox venv patcharm64
* Update unit test related to vyos_vrouter
* Update the version of refstack set to 2017.09
* Fix the regular expression for refstack
* Remove opnfv module from functest-core
* Do not use cache when building the image
* Add shebang in snaps_suite_builder.py
* Remove $BRANCH in healthcheck/Dockerfile
* Update INFO file with new PTL information
* Move rally and tempest in functest-restapi
* Remove rally and tempest from core/Dockerfile
* Move rally and tempest out of functest-core
* Add BRANCH as Docker build arg
* Select the subset of snaps test cases
* Remove the former Dockerfile
* Stop installing docker/config_install_env.sh
* Stop installing enable_remote_api.sh
* Patch Functest docker images for ARM
* Fix the format of getting upper-constraints
* Move fds to features tier
* Protect vs exceptions when ext_nets is empty
* Define thirdparty-requirements.txt for functest-parser
* Allow building containers from a gerrit change
* Update Functest to OpenStack stable/pike
* Fix rally cinder scenarios
* Add new cinder scenarios for rally sanity/full
* Remove the constraint of INSTALLER_TYPE
* Add new neutron scenarios for rally sanity/full
* Adopt new config schema for rally 0.10
* Update INFO file
* Add new nova scenarios for rally sanity/full
* Add new glance scenarios for rally 0.10
* Remove some obsolete scenarios for rally 0.10
* Update Rally to 0.10
* Bump os-faults version to 0.1.15
* Update INFO file
* Wrap Functest Ascii Diagram in literal text block
* Save Euphrates results in repo
* Get the right git commit ids for ubuntu image
* Take into account a feedback from the meeting
* Release notes for Euphrates 5.0
* Switch from BashFeature to Feature of bgpvpn testcase
* Fix another typos in dockerslicing.md
* Fix 1 typo in dockerslicing.md
* Harmonization titles of the testing project
* Complete dockerslicing.md
* Update blacklist about migration tests for rally
* Update Docker slicing presentation
* Update requests to 2.13.0 in virtualenvs
* Enhance the compatibility judgement of INSTALLER
* Update project field of fds testcase to fastdatastacks
* Force requests===2.13.0
* Fix former default values in build.sh
* Get the right git commit ids
* Conform with Docker ARCH names
* Allow building aarch64 images
* Publish Docker Slicing Presentation
* Update userguide and configguide
* Fix fail of vRouter on Orange POD
* Include tempest_custom in the documentation
* Fix the format issue of documentation
* Modify the egg name for parser
* Complete framework documentation part for VNF
* Add UEFI image extra properties for CentOS image for aarch64
* Update Config Guide
* Live migration support determination in rally
* Disable vyos_vrouter
* Report duration and result when vping fails
* Create a router in both vping scenarii
* Add icmp rules for clearwaterims case
* Bug fix: vping_userdata test status was not properly reported
* Add ${DOCKER_TAG} in Docker hooks
* Enable promise on all fuel and joid scenarii
* Remove tempest_custom from testcases configs
* Fix userdata issue for vping and orchestra
* remove icmp rules from secgroups
* Force python2 when creating venv for refstack
* Fix connection error due to invalid lib version usage
* Switch to OS_PROJECT_NAME
* Update Functest documentation for Euphrates
* Add log details on SDK first connection
* Fix timeout for socket connection
* Disable Promise testsuite on Fuel installer
* Fix creds still used by vrouter
* Support https when testing ODL
* Adding orchestra test cases to orchestra project
* Remove void return value mocks in rally unit tests
* Remove false hooks for functest-parser
* Add python3-dev and python3-pip in former Dockerfile
* Remove white space when listing testcases
* Dedicated flavors for rally tests
* Remove restriction to fuel on vyosvrouter case in Alpine
* Add swagger support for Rest API
* Select ansible 2.3.2.0
* Return Functest status to Jenkins
* Fix image name in rally scenarios
* increase timeout of NFVO installation
* Enable parser testcase
* Enable Doctor testcase
* Enable Domino testcase
* Remove securityscanning testcase
* Fix one whitespace character
* Remove useless enabled: true in testcases.yaml
* Bug fix: wrong dependency filter for lxd scenarios
* Refactor resource creation and cleanup in rally
* Enable tempest run concurrently
* New testcase creation named "cloudify_ims_perf"
* Override tempest upper-constraints in functest-parser
* Select $OPENSTACK_TAG instead of stable/ocata
* Optimize Alpine Dockerfiles
* Add packages in docker alpine containers
* Allow reading log file with byte offset
* Disable urllib3 warnings
* Add Functest restapi container
* Remove thirdparty-requirements.txt in smoke
* Add Docker automated build hooks for Parser
* Fix some errors about getting tiers resources
* set marketplace port to 8080 for NFVO
* Fix bug in cloudify_ims: no return code
* Remove volume type handling
* Re-enable orchestra tests (VNF)
* Allow live migration related tests to run
* Remove Parser from the former Container
* Use git commit id for refstack-client
* Update ODL testcase to Keystone v3
* Exclude api_check on lxd scenarios
* Fix pylint errors in test_refstack_client
* Use git commit id for ODL
* [Fuel/MCP] Set opendaylight web/restconf ports
* Publish a container for Parser
* Use custom images and flavors for aarch64
* Unify the key as testcase in result
* Remove redundant tempest cleanup utility
* Fix creds used by vrouter
* Unlink Functest and FDS tags
* Fix all refstack-client requirements on-the-fly
* Set os-faults 0.1.10
* Integrate doctor-test package
* Create VNF user with admin role
* unify all the return status as number
* Stop using master for pip
* Stop downloading openbaton image
* Integrate new Domino package
* Create results/tempest dir for refstack config
* Fix the cloudify_ims update quotas error
* Delete some unittest which block the verify job
* More support of snaps for VNF
* Remove get_repo_tag
* Blacklist CeilometerTraits tests
* Fix get_port_by_name in ims testcases
* Stop cloning doctor and domino
* Allow building Alpine containers from any gerrit changes
* Unlink Functest and Domino tags
* Remove openstack-requirements from requirements.txt
* Enable tempest multinode tests
* Remove all useless dependencies
* Stop removing /src/openstack-requirements/.git
* Add all missing dependencies
* Fix all rally requirements on-the-fly
* Add UEFI support in functest
* Remove tacker library from functest
* Activate SFC testcases in CI (alpine)
* Activate SFC testcases in CI
* Blacklist CeilometerEvents tests
* Allow building functest-vnf via build.sh
* Remove installer constraint on vyos_vrouter test case
* Make the vnf images public
* Revert cirros downloading urls to official ones
* Put vnf_test pass if more than 80% of vnf test result are OK
* Fix securityscanning/config.ini path
* Refactor the vyos_vrouter to adopt VNF abstraction
* Remove get_installer_type
* Temporarily download cirros from artifacts
* Avoid exiting when snapshot initialization failed
* Clean repo: mano directory not used
* Obtain scenario by CONST instead of get function
* Launch Functest RestApi once the container is run
* Add log info of refstack tests into functest.log
* Get rid of tacker_client_install.sh
* Remove Onos in Functest
* download_images.sh: add --keep option to avoid redownloading images
* Updated sfc section in testcases
* Fix args parsing in run_tests
* Fix the config of vping net
* Create API to update hosts info
* Create API to get log for each task
* Patch Read aarch64 architecture
* bug fix download_images.sh
* Fix the tempest error when creating snapshot
* Prevent KeyError during main args parsing
* Add Rally scenarios for telemetry
* Ensure that aarch64 patch can be applied
* Fix aarch64 patch
* Download images from marketplace.openbaton.org:8082
* Refactor resource creation and cleanup in Tempest
* Read aarch64 architecture
* AArch64: SNAPS: CentOS, Ubuntu image config
* Fixes image download script
* Complete caching images for vnf testcases
* Use dnsmasq to cache DNS queries
* Functest Doc: first update for Euphrates - move part of the dev group to the testing document - move reporting into user guide - update logs - introduce alpine - introduce functest API - split documents per chapter
* Config test_accounts_file for refstack_defcore
* Specify physical_network when creating network
* Add the skipped testcases into details
* Added means to override the RC file credentials
* Euphrates cleaning: remove any reference to aaa vnf
* Allow caching images for vnf testcases
* Give a list of links to wget
* Remove opera testcase as Opera is inactive
* Create API to run a test case
* Complete the container opnfv-vnf
* Fix ci_loop conditions for vnf
* Allow defining CI_LOOP via env
* Updating the constrains for the Barometer test-suite
* Create API to update openrc
* Remove the tenant and user created for tempest
* Integrate cloudify_ims in functest-features
* Fix summary in run_tests.py
* Put domain name in CONST
* Remove multisite support
* Switch to blocking: false for ODL in functest-smoke
* Disable temporarily Doctor from Functest
* Specify valid external network as an env
* Obtain pod_name by CONST instead of get function
* API proposal for functest
* Switch to blocking: false for ODL testcase
* Clean run_tests.py and the related ut
* Update ODL tag to release/carbon
* Use separate timeouts for connection and reading
* Revert "Enable parser project"
* Fix domain in tenant creation
* Obtain build_tag by CONST instead of get function
* Remove timestamp in the details for tempest
* Fully integrate promise in functest-features
* Remove copper refs
* Remove netready refs
* Update promise upper constraint
* add orchestra_clearwaterims testcase
* Keep the promise working dir in /src
* Fix the logic of adding/updating tempest.conf
* Integrate the netready package
* Integrate the promise package
* Add/Update tempest.conf via a specific file
* Record the test cases passed in tempest
* Improved error handling when Energy recorder API is unavailable
* Configure AARCH64 image settings for UEFI
* Add copper and domino in functest-features
* Switch to Docker post_checkout hooks
* Fix import and docstrings in onos/teston
* Remove rnc unit test dir as empty
* Add functest-components based on Alpine
* Add functest-features based on Alpine
* Clean smoke requirements
* Add all ODL testcases in functest-smoke
* Fixed test description for snaps_smoke
* Restrict ping only once in ping.sh
* update/improve orchestra_ims
* Omit space line in openrc file
* Fix dockerfile patch for aarch64
* Enable parser project
* Modified Dockerfile.aarch to a patch
* Add id to test_list for tempest_custom
* Add AARCH64 images back to Functest
* Save space in Alpine containers
* Add script to build all containers
* Conform the RefStack testcase with the Rally context
* Wait for refstack-client to finish
* Change calls to SNAPS library exposing OpenStack instance objects
* Release notes for Danube.3.0
* Remove add_images.sh
* Add reporting results for Danube 3.0
* Fix some issues in cloudify_ims
* Correct odl port for compass installer
* Release notes for Danube 2.0
* Switch to check_deployment instead of check_os.sh
* Add odl configurations for odl testcase in daisy environment
* Use decorators for mock patching
* Add openssh-client in core
* Add decorators in testcases for energy recording
* New python script to check openstack deployment
* Allow regex for blacklist scenarios/installers
* Define CMD in smoke and healthcheck containers
* Download Functest's upper-constraints.txt
* Add upper-constraints.txt for Functest
* Add lesser containers based on Alpine
* Stop redefining $HOME
* Get rid of install_rally.sh
* Inherit packages when creating /src/tempest/.venv
* Stop using tempest version in Dockerfile
* Fix get_endpoint
* Remove setup_env for refstack in Dockerfile
* Move rally and tempest to requirements.txt
* Fix logger name in vping_base.py
* Add a default value to protect add_images.sh
* Set repo_tempest to /src/tempest
* Enable cloudify_ims
* Enable refstack work on https without SSL checks
* Convert files to Unix format
* Clone tempest before installing the package
* bugfix: vping support not_hugepage_configured pod
* Fix environment variables in Dockerfile
* Cleanup Tempest blacklist for Euphrates
* Sync thirdparty-requirements.txt
* Fix upper-constraints.txt url
* Update the link to firewall_block_image.img
* [cloudify_ims] Support Cloudify 4.0
* Remove the former link /home/opnfv/repos/functest
* Update cli commands to call console scripts
* Apply restrictive file permissions
* Stop modifying unix perm in cloudify_ims
* Fix unix permissions in docs/com
* Remove useless files in docs/com
* Fix typos in docs
* Energy monitoring SDK update
* Define download_images.sh and check_os.sh as scripts
* Define console_scripts
* Fix unix permissions
* Update securityscanning section in testcases.yaml
* Define ODL console_script
* Remove networking-bgpvpn from Functest requirements
* Remove BGPVPN utils in Functest
* Get install_rally.sh from git.openstack.org
* Switch to official tosca-parser and heat-translator
* Leverage on parser python packages in Dockerfile
* Update paths in functest/ci/testcases.yaml
* Fix refstack_defcore
* Added unit tests for vping
* SNAPS tests now support offline testing
* Remove Rally requests scenario
* Updated fds testcase criteria
* Add sfc in thirdparty-requirements.txt
* Increase timeout of Open Baton installation
* Remove Tempest repo and use the one created by Refstack
* enable doctor-notification test case
* Fix floating ips issue in openstack_clean
* Fixed problem to vping userdata introducted by SNAPS-OO patch
* Add securityscanning in thirdparty-requirements.txt
* Remove obsolete repos in functest/ci/config_functest.yaml
* Change floating ips management from nova to neutron
* Don't display functest report for single test cases
* Take OpenStack's constraints into account
* Make rally support https insecure deployment
* Use glance to list images
* Enable vping offline
* Remove calls to deployment handler in prepare env
* Revert rally version to 0.8.1
* Clone tempest repository in the Docker image
* Fix command in prepare env to execute check_os.sh
* Define logger as Feature instance attribute
* Install opera via python package
* Install OPNFV sdnvpn via python package
* Stop personalizing the common Dockerfile
* Enable https insecure for functest
* Use directly OpenStack project packages
* Change barometer module to load
* Added unit tests for api_check, health_check, and smoke tests
* Remove all references to /home/opnfv/repos/functest
* Stop getting git data from functest dir
* Clean requirements.txt
* Remove module references __file__
* Update Suite details pushed to DB
* Update (test-)requirements.txt
* Promote Linda Wang as a committer
* Bugfix: fix the return value
* Leverage on pbr (Python Build Reasonableness)
* Configure the param auth_version in tempest.conf
* Remove call to fetch_os_creds.sh
* Update setuptools version to 30.0.0
* Refactor core VNF class
* Remove a former action listed in framework.md
* Add the copyright header to decorators.py
* Use PrettyTable to show functest env
* Use constants in odl
* Make tempest user_password more complicated
* Update setuptools version to 35.0.2
* Use CONST to retrieve db_url rather than getter function
* Added unit tests for the connection_check test case
* Return pylint status code for modules rated 10/10
* Enable tempest offline by use_custom_images=True
* Fix a typo in framework.md
* Fix a typo in docstring
* Define create_snapshot() and clean() in TestCase
* Chmod 755 functest/ci/download_images.sh
* Fix one email address in INFO
* Rename framework.html to index.html
* Move api out of the docs directory
* Rename logger to __logger in unit.py
* Protect against self.suite = None
* Switch shebangs to /usr/bin/env python
* Export the Pylint results via pylint.out
* vping&snaps_xxx support not_hugepage_supported pod
* Fix some pylint errors in onos package
* Stop printing in console when testing functest_utils.py
* Add docstrings in unit
* Rename the class TestSuiteRunner to Suite
* Rename test_pytest_suite_runner.py to test_unit.py
* Rename pytest_suite_runner.py to unit.py
* Call fetch_os_creds.sh from $PATH
* Bugfix: fix two typos
* Update test_vnf.py to support py3
* Test decorators.py in testenv:py35
* Turn Sphinx warnings into errors
* Remove former run_unit_tests.sh
* Check python3 support when running tox
* Generate api doc when running tox
* Update apidoc to conform with vnf module
* Analyse code when running tox
* Check style when running tox
* Delete line breaks before binary operator
* Sort keys when dumping json
* Ignore .tox
* Tox utility to run unit tests
* Update requests as defined in releng
* Add baro_tests as requirements
* Install releng via requirements.txt
* Set default value for CONFIG_FUNCTEST_YAML
* Activating SDNVPN test cases for master
* Re-Enable Promise testcases
* Bugfix: fix the errors of onos_sfc
* Fully cover pytest_suite_runner.py
* Precise self.result in pytest_suite_runner.py
* Replace CONST.* by getattribute/setattr for refstack
* Replace CONST.* by getattribute/setattr for rally and tempest
* Print stack when catching exceptions in run_tests.py
* Modify how to disable logging in unit test
* Use StringIO in odl.py
* Use logger instead of printing in console
* Remove check_success_rate
* Replace CONST.* by getattribute/setattr for cli
* Add a new directory to hold pre-downloaded images
* Fix 2 issues related to logger in pytest_suite_runer.py
* Allow running unittest.TestCase via run_tests.py
* Clean test-requirements.txt
* Update self.result value to INT
* Conform constants.py with the minimal standards
* Fix an unorderable types error (if python 3)
* Add Python3 support to the ODL testcase
* Update/Add requirements to run ODL robot CSIT
* Converted vPing to leverage the object-oriented SNAPS library
* Define Runner class
* Add enabled flag in testcases.yaml
* Switch from generate_report to PrettyTable
* Update framework pres
* Fix how to get tier_name
* Fix one minor typo
* Additional Unit Tests for core modules
* Get a logger before printing
* Fully cover the decorator
* Assign the wrapped function’s attributes
* Upgrade robotframework-sshlibrary to 2.1.3
* Modify TestCase.__str__() to use PrettyTable
* Remove the former results in DB url
* Add Energy recording support
* Conform ODL with last framework updates
* Rename VnfOnBoardingBase to VnfOnBoarding
* Rename vnf_base to vnf
* Bugfix: initialize the logger for snaps
* Fix the opera ims instance initialization error
* Implement TestCase __str__()
* Rename TestCase check_result() to is_successful()
* Print the real testcase duration
* Replace CONST.* by getattribute/setattr
* Replace project_name by case_name in result file name
* Add iniparse to requirements.txt
* Check open args in test_odl
* Add Danube 2.0 reporting status
* Forbid calling generate_report from cmdline
* Define loggers as class-private members
* Delete functest.utils.functest_logger
* Move few local ODL SFC confs to global functest confs
* Extended the timeout for Opera
* Remove openstack directory
* Update tempest.conf to enable tempest from external server
* refstack-client userguide
* Updated basic attributes for opera testcase
* Remove create_instance_and_ip.py
* Publish framework presentation
* Add the choice of interface for keystoneclient
* Remove missing statements in test_odl
* Restrict coverage output to all functest packages
* Fix pylint warnings in snaps
* Update rally_conf.json for creating deployment
* Fix the instance initialization error for OnosSfc
* Logger must be a singleton
* Documentation for unit test project
* Fix false positives in test_tempest
* Catch os.makedirs() exceptions in tempest.py
* Manage criteria in TestCase
* Switch TestCase attribute criteria to result
* Remove the useless opnfv_tests dir in tests
* Remove useless lines of code in barometer.py
* rename tempest.conf to refstack_tempest.conf
* Switch testcase to test case in docstrings
* [VNF_base] Support existing tenant and user
* Remove exec right for ci config files
* Ignore _build (sphinx output dir)
* Fix pylint warnings in decorators.py
* Minor changes in docstrings
* Stop hardcoding results suffix in push_to_db
* Add mock to requirements.txt
* Update INFO file for Euphrates
* Add docstings in feature.py
* Remove former cmd instance attribute
* Fix Sphinx warnings/errors
* Use Sphinx to create API documentation
* Fix the irc channel
* Add class attribute docstrings in testcase.py
* Fix typos in vnf_base.py
* Add copper section in testcases.yaml
* Add license in feature.py
* Remove deprecated feature modules
* update check_os.sh admin port seds to match public
* Set image and flavor id in tempest config file
* Updated method calls to SNAPS tests
* Refactor the Feature framework
* Modify TestCase constructor attributes
* Rename test_ims_base.by to test_ims_base.py
* Write feature case names in testcases.yaml
* Add unit tests for parser
* Bugfixing the testcases execusion
* Bugfix: Add case_name as constructor arg for snaps_smoke
* Increase ram for tempest tests (aarch64)
* Add case_name as args in all features
* Bugfix: Add case_name as constructor arg for snaps and rally
* Fix VIM onboarding and ims deployment
* refstack client: improvement and fix of TestCase usage
* Add unit tests for feature
* Add unit tests for security_scan
* Add unit tests for sdnvpn
* Add unit tests for promise
* Add unit tests for odl_sfc
* Add unit tests for netready
* Add unit tests for domino
* Add unit tests for doctor
* Add unit tests for copper
* Add unit tests for barometer
* Add case_name as constructor arg
* Backup of reporting status for Danube 1.0
* [Clearwater Test] Fix bug in error message
* Enable the deployment info print for compass
* Adding label for userguide
* Make tempest cleanup resources after running
* Check a rule existence for a specific security group
* Upgrade to the latest kingbird version
* Re-enable rally and tempest full for weekly
* Release notes for Danube 1.0
* modify old naming testcase_base to testcase
* Clean up Tempest blacklist
* Disable tempest server reboot test for SDNVPN and Gluon
* More Unit Tests for tempest and IMS module
* Added test case for opera vims
* refstack: bugfix of name TestCase
* Add docstrings in odl
* Fully fix pylint warnings in test_testcase
* Rename test_testcase_base to test_testcase
* rename FeatureBase to Feature
* rename feature_base to feature
* Fix pylint warnings in test_odl
* modify old naming Testcase_base to TestCase
* Revert "Make SFC test a python call to main()"
* refstack client: manually running improvement
* More Unit Tests for utils module
* Remove vping_ssh from bgpvpn and gluon scenario
* Fix pylint warnings in odl
* Add docstrings in testcase.py
* Changing project name of vRouter
* More Unit Tests for ci directory
* Rename testcase_base to testcase
* Switch TestcaseBase to TestCase
* Fix pylint warnings in test_testcase_base
* Fix pylint warnings in testcase_base
* Fix Dockerfile.aarch64
* Update documentation for Danube
* Printing the flavor_metadata for SnapsTestRunner
* Change api version
* Fix VIM onboarding
* bug fix: unit test on openstack_utils
* Clean redundant error logs of refstack_defcore in the console
* Replace domain name from Default to default
* Ignore certain modules for logging
* Make SFC test a python call to main()
* Disable blocking status for odl_netvirt
* Fix Dockerfile
* Switch test_db_url to a directory
* bugfix: fail to push odl-sfc test result to TestDB
* refstack: bugfix of testcase failure
* Change execute bits
* Improve unix permissions fixes
* Respect common unix permissions
* Update keys of details dic for refstack_defcore
* Set refstack_defcore criteria to 100%
* [cloudify_ims] Change VNF flavor value
* Fix usage of v3 APIs of OpenStack
* Add reveal.js as a submodule
* [vnf_base] improve exception
* bug fix: version not retrieved on weekly jobs
* Enable functest offline by installing tempest system wide
* [cloudify_ims] fix signaling test error
* Fix deployment flavor of orchestra machine; Improve bootstrap
* Bug Fix: retrieve version from build tag in weekly jobs
* Remove functest_defcore testcases
* Bugfix: fix the criteria of refstack_defcore
* Parse refstack_defcore results
* refstack-client: arm dockerfile support
* [fuel] Skip test_server_basic_ops tempest test
* refstack client integration
* env variable support for test DB url
* Added Unit Tests for ci/tier_builder
* Added Unit Tests for ci/tier_handler
* Added Unit Tests for ci/run_tests
* Added Unit Tests for ci/generate_report with argument refactoring for main and init functions in generate_reports
* bug fix: remove reference to ovno
* [snaps] Pass flavor metadata to smoke tests
* [tempest/defcore] Configure volume device name
* Support running on openstack which enabled https
* Remove raise exceptions
* cloudify_ims: fix error on account creation
* cloudify_ims: fix sip public domain name
* Exclude Doctor from Joid scnenarios
* Change scenario for odl_netvirt tests to be os-odl_l3-nofeature
* fix vnf deployment
* Change the order of HealthCheck tests
* Show verification details in tempest log
* Introduce smoke tests for FDS
* Revert "Change barometer target log file"
* Optimize releng cloning when running unit tests
* Change barometer target log file
* Install kingbird verifier extension for tempest
* Improve error log into vnf test step
* Aarch64 adaption in functest for snaps smoke
* Adding Labels
* Exclude SNAPS smoke for lxd scenario
* Added support for scenario-based flavor creation
* Modification of repo path for vrouter
* Bugfix: modify test_prepare_env to make verify job successful
* delete ft_constants and file functest_constants.py
* Aarch64 adaption in functest for snaps healthcheck
* Update tempest to the latest 15.0.0
* [cloudify_ims] New requirement for ims testing
* Add extra check to avoid double delete of instances
* Bugfix: make security_scan authorized
* fix KeyError: 'clean_flag'
* unify TestAPI naming
* Integration of orchestra project
* Remove exec_test.sh
* Adopt TestcaseBase for ONOS and ONOS SFC
* Unit tests added for openstack/tempest
* Added Unit Tests for ci/prepare_env
* Restructure docs
* Fix bad log message when trying to create an existing sec group
* Bugfix: fix the CI failure for compass and joid
* Correct one reference url
* Add clean_flag to test cases
* Update cirros image to latest version
* Use python setup.py develop to install repos
* [odl-sfc] Add function to retrieve a resource from HEAT
* Bugfix: fix the cirros path for aarch64
* Add aarch64 custom config
* Re-enable the tests for bgpvpn scenario wich use floating ips
* Add custom tempest test
* Add Tempest Defcore test case
* Adding vRouter test codes using TestCasesBase
* Integration of orchestra_ims test
* Bugfix:Added the adapter info for compass and joid
* Add domino testcase
* Add documentation of testapi internship
* Use new-style classes which inherit from object
* WIP: Cirros TestVM: Allow config of username/password
* Remove shell Healtcheck test case
* Prepare env will exit when an error is raised
* Unit tests for vnf/ims
* Restore Kingbird functest
* Integrate BAROMETER feature test case
* Add deployment_handler printout to prepare env
* Fix neutron auth issue
* [odl-sfc] Fix wait_for_vnf returning vnf_id on timeout
* [odl-sfc] Add function get_vnf and fix endless loop in get_vnf_id
* Refactoring of cloudify_ims
* [odl-sfc] Add timeout to get_vnf_id and create_vnf functions
* Undo setting CI_DEBUG to true by default
* Remove cloudify_ims from ci daily loop
* Swap SNAPS repo from Cablelabs to OPNFV
* Modifies check_os.sh to check services and cinder is optional
* Fix flavor config and error log
* Revert "Add deployment_handler printout to prepare env"
* config_functest support muiltilevel query
* [odl-sfc] Add symmetric option for sfc_create
* [odl-sfc] Fix bug when getting the params for create_vnf
* Fix auth error
* Bugfix: update from security_scan to securityscanning
* Integration of NETREADY test case
* Add parameterized vnfd capabilities on vnf create
* update cloudify_ims case
* Fix tempest multisite config
* Add deployment_handler printout to prepare env
* Limit the substitution of ' in env vars
* Fix config file name setting
* Fix again unix permissions
* Bugfix: remove double quotes from environment variables
* Add ODL netvirt connectivity suites to list of robot tests
* Add can_dump_request_to_file decorator
* Revert "write test results to a local file"
* Use Exception instead of return code
* Put the Logger as Object oriented
* Refactoring of args and parser variable
* Fix source_credentials in openstack_utils
* [WIP] update cloudify_ims case
* delete useless file multisite.py
* Logic to trigger Security Scan project
* Refactor configure_tempest() function
* Integrating PyTest contained in SNAPS as a replacement to the old bash healthcheck
* Exclude Moon feature for Danube
* Releng environment in unit testing
* Change endpoint type for Kingbird
* Change log level when pod, scenario or build_tag cannot be retrieved
* Migrates more commands to openstack-pythonclient cmds
* bugfix for finding tempest failed testcase
* Fix template error log
* Add dockerfile for aarch64
* Add netvirt to odl tests
* Move api_check and connection check to healthcheck category
* Freeze the rally version
* Migrates glance commands to OSCLI
* Unit tests for openstack/rally
* Allow multiple sets of suites in ODL
* Remove all the results from previous releases
* Add flavor creation in functest env prepare
* Upgrade High level architecture config guide
* Bugfix: multisite test case fails
* Get tacker client using session authentication
* Exclude Copper until copper/installer integration completed
* Add tempest test details to results report
* Change permissions of python files
* Convert files to Unix format
* bug fix: no status returned at the end of a Tempest/Rally run
* Define how to pass args to TestcaseBase.run
* Adapt Promise to new framework
* [rally] Get keystone auth endpoint as request_url
* First update of dev guide for dnaube
* Update Configuration guide
* Extract util functions from tempest.py to conf_utils
* Tempest and SNAPS not pushing results to DB in case of FAIL
* First update of Functest user guide for Danube
* Adapt doctor test case to the FeatureBase framework
* Make sure we have installed python_novaclient==6.0.0
* Support newton in tempest
* [doctor] allow testing with fuel and joid
* Refactor Rally to adopt OO
* Bugfix: fix the error of no sh file
* Fix for opnfv onos-sfc scripts
* bug fix case name for VNFonboarding
* VNF_BASE - fix quota update failed
* Leverage logging config and refactor the logger
* Bugfix: delete the wrong path in functest_constants.py
* Bugfix: fix wrong path to vims-test repo
* Use 8081 for apex's restconfport robot variable
* Add VnfOnBoarding Abstraction
* Bugfix: fix the execution way in copper
* write test results to a local file
* Rally keystone test scenarios for v3
* Setting level to the Functest logger's parent logger to ensure log output from Python libraries being used by framework does not get sent to dev/null
* Fixes ODL rest port for Apex
* [Netvirt-pipeline] Exclude unwanted testcases
* Bugfix: fix the wrong return code
* [FUNCTEST] Correct right ip is used for public endpoint
* Bugfix: fix the wrong path in copper
* Remove cmd to OpenStack, use python client
* Added unit tests for utils/openstack_utils.py
* Refactoring of args and parser variable in ci/run_tests, prepare_env
* Tests added for utils
* Cover ODLTests.parse_results()
* Switch to assert_any_call in test_show_credentials
* Remove clean_results_dir
* Create ODLParser to parse sys.argv
* Fully cover set_robotframework_vars
* Use mock_open() to prevent stdout.txt
* Patch logging.FileHandler
* Added Unit Tests for cli
* Reverted the file permission
* Tackerclient added in test-requirement
* Added unit tests for utils/functest_utils.py
* Unit tests utils added
* use working zmail rather than private gmail
* Set flavor's page size to support dpdk enabled vms
* bugfix: clean results directory error
* Enable the tenant related features
* Adapt create_tenant and create_user to keystone v3
* refactor rally using new constants provider
* Add a flag in the CLI to report results to DB
* Bugfix: fix the wrong path for security scan
* Fix Tempest push results to DB
* refactor snaps and example using new constants provider
* bugfix: get git branch failed when only 'git fetch' is provided
* refactor cli module using new constants provider
* Refactor domino using FeatureBase and new constants provider
* Refactor tempest using new constants provider
* Adapt SDNVPN tests using Featurebase
* Updated vims to support keystone v3
* Refactor test run related modules using new constants provider
* refactor vping using new constants provider
* Bugfix in passing parameters to logger_debug
* Add default env variables in ENV class
* Remove backslash to meet PEP8 requirement
* Remove old tempest implementation
* Adapt Tempest to the new template
* Allow executing several testcases with the CLI
* Bug-Fix: No module named feature.copper
* Cover ODLResultVisitor
* Set SNAPS tests as non blocking
* Avoid side effects induced by functest_constants in ODL UT
* Fix the issue of unexpected keyword argument 'endpoint_type'
* Add check_criteria() in testcase_base
* Convert files to Unix format
* Fix find in Dockerfile
* Fix file permissions
* Install sdnvpn as a python package
* Fix path for SFC package installation
* Promote Helen Yao as commiter in Functest
* Install SFC python modules in Functest
* Unified way to provide configurations and env variables(proposal 1)
* Switch to ODL beryllium-sr4
* Bug fix: precise testcase name to push results into DB
* Authenticate clients with keystoneauth1.session
* Adapt Copper to Abstraction framework
* Adapt Domino to FeatureBase
* Create internship dir in docs
* Conform SFC test case to FeatureBase
* rename openstack to components
* Add timing decorator utility
* CI-Build-Fix: Move the connection check to smoke
* Rename add_floating_ip arg to floatingip_addr
* Upgraded the virtualenv
* Install releng as a python module
* Support rally configuration for both Newton and Mitaka
* Move api_check test in smoke category
* Snaps integration
* Add host aggregate / av zones util functions
* Added test cases for running the Python Tests included with SNAPS
* Update the logic to support both Newton and Mitaka
* Revert commits that handle tacker objects
* Get rid of easy_install in unit test
* Bugfix: fix the wrong class name
* abstract umbrella part to make integration code simpler
* test-requirements.txt is added for unit test
* Tacker objects in openstack clean
* Tacker objects in openstack snapshot
* Fix Pep8 issues related to \
* Fix typo in openstack_tacker
* Concatenate the RUN commands
* Sort multi-line arguments alphanumerically
* Rename TestCasesBase into TestcaseBase
* Update release notes with arm results
* remove functest_repo from TestBase, move it to vPingBase
* Revert "solve failure testcases are not pushed to testDB problem"
* Remove Notion of SKIP in test cases
* Allow unit testing w/o internet connectivity
* bug fix: bad ping.sh path after refactoring
* Fix tacker util script
* Bugfix: fix the wrong path for vping_ssh
* Bugfix: fix the wrong script path for healthcheck
* Lifted requirements.pip one level up to meet the basic structure of OpenStack project
* Add suffix '_DIR' to some constants that point to directories
* file/dir renaming for consistency
* Adapt Parser test case to the new template
* Fix bug repos_dir -> REPOS_DIR
* Consider criteria as exit condition in odl test
* Extracted all global parameters into functest_constants.py
* bugfix: correct test report status
* Adapt check_os to OpenStack Newton
* Conform SDNVPN test case to TestCaseBase
* Adapt vping testcases to the new template
* solve failure testcases are not pushed to testDB problem
* Fix path for Promise testcase call
* Fix path for Tacker installation
* Switch SFC call to sfc repository
* bugfix: domino test can not be executed
* Create directory and empty files for the new openstack utils
* Create ovs log artifact on odl-sfc fail
* Adapt Domino to Test Abstraction
* Update Promise repository
* Remove Harcoded version for ruby (vIMS)
* Installing SNAPS library to Docker image
* Bug fix odl-sfc
* Wrap the Functest and install it as module by pip
* Downgrade keystone client only for SFC testcase
* Update OpenStack python clients to Newton version
* Bug fix in odl-sfc
* Fix path in CLI after directory restructure
* Add script to enable Docker Remote API by updating Docker Daemon configuration
* Fix path for vping_ssh after refactor
* Bug fix: fix path in run_tests.py
* Make the healthcheck sleep time configurable
* Phase out sfc_colorado1 from the CI
* change path for python ci files
* Feature to know the time it takes to update OVS
* Fix paths in SFC testcase configuration
* Fix path issue in Docker file
* Remove kingbird installation
* Repo structure modification
* Update rally version
* Restructure SFC-ODL test cases
* Upgrade python-keystoneclient
* Adapting testcase to Boron SR1
* Add security group rule for DHCP
* Delete the reachability tests
* Do not modify unix rights in case of unit tests
* Remove python-keystoneclient downgrade and keep the newer version
* Fix typo in Dockerfile
* bug fix on log file creation for unit tests
* Add exit return code for unit tests
* Update onos scenarios in the release notes for Colorado 2.0
* Fix bug in ovs utils
* Update release notes for Colorado 2.0
* Bug fix for odl-sfc
* Complete OVS logging for sfc testcases
* Add ovs logging in sfc_colorado1
* Add OVS logger
* Ignore files created by run_unit_tests.sh
* Cover KeyError in ODLTestCases.run()
* Added more logs to track better errors
* Fix nosetests call in run_unit_tests.sh
* Add Copyright headers
* Move unit tests in unit_tests
* Import TestCasesBase from functest dir
* Add unittests dir
* Add full Apache 2.0 licence in LICENSE
* Add wrappers for Tacker Python client
* Get OS_ env vars via os.environ
* Extend rally test case exclusion feature
* Use importlib to load testcases
* Add OpenDaylightTesting unit tests
* Remove exits in OpenStack client utils
* Multi-compute support and python refactoring
* Ignore rally_conf.json
* Conform ODL to TestCasesBase
* Add a parent class for test cases
* Unify rally test case exclusion mechanisms
* remove 3rd part files with MIT or BSD license
* Stop copying obsolete files
* Spawn instances in nova availability zone
* Bug fixes and updates to fit ODL Boron SR0
* Remove exit() in ft_utils.execute_command
* Delete obsolete robot files
* Create shallow clones with a history truncated
* Bug fix in odl-sfc testcase
* Small fixes in sfc testcase
* Update INFO information after PTL election
* Use huge page for dpdk (ovs) scenario
* Remove old tacker setup
* Add Serena update on Functest Dashboard
* Refactor rally task scenario files
* Move sfc custom flavor creation
* make logger in vping a local variable
* SFC test: Add port 80 to security groups
* vPing ssh outpust wrong logger
* Fix tag version for documentation
* Increment counter in sfc_colorado1
* Open secgroups and add check_ssh in sfc_colorado1
* Add SSH connectivity check
* Update release note
* Add odl_sfc test in apex as the scenario is run
* Review release note for COlorado
* Bug fix for the SFC-CI test case
* [ODL-SFC] Bugfix: replace string "22" by "22/tcp"
* [ODL-SFC] Open port 22 in default secgroup for sfc scenario
* Remove parser test case from bgpvpn scenarios
* Style the headers for release-notes
* Update results on ARM
* Remove TODO in Functest user guide - Add links to feature project user guide - Add links to external web site - Change Dashboard picture
* Updated results info for os-odl_l2-fdio-noha
* Add user guide link for copper
* Fix formatting error
* Update release notes with ARM results
* Corrected Promise links (According to final opnfvdocs directives)
* Added support for custom images and flavors in tempest
* Update release Note
* fixed updating of hugepage flavors
* Exclude Doctor from Functest for fuel scenarios
* Exclude copper, doctor and security_scan from apex/fdio scenarios
* Add delay after SF floating IP assignment
* Include latest tag for Multisite Kingbird
* Added missing parameter into logger warning message
* Push FAIL to DB for onos-sfc
* Add utils for getting bgpvpn information
* Doc for Xreview by other test projects
* Refactored support for flavor and image hugepages based on Morgan's suggestins
* SFC testcase IP tables policy
* Add CI link for ARM
* [SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios
* [ODL-SFC] Add push resulst to DB
* Added support for creating images and flavors with hugepages for fdio scenarios
* Exclude Tempest basicops case also in noha scenarios
* Optimize onos-sfc
* [Promise] Use the repository from github
* Exclude some Rally/Nova tests from lxd noha scenario
* Tempest release verion updated 12.1.0 -> 12.2.0
* make use of functest_utils.get_parameter_from_yaml
* Exclude Rally/Nova tests for lxd scenario
* remove imported FUNCTEST_REPO object
* Clone the proper branches in the dockerfile
* Fix image format set for rally test cases
* Remove source-sans-pro directory, fonts not used and license conflict
* Reduce logging in the SFC test case
* [Promise] Fix bug opening the json result file
* Add support of arm for doctor
* [Promise test case] Use proper way to get parameters from yaml
* Add blacklist handling for rally test cases
* Redirect dominio's output to a log file
* [Doctor test case] Redirect output to a log file
* Revert excluding floating IP cases from odl_l3
* solve bidirectional dependencies between ci and utils modules
* Exclude test cases that use floating IP from odl_l3 scenarios
* Print all the Copper test output to a log file
* Print all the Parser test output to a log file
* Fixes cleaning up HA Neutron objects
* Change debug mode for commands that generate too much output in sec_scan
* Change default memory for Promise flavor
* Add router association utility function
* Add print-to-a-file option when executing a command in functest_utils
* Fix some bugs
* Switch print to logging.info
* Force python-keystoneclient to version 2.3.1 for tacker to work
* stop hardcoded FUNCTEST_REPO path everywhere
* Remove copper from lxd scenario
* Refactor SFC testcase
* Add a specific logger for orchestrator class
* unify functest_yaml obtain process
* Remove all logers as utils method args
* Use a global logger instead of method args
* parser fails on virtual environement
* Fix problem with SFC test
* Committer promotion: Cedric Ollivier
* unify testcases.yaml obtain process
* delete useless FUNCTEST_REPO variable
* Release note: add restriction for joid/domino
* disable test case does not make sense for LXD
* Exclude healthcheck from lxd scenarios
* update fuel ref in tacker setup script
* Allow realtime Jenkins' console output
* Force stdin, stdout and stderr to be totally unbuffered
* Exclude floating-ip related tempest tests to blacklist for bgpvpn scenario
* Stop hard-coding db url
* Flush stdout as it can be redirected to log
* Update Release note
* Review dev guide
* Set env vars as mandatory to push to DB
* configuration guide review
* refactor create shared network process to eliminate reduplicate
* refactor create or get image process to eliminate reduplicate
* Stop calling exec_test.sh in the middle of python scripts
* Use by default the default ODL web port
* Fixing commit f1054f8f
* Included correct links (Colorado) to Doctor/Promise user guides
* [SFC] Fixing CI
* Committer promotion: Serena Feng
* Avoid duplicating logs in run_tests.py
* when create/get/update failed return None rather than False
* Enable security scan for apex scenarios
* [Fuel] Skip test_server_basic_ops tempest test
* refactor push_result_to_db print thing
* Create tempest resources before generating tempest.conf
* Add logger to push_results_to_db args
* delete useless image_exists in vping
* doctor test support fuel installer
* Fix typos in OpenDaylightTesting
* Mend create_image() function
* Avoid opening tmp files twice
* Add logs (info)
* bugfix: push_result_to_db exception show
* Improve errors and status codes management
* Point tempest to stable 12.1.0
* Catch exception if output.xml failed
* refactor vping
* Protect again changes of unix permissions
* Chmod 755 all py files which can be executed
* Add reporting to DB in OpenDaylightTesting
* Add exec right
* Fix print when push_results_to_db fails
* Bug fix - Better way to grab file from gerrit
* Pull down default instance flavor
* Modify data sent to testAPI
* Colorado Release note
* fix Pillow version 3.3.0
* functest compass usage document
* complement Parser related userguide
* Config guide workflow simplification
* Remove useless odlreport2db args
* Add report flag for moon
* Minor fixes for Doctor Project
* delete extra slash while execute cases test in exec_test.sh
* resume Parser test run on fuel onos
* Reorder imports
* Convert to Unix format
* Check the response status code
* bugfix: wrong directory
* Remove parser tests from fuel onos
* Add reporting flag to push reuslts only from CI
* [moon] install moonclient in docker
* [multisite] set the criteria as 100%
* Modify joid tempest list for onos
* blacklist.txt file format corrected
* output logger info for Parser tests
* Add Domino user guide link, modified description text, remove trailing spaces in index.rst
* Repoint security_scanning to its own repository
* Add onos blacklist for tempest
* Fix joid test bug that creation of vm fails
* [multisite]push result to db
* Call moon python script to run the moon tests
* Update cli output text
* add parser to feature tier to make it run daily
* Update user guide for Colorado
* Provides connection check for package download
* copper push to DB fix
* Fixing a typo
* Improve LXD scenario support
* Tacker post script link changed
* [bugfix] should create result folder for multisite
* [bugfix] pass the wrong argument to rally
* Add conf directory to Dockerfile
* Bug fix to eliminate undeterministic behaviour
* add report flag to parser
* [multisite] refactor the scripts of multiste
* change parser path from RNC to vRNC
* update pip version of functest docker image
* Create config_functest patch to update the conf with scenario
* Add SKIP status if Domino Test Case is skipped
* parser integration bugfix
* Bug fix in functest ODL-SFC
* Update test with the new SF and new tacker script
* Use Kingbird Bind host URL for Tempest
* Bug fixes odl-sfc + new features
* Reduced timeout for SSH connection attempt in tempest.conf
* Re-generating tempest.conf file before starting tests
* unify test result check for feature project and apply to parser
* support "" equals to None check in Testcase.is_compatible
* Set lnfo logging level for Doctor tests
* Enable Copper functest under JOID
* Shorter test case names are accepted for tempest blacklist file
* functest utils - get_resolvconf_ns() Ensure that dns works with dns name resolution
* Fix for the endpoint URL for kingbird
* use configured success_rate to check tempest test status
* Fix missing directory when calling bgpvpn tests
* Several bug fixes in ODL-SFC functest testcase
* modfied to mute object storage test on joid
* Wrap call to the rest api with try-except while generating report
* Add onos_sfc scenario
* Add dir_repo_domino to fix bug
* Return with exit code in Doctor testcase
* Return with exit code in Promise testcase
* Return -1 in Rally if the success criteria is not met
* correct rally criteria check
* unify test results logger and apply to parser
* Select test cases in tempest to be blacklisted per each scenario
* Bug fix of the CI script in the ODL-SFC test case
* Prevent exiting the overall execution when there is a failed test case
* Scripts added to enable the SFC-ODL test in CI
* Add configure options for healthcheck
* Add region name to OpenStack credentials
* Functional testing for tosca2heat translation
* Bugfix: dont stop execution when a test case is not blocking
* Add endpoint type support on functest
* logger the push result of rally test
* Disable security scan tests
* Make openstack_clean be aware of the names and not only the IDs
* Fix the proper version output for kingbird
* Return -1 in Tempest if the success criteria is not passed
* Return -1 if copper test fails
* [bugfix] issures in multisite testcase
* Enable odl-sfc in CI
* Bump rally to 0.5.0 and add shyaml
* [bugfix] miss a argument
* substitue misused variable 'total_success' with 'success_rate'
* Generate Functest report at the end of the execution
* delete useless stop_time initialization in run_rally-cert.py
* Bug fix for ODL-SFC testcase
* Bad status on rally_sanity
* add .idea directory to gitignore
* Turn off vPing_ssh for odl_l3 scenarios due to odl bug
* Create a flag in the tests to indicate if they should be blocking or not
* Bug fix for SFC test case
* Add duration message after test execution
* bugfix: Don't try to run a tier if it doesn't contain any enabled test
* Fix execute_command function to show all the output
* Add cd to test directory
* Bugfix: ODL report to DB fails
* Remove logger as input parameter of functions in openstack_utils
* Add kingbird endpoint information to functest
* Add logger to openstack_utils to output error messages
* Show real time tempest test execution
* Catch timeout exception in vIMS
* Exit with -1 return code if something fails in vping tests
* Extend timeout to check vm in onos-sfc testcase
* Don't take openstack snapshot when "-n" option is set
* [multisite] run on the env of fuel and compass
* Use blacklist of Tempest test cases for SDNVPN scenario
* Fixed typo in config.ini for reports.html
* Add functest logger in ODL script
* Push sfc result into DB
* Revert "Disable ODL test."
* Disable ODL test
* Disable ODL reporting to DB
* [bug] miss a ; in case statement
* Enable domino multi-node test case in Functest
* Enable new SDNVPN test cases in Functest
* Use common way to get the openstack clients
* Switch to $SDN_CONTROLLER_IP instead of $neutron_ip
* [multisite] add kingbird repo and install python lib in docker
* [multisite] integrate kingbird tempest testcases
* Improve timeout management with python
* Bump to cloudify-manager 3.3.1
* Propose a new python file to launch ODL testing
* Enhance ips, ports and creds management
* [multisite] add interface of multisite test suite
* Add sfc support for all installers
* Use flavor m1.tiny in healthcheck
* BugFix --noclean option in the CLI
* Chmod 755 all sh files which can be executed
* Chmod 755 all py files which can be executed
* Stop creating the useless ODL results dir
* Add fixed_ip and files parameters in openstack_utils in create_instance
* bug fix: use PASS/FAIL in Onos instead of passed/failed
* Fix one pep8 violation
* Add --noclean option in the CLI
* Add delete bgpvpn function in openstack utils
* SFC Testcase for functest
* Fix onos sfc's block. Add ping check before login
* Create vnf directory in testcases
* Conform start_tests.sh to last ODL patches
* Update developer guide  documentation
* Fix function get_hypervisors in openstack utils
* Added 'vacation' test case
* [SDNVPN] Bugfix bgpvpn functions in openstack utils
* [SDNVPN] Add helper functions to create bgpvpn and associations
* [SDNVPN] Adding sdnvpn repo to functest
* Add Moon in Functest
* Add BGPVPN neutron client extension for SDNVPN project
* Add tacker-client in the functest Docker image
* Adding security_scan section to functest userguide
* Add support functions for SDNVPN test cases
* bug fix: use PASS/FAIL for rally
* bug fix use FAIL/PASS as criteria for integration in automatic reporting
* Add copper for CI integration
* Move copper.py to functest repo
* Fix tacker client dependencies installation
* Bug fix of tacker_client_install
* Add tacker installation to odl-sfc
* Enable doctor test scenario in master
* Fix doctor test return check
* Change methods to call openstack utils
* Fix incorrect path for createfiles.py and amended hiera path
* Functest Userguide update for Colorado
* Add support for Copper project
* Add example script creating an instance
* Delete robotframework files hosted by ODL
* Add openstack clients and create instance in openstack_utils
* Add interface to run sfc functests
* add missing symbols in Results section
* Change OpenStack clean behaviour
* ONOS sfc scripts
* Remove OVNO test for Colorado
* update Test Dashboard & API description in devguide
* Remove old test dependency in config_functest.yaml
* Suspend Doctor execution on Master for apex scenario
* bug fix: use FAIL/PASS as criteria for vping_userdata and rally_sanity
* Switch to ODL_SYSTEM_IP and OPENSTACK vars
* Functest Config Guide - Text updates to reflect new CLI
* Change step 4 to step 3 in healtcheck
* bug fix: duplicate start_date var with different type
* modify onos tests' link to support onos 1.6
* Final version of testAPI presentation
* Serena's presentation review
* bugfix: name format and testcase start time
* Added content for StorPerf
* add slides for qtip
* update team image
* Update image, add Qtip and minor formatting changes
* Check resources exist before testing delete
* change cloudify cli version from 3.3 to 3.3.1
* adjust testAPI presentation
* fix format problem
* Align test names in DB and config file
* Remove default values if the os credentials are not set
* Fixed auth url in v2.Password
* bugfix: import module
* Added use of OS_AUTH_URL to security_scan and exec_test.sh
* Add documentation to conform to odlreport2db.py
* Try/except ODL push to DB until ODL tests are refactored
* Replace deprecated keywords
* format fix + KPI section update
* Update css and team image
* Lessons learned for Tempest into Berlin presentation
* Remove unused librairies in robot files
* Enable security scanning
* Add reachability testcase for ODL
* Reduce rally run script log output
* Add yardstick section into Presentation
* SSH key key type select improvements and jump host rename
* Remove unnecessary defaults from rally task file
* Fix bug: use right format for date when pushing to DB
* Remove external server references on Rally scenarios
* Creating Glance image for Tempest suite
* Fix flake8 violations
* bug fix: end_time var does not exist to calculate duration
* little changes in testapi presentation
* Update testapi presentation
* Fixes and Docker Specific Attributes on security_scan
* Fix vPing success criteria evaluation bugfix
* Add CPerf slide to OPNFV Summit Berlin deck
* Fixes incorrect parenthesis format & adds ft_logger import
* Adapt functest testcase to APi refactoring
* Added paramiko.util.log_to_file
* Use current ODL Integration/Test repo
* Add presentation for test API
* Presentation Test community Design Summit
* Stop the job and quit with error if a test case fails
* Replace subnet by port
* Rename Robot Framework sources to *.robot
* Fix duplicated output when using the functest logger
* Check correctly arguments
* Add criteria in testcases.yaml and Test class
* bug fix: pb when pushing bgpvpn results when no failed failed field is empty (not equal to 0)
* Avoid tuples when printing multiple strings
* Write login correctly
* Add Apex based security scan code
* Remove unused CI_DEBUG
* Bugfix: can not find tempest.log
* bug fix: if all tests passed failed could be empty
* Take report arg into account
* Add simple error logs in result DB
* Use flavor name instead of flavor id
* Add security_scan in Functest CI pipeline
* Push results if INSTALLER_TYPE and NODE_NAME are defined
* Allow unknown ci_installer or ci_scenario in is_compatible
* Added 60 sec delay before launching instances in healthcheck
* Join Rally_full and Tempest_full in the same Tier
* Add framework for presentations
* Push bgpvpn_api results into Test DB
* Preserving Nova instances from os_defaults.yaml
* Fix path for vping.sh and exit if SCP fails
* fix vPing paths post refactoring effect
* Change 'testcases' directory structure
* BGPVPN test case refactored
* Refactor ODL vars in ci/exec_test.sh
* Replace error in ci/exec_test.sh
* Catch TypeError exceptions in ci/tier_handler.py
* Added handling of blacklist for tempest
* Add protections if INSTALLER_TYPE is unset
* Fix typos in testcases.yaml
* Respect multiline syntax in Dockerfile
* Fix a few nits in prepare_env and dockerfile
* Specify the field id in neutron arguments
* Removed obsolete modules
* Split tempest into smoke and full modes
* Enable sanity mode of Rally test for the CI runs
* Adapt tiers to run depending on WEEKLY/DAILY
* Create a private shared network for Rally
* Creating private network for Tempest
* CLI implementation
* Generic Function to create a private network
* Fix shebang of python scripts
* Add results dir to Dockerfile
* Don't exit on error when destroying rally deployment
* Fix bug config_functest.yaml location
* Refactor, add logger handler to collect all the logs to a file as well
* Refactor improvements
* Add command to execute the actual tests
* Enhance output when showing tiers and testcases info
* Create CLI template for Functest
* Source the credentials in run_tests.py
* Functest - documentation small corrections
* Execute successive scenarios after task failure
* Add a step to enable docker run without sudo
* Create run_test.py using the tier mechanism to run the tests
* Prepare Brahmaputra 3.0 release
* Replace all the loggers by the functest logger module
* Create prepare_env.py from prepare_env.sh and config_functest.py
* Corrected path for clean_openstack.py
* Move functest_utils and openstack_utils to directory /utils
* Add Functest Logger centralized Class
* Corrected logging.Formatter parameters
* Corrected if statement for clean_openstack
* Remove backslashs for line continuation
* Add untracked files to ignore
* Add tier_handler and tier_builder
* ConfigParser is used for tempest.conf updating
* Introduce a sanity test mode for Rally test
* Fix regex to exclude vPing_ssh and vIMS for scenario dealing with bgpvpn
* Affect version field in results for all the testcases
* Enable PYTHONPATH env variable inside the container
* prepare_env CI_DEBUG when calling generate_defaults.py
* Remove cleanup from vPing scripts, and use the existing cleanup script
* Fix Flake8 Violations in the Functest scripts
* Add Tier scripts handlers and list of test cases yaml
* Print openstack info only if CI_DEBUG==true
* Remove RALLY_REPO in config_functest since it is not used
* Dockerfile, fix typo in git clone command
* Small adaptations in prepare_env,run_tests and common
* Adapt Functest output to the env variable CI_DEBUG
* Quote missing
* Remove all the repo handling in prepare_env
* Allow rally to use existing glance image
* Author: Luke Hinds <lhinds@redhat.com> Date:   Mon 18 Apr 11:48:27 2016 +0100
* Generating test lists for tempest
* Add healthcheck test case to test_exec_priority
* Update python-openstackclient to version 2.3.0
* [BGPVPN] Exclude vims and vping_ssh from testlist
* [BGPVPN] Use system wide installation of tempest
* Revert "[BGPVPN] Rally create the v-env which is needed"
* [BGPVPN] Rally create the v-env which is needed
* Adding Apex able to run BGPVPN tests
* Add healthcheck test case to config_functest.yaml
* Create health check test case
* Lack of Internet connectivity is not treated as fatal
* add bash script to config pip and easy_install
* Remove unused Rally scenarios and run script
* [BGPVPN] Remove odl-vpnservice test cases
* Split functest_utils.py into 2 scripts
* [BGPVPN] Bugfix for /etc/tempest/ no there
* Allow vping to use existing glance image
* update of INFO file
* bugfix single quote
* Bugfix result criteria
* Add status when pushing Tempest results
* ONOS can now support vPing_userdata testcase, remove the exception in the config for CI
* Try configdrive in vping userdata test case
* improve status criteria
* Fix support for CACERT and set OS_INSECURE=true
* Revert "Checkout the Latest stable Tempest"
* Add criteria and version when pushing the results into test DB
* Checkout the Latest stable Tempest
* Add exception handling for output processing
* Test numbers creation before starting the signal test
* A non default argument cannot be placed before a default one
* Have vIMS and Promise packages pre installed in the docker image
* Add support for SSL endpoints in Functest
* Rally and Tempest pre-installed in the Docker image
* Add Proxy section in the config guide
* Fix Dockerfile to use proper bashrc file for the alias 'll'
* Samll corrections in the config guide
* remove ref to Opencontrail
* Updates and fixes in the Config Guide
* Add release note
* Updates and fixes to the user guide
* docs: fix pdf creation bug in userguide
* Fix tables in the troubleshooting guide
* Add rally troubleshooting guide
* minor fix on format + add doctor references
* Add vPing troubleshooting guides
* Adjusting the heading level for composite doc rendering
* Fix Doc errors detected in opnfv-docs-verify and add license
* Change table format
* Add jenkins build tag for result api
* Fix formatting for compass and joid scenarios
* Correct rst formatting for fuel scenarios and set proper order
* Add the missing scenario results to the doc html page
* Add doctor results to apex-odl-l2 scenario
* Add result docs for apex, compass, joid
* Add fuel scenarios test report
* Moving testusage.rst to introduction.rst to avoid being pulled into the userguide
* remove "print" in tempest to avoid having a message "None" in the output
* Create troubleshooting guide as a separate .rst
* Add git support for Doctor repo in config_functest.yaml
* Fix message outputs taken from the console log in vPing_ssh
* Corrected using of echo command
* Remove network failed message check form vping_ssh
* Add VI and alias support in the docker container
* Release floating ip after vPing_ssh test
* Create vPing_userdata instances with dynamic ports created by nova/neutron
* Create vPing instances with dynamic ports created by nova/neutron
* Renaming the description text to include in composite docs
* Add compass onos and odl_l2 scenario
* Rally live migration case selection
* Add result overview and onos-nosdn-ha scenario reults
* Adding a structure for the reporting of test cases for functest
* bug fiw syntax when calling push to db from vIMS
* Add project in push_to_db function of functests utils to allow external project onboarded in Functest to push their results
* Push results without extra formating
* Enadled --serial option for run_tests.sh
* Bugfix add "fi" at the end of the if-else statement in run_tests.sh
* Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scripts
* Rename the vPing scripts proplery and adapt documentation
* Doc updates
* Create Rally summary report also for verbose mode
* Push rally summary results into DB
* docs: add userguide file for the central doc
* Create Rally output summary at the end of the tests
* Remove obsolete public network definitions
* doctor: adds logger
* update doc - update external test cases - add chapter on push to DB
* Used sed instead of crudini for updating regex
* Added configuration of ssh_user_regex parameter
* enable doctor test scenario
* Reduce the number of iterations to ten in rally scenarios
* update user guide - change vIMS logs - add Promise logs - modify section on OpenStack audit (now dynamic) - minor reformating of tables - typos - add troubleshooting section on vPing and vPing_userdata
* Import request python module for promise test case
* Fix success status parsing of rally results
* Use python json parser to get the results form the Promise json report
* Revert "bug fix: get installer using functest_utils"
* bug fix: get installer using functest_utils
* FIX: sleep 3 second to release create_venv.sh from chmod command
* FIX:use 'info' after sourcing the common.sh
* Show Promise results output and push results to DB
* Consider volumes and floatingips as defaults in clean_openstack
* bug fix to run tempest and minor display error in run_test.sh
* Create security groups with ICMP and SSH rules for vPing tests
* Report vPing timeouts to the DB with duration = 0 and test status=NOK
* Remove error message if instance is not found
* Small improvements with output messages
* Use openstack client to avoid keystone deprecation warnings
* Use promise-flavor if exists and don't try to create it again
* Use generate_defaults instead of os_defaults fixed parameters
* Add script to generate the OpenStack defaults
* Enable all rally outputs in verbose mode
* Adding structure to pull content into central docs
* Export private net OS_TEST_NETWORK for Promise tests
* Replace openstack single clients by python-openstackcclient
* Add testcases results to DB
* Add aodh default user for apex
* use scenario instead of git info in version field of the test results
* Copy tempest.conf to results dir to be uploaded to artifacts
* Add promise section from patch 8361 of Gerald
* Create stdout and stderr files for Tempest results
* bugfix: self.logger
* Editorials
* fix the bug of onos test report
* Change scenario start/result messages in run_rally-cert.py
* Add some error result in result db api
* Update doc
* Add scenario name to Rally result message
* Changed to use $(repos_dir) and removed #
* Change to logger.error when there is an error in clean_openstack
* Small typos fixes in functest_utils.py
* Refactor functest_utils.py
* change for get joid onos ip
* Follow change in joid use SDN_CONTROLLER_IP env var instead of ODL_CONTROLLER_IP
* Reduce Rally output
* Volume type management moved from run_tests.sh to run_rally-cert.py
* Fix promise test output
* Bugfix print arguments in functest_utils.py
* Print json result file of Promise testcase
* Refactor functest_utils.py script
* Option to redirect stderr output to a file for Tempest test
* Remove possible message "No handlers could be found for logger paramiko"
* FUNCTEST-128 Modify the ssh output match
* FUNCTEST-127 FIx the condition judgment of vping
* bug fix bad var affection when running ODL
* typo fix on odl
* Add bgpvpn and odl_vpnservice in config_yaml
* Add timeout in paramiko ssh command
* Add more OS defaults for Fuel 8.0
* Patch ODL scenario to support joid (different keystone and neutron API IP)
* Replace 'No vPing detected' by a better understandable message
* Allow executing ODL test as many times as wanted on the same env
* Add whitespace in the vPing2 command
* Add missing directories env variables in common.sh
* Add function for Promise libraries pre-install
* Fix typo in requirements.pip
* Remove vPing_userdata and vIMS from onos scenario
* Use paramiko library to SSH and SCP the instances in vPing2
* Use rally cert script
* bugfix: syntax error
* Add copy of packages.json to the features path before running npm install
* Adding BGPVPN and VPNSERVICE testcases
* test db migration
* FIX: args of push_result_to_db changed from git_version to version
* bug fix: when running manually a test, get stuck in echo
* Removed unnecessary references to public subnet cidr
* Put scenario in version field on the Test DB (rather that git indication)
* Added --no-clean option for run_tests.sh
* Add support for Promise test cases
* Push ODL results to DB
* modify onos functest to suit joid CI
* Add control to redirect rally stderr
* Temp solution to workaround the problem with pip when installing tempest
* Add default admin_floating for Fuel 8.0
* Check if rally image already exist and don't create it again if so
* Detect if userdata is not supported by nova in vPing-userdata test
* create 2 vPing scenario:vping and vping-userdata
* add doc of onos usergide
* Added vPing2 using SCP and SSH instead of nova userdata
* Modify ONOS CI running
* Ensure nameserver ip works
* Add mention to apache 2 license in Functest files and remove unused files
* Remove rally stderr output from rally-cert
* Updated Tempest related parts into User guide
* Remove --offline flag
* Bugfix Missing "$" in front of some variables
* Remove all the unnecessary Rally output
* Fix array of test in run_tests.sh
* Add developer guide
* bug fix: duration time not initialized in case of VPing error (timeout)
* Add 'neutron' default user for joid
* Prepare integration of ovno
* Print openstack defaults before running clean_openstack.py
* Add --debug flag to first clean_functest.py
* Remove FUNCTEST_BRANCH and FUNCTEST_COMMIT from the output
* Replace command "pass" in the shell script by ":"
* bugfix: update cinder quota strange space
* Remove ODL and ONOS from base scenarios
* Change novaclient usage
* Remove extra output if CI_DEBUG is false
* Add onos in the list of executable tests
* Added more consistency when getting the config_functest.yaml
* Add explicit logs when creating list of runnable tests
* Fix bug ruby sig test
* add doctor test case
* Modify ONOS test for CI running
* Adds check to make deploy scenario is also not "none" (default)
* Fixes syntax error on if statement with run_tests.sh
* set up mechanism to tun only runnable tests in CI based on scenario
* Use the env variable NODE_NAME for pod_name
* Add rvm use system to bundle install for vIMS
* Remove bundle install from Dockerfile
* Change functest branch to stable/brahmaputra
* Bugfix: create functest conf dir
* Fix dns problem on E/// pod
* Remove arg.repo_path in run_rally_cert.py
* Create volume type before running Rally tests
* Place config_functest.yaml outside the functest repo
* Remove references to foreman installer
* Add cinderv2 and ceilometer to default users for Apex
* Change MTU size in the container
* Fixes netcat for multiple platforms
* Rally test case troubleshooting
* Cleanup functionality improved
* Prepare Promise integration in Functest
* Add timeout for cloudify-manager deployment
* Update rally version to 0.2.0
* make doctor tester available in functest docker image
* Add mechanism to check whether the test can be run or not according to the scenario/controller
* Prepare onos integration in Functest
* bugfix: get admin role on joid installer
* Add ext network for joid
* Add check of external network before running any test
* Add 'service' tenant to os_defaults for apex
* typo it should be services not service
* added the quantum_nova user as well for joid
* User and installation guide
* Add joid defaults to clean openstack
* add .gitignore
* Fix path of os_defaults.yaml
* Searching for shared private networks
* Move openstack defaults to a yaml file
* Bugfix: cfy teardown -f
* Bugfix: indent ........
* Bugfix: logger .
* bugfix: indentation error
* Ensure no ssh key file already exists before launch cloudify deployment
* Using shared private network
* Bugfix : Ensure that ruby libraries was installed before running vims test-case
* Ensure that ruby libraries was installed before running vims test-case
* Configuring non-admin credentials for tempest
* Give the right repo path for vIMS to send report
* Update cinder volume quota for new tenant 'vIMS'
* Support for customized tempest case list
* Add ruby 1.9.1 installation in docker image
* Support for removing hanging ports
* Refactor run_rally-cert.py
* Update orchestrator (cloudify) version from 3.2 to 3.3
* Update rally to lastest release 0.1.2
* Fix timeout in vPing when booting a VM
* Fix: do not remove network/router created by functest preparation
* Add 'check if file exists' when creating the glance image
* Add 'rvm use system;' to Dockerfile for vIMS
* Fix bug 'unrecognized arguments: start'
* Move check_os call to prepare_env.sh
* Use repos_dir env variable in all Functest scripts
* Add more compass defaults to clean_openstack
* Wait for floatingips to be released in clean_openstack script
* Change ping command by netcat to check OpenStack endpoint
* Remove hardcoded IP in check_os
* Script to check the basic OpenStack services
* bugfix: vIMS blueprint branch
* Move 'wait for instances to be terminated' after deleting them when cleaning openstack
* Add cinder check to support NoneType object
* Parameterize Rally scenarios
* Add more defaults to clean_openstack script
* Fix the call to the ODL test
* Adding more robust check to delete a port in clean_openstack
* Fix bug clean_openstack if the function return a None
* fix bug of cleaning the openstack env, the tenant"service" cannot be deleted
* Add debug information for ports in clean_openstack
* Change print statement to logger.debug for the separator in clean_openstack
* Fix bug clean_openstack if there are no users and tenants
* Fix bug clean_openstack if there are no networks
* Add path to credentials env variable in Docker file
* Add clean_openstack script call in clean functest environment
* Update rally commit to version 0.1.1
* Fix run_rally.py to create image using glance python client
* Creation of image using python glance client instead of CLI
* Add openstack cleanup after running the tests
* Add template for BGPVPN test case in run_tests.sh
* Add a flag to push the results to the DB optionaly
* OpenStack cleanup script
* Adding BGPVPN repository to the Docker image and scripts
* Run tempest from docker using run_tempest
* First upload of Functest Doc for Brahmaputra
* Remove gsutil python module in the docker image
* fix path bug add / in cofig file for rally res dir
* fix path for rally result
* fiw path bug for run_rally remove HOME as path are now absolute path in docker file
* Add gsutil python module in the docker image
* Add WORKDIR in Dockerfile
* Create a common network for functest for all the tests
* Add test dependencies in Functest config files to know if the tescase/test suite can be run (or not)
* Add ssh 700 rights to the .ssh directory in the docker image
* condensing python code in utils check_credentials
* Add support of joid, apex and compass when running odl
* Add functions to retrieve POD name in Functest
* Add cinder python client library to Docker container
* Added customized tempest test case list
* Clean Functest repo, dashboard fully migrated to Releng
* Don't check for env variables if openstack credentials are given
* use joid rather juju
* Rally 'module' parameter not needed any more
* Refactoring of committers
* Use only Rally as tescase name
* [functest] modify functest prepare scripts to adapt compass
* Bugfix: cloudify deployment error
* Add possibility to give Openstack creds file to the docker container
* add load of functest-img-rally for vm and cinder tests
* Bugfix: test payload value
* Updated vIMS result format
* Change default order of tests
* Fix so that given config_functest.yaml is copied to functest repo dir
* Add vIMS test-case in run_tests script
* Added functionnal test and push result to db
* Fix error when deleting the network in vPing test
* Small correction of the --test flag in run_test.sh
* Move creation of glance image to vPing
* Reversed: Added reset to rally commit ID in prepare_env.sh
* Added reset to rally commit ID in prepare_env.sh
* ODL script bugfixes
* PGP network problems Fix
* vIMS test integration and move "push_results_to_db" method
* Move git clone of ODL tests repo to Dockefile
* Include cirros image in the docker container
* Add possibility to run specific set of tests
* Refactor Functest docker container
* Remove start.sh in the dockerfile since it is splitted by 2 scripts
* Removed ODL create_env from config_functest.py
* Change duration to integer seconds in tempest results
* set nb test run and failure tests as int
* change expected response to 404
* ODL test suite requirements.pip moved to general requirements
* Create run_tempest out of run_rally
* refactor run-rally and integrate API to push results into DB heavier refactoring due to new verison of Rally will probably needed
* Bugfix: Add default DNS on subnet
* Move the configuration from test scripts to config_functest.yaml
* Bugfix: venv path
* Bugfix: venv path
* intergrate the basic function senario and testcases in TESTON
* Fix version number return
* forget to clean push function in vPing
* add functions in utils and fix vPing
* Write a simple adapter in functest project to run TESTON
* remove chitti.nimmagadda@ericsson.com fro committer list
* Use new client script to run onos test
* Bugfix: urllib-->urllib2
* Create demo.sh cloned from start.sh to run Functest demos without executing the full Rally bench suites
* Add small checks to avoid possible 'No such file or directory' errors in the Docker automation procedure
* Bigfix : function "download_and_add_image_on_glance"
* Fix rally installation path in config yaml file
* update of the INFO file
* Add 2 libraries for Rally to the Functest Dockerfile
* Dockerfile for Functest
* vIMS deployment and cleanup
* Added configure_tempest() function
* Use new environment script to setup env to run onos function test JIRA:FUNCTEST-60
* Write a simple adapter in functest project to run TESTON JIRA:FUNCTEST-46
* Add get_networks_list function in functest_utils.py
* Add SLA to Rally test cases
* Use new connection script to be the connection adapter to run onos JIRA:FUNCTEST-59
* Adapt installation of Tempest from rally with new command line https://review.openstack.org/#/c/225479/
* Removed command 'exit 0'
* Fix for ODL suite
* Minor corrections for SR1
* added flag --yes to install_rally to force install dependencies
* added yum install of needed packages on jumphost
* onos-test:basic frame work of running onos TestOn test
* creation of scripts to generate Dashboard compatible json result files
* Adding some methods on functest_utils.py
* Remove OS_REGION_NAME from OpenStack credentials check
* clean INFO file
* script to transfor vPing raw results into a json file to be used by the future dashboard
* change vPing to push results in Test DB
* Baseline of mobility traffic profile. JIRA: FUNCTEST-33
* workaround order of env settings to all ODL tests to be run
* README for vIMS testcase Note that vIMS shall be also documented in the global functest rst guideline
* first upload for traffic profiles management
* add 3 new commiters and remove 2 ghost committers iMeeting minutes approving the 3 new committers: http://ircbot.wl.linuxfoundation.org/meetings/opnfv-meeting/2015/opnfv-meeting.2015-07-07-12.59.html
* Add check for ownership in ~/.cache/pip
* Doc: added required libraries and python modules JIRA: FUNCTEST-9
* config_functest.py: Rally installed with sudo JIRA: FUNCTEST-19
* Doc: Fixed weird chars for the tree directory structure JIRA: FUNCTEST-9
* functet_utils: bugfix check_internet_connectivity except JIRA: FUNCTEST-17
* replace default web site for testing internet connectivity previous one was filtered in China
* Doc: adapted table page 6. "The procedure to set up functional testing environment can be described as follow:" JIRA: FUNCTEST-9
* Doc: adapted image size for pdf as Victor suggested JIRA: FUNCTEST-9
* modify functest config to prepare result folder
* remove date stamping in run_rally rally results shall be pushed to result folder but date stamping shall be done at CI level not test by test
* Put ToC after heading
* fix ODL image bug
* Update for Arno
* config_functest.py : bugfix: removed "sudo" from installing rally command JIRA: FUNCTEST-10
* functest_utils.py : bugfix: logg-->logger JIRA: FUNCTEST-10
* update doc for Arno
* remove unused doc file
* correct doc after CI job refactoring
* vPing.py: Fixed IPs for VMs, Not DHCP JIRA: FUNCTEST-3
* Improvements - Added: functest_utils.py for common util functions - Moved: a lot of functions from config_functest.py to functest_utils.py - Moved: create of functest-net from config_functest.py to vPing.py - Improvements and code cleaned
* Fix relative path issue in custom test
* fix absolute/relative issue in start_test.sh
* vPing.py: bugfix: removed cgit download of scenarios JIRA: FUNCTEST-3
* Refactor functest environment. Bugfixes: arguments missing
* Refactor functest environment. Bugfixes: arg dependencies
* Refactor functest environment. Config_functest.yaml comments added. Depends on: https://gerrit.opnfv.org/gerrit/#/c/642/
* Refactor functest environment Depends on: https://gerrit.opnfv.org/gerrit/#/c/642/
* vPing.py: bugfix: EXIT_CODE not defined JIRA: FUNCTEST-3
* Add $BASEDIR var to all paths
* due to cleaning issue the order of the tests may have some consequences. Running list of images first reduce the risk of false errors
* This version of script was tested on POD1 manualy
* vPing.py: added timeout when building the VMs JIRA: FUNCTEST-3
* fix bug due to removal of VM scenario
* remove test VM to test CI (could be reintrouduced later)
* run_rally.py: added consistent path for functest.yaml JIRA:FUNCTEST-1
* Fix requests scenario for rally bench suite (re import from rally)
* fix cinder scenario bug (bad scenario format)
* config_functest.py : added --force flag to force clean functest without prompting. JIRA: FUNCTEST-10
* Corrected project lead
* config_functet.py: bug while creating router and interface. Other minor improvements. JIRA: FUNCTEST-10
* remove heat from the list of rally benchs to execute for R1 (out of scope)
* change default public network name in VM scenario
* change result structure, put all results in a date directory instead of suffixing file with date
* fix link error, rename default pre loaded image, change formating for config function description
* vPing.py: code cleaned. JIRA: FUNCTEST-3
* Doc updates:   vPing picture updated to check console for ping   Removed configuration of external network
* change default image name for bench testing
* Change default image name for tests (in ligne with config script), use the one preloaded by the config script
* vPing.py : changed #cloud-config to inject an sh script functest.yaml : vPing works now with a Cirros image JIRA: FUNCTEST-3
* config_functest.py : removed public network creating
* fix bug on error detection
* config.py bug fix: NEUTRON_NET_NAME parameter changed to NEUTRON_PRIVATE_NET_NAME
* Updated doc with more info about functest_config.py JIRA: FUNCTEST-9
* config_functest.py: 1) Added create public network. 2) functest.yaml is now copied instead of downloaded. JIRA: FUNCTEST-10
* Added links to voting results for new commiters
* Update doc, include config_functest.py, remove manual operations, remove vIMS testcase
* config_functest.py: added create neutron network. vPing.py: some adaptations and bug fixes JIRA: FUNCTEST-1 JIRA: FUNCTEST-3
* config_functest.py download functest.yaml if not present
* Added functest.yaml to centralize the common parameters for all scripts of functest adapted scripts to get the parameters from the yaml
* vPing.py: improved, updated and working with Ubuntu Cloud image. TBD: get deployment from a functest configuration file
* Added smoke bench scenarios: complete smoke and green list of working tests. Include smoke as input parameter for run_rally.py to run as bench test. JIRA: FUNCTEST-2
* update of the script, change tempest management, set smoke test by default, generate log file for Tempest result
* config_functest.py: added ODL config support
* change path to create rally forlder and scenarios+results subfolders, change image for vping to Ubuntu
* config_functest.py: improved output and error handling. Added download of run_rally.py
* Script for creating virtual environment added
* config_functest.py: Added Rally and Robot automatic installation and configuration
* Added first draft config_functest.py
* Remove unused image
* Remove not used image
* reformat CI part, add vPing description, remove images, replace them with ASCII description
* Add 2 new committers. Vote by Mail 10+1 on 14 voters 2 mail address no more responding, correct 1 (with alternate known address)
* run_rally: added quotas and requests as input parameters
* JIRA:FUNCTEST-1 -run_rally: added cinder as input parameter and other minor changes
* JIRA:FUNCTEST-1 -removed multibackend bench test in opnfv-cinder.json
* add bench scenario for glance
* Add links to images
* Add figure for rst document
* update python script to manage Rally bench tests, add help section, exclude Tempest from all bench tests
* Add Rally request scenario in OPNFV Rally scenario
* First upload of vPing script, one of the 5 functest testcase. This Hello world example consists in - Booting 2 VMs - Performing basic Ping - Check the Ping
* Update document for functest R1, add description section, split tooling installation from test running, add illustration
* Moved functest.rst under docs/ and removed docs/main.rst
* Remove hardcoded path, retrieve scenario file dynamically, create results and scenario folder
* small fixes to script starting odl suite
* Script for starting Robotframework ODL suites
* Renamed and moved functest.rst as docs/main.rst
* Complete Automation section Correct previous sections: installation tools on jumphost server (not in a dedicated VM) Minor wording correction
* script to launch Rally bench scenario per module or all one after the other from CI the script get the test ID and generate reporting
* Add Rally based bench scenario for OPNFV Add md document to explain how to install Rally and run test manually towards OPNFV solution
* Add ODL tests from ODL integration suites
* Functional test documentation
* Adding LICENSE file (whitespace removed)
* JIRA: FUNCTEST-8 Adding the INFO file with committers and key project facts inserted
* Adding .gitreview to functest more information at https://wiki.opendaylight.org/view/Git-review_Workflow
* Initial empty repository
