Scripts used for SBI/NBI Testing
License: Apache License 2.0
| ni | bgp | export-policy |
|---|---|---|
| ni | bgp | import-policy |
We should divide the test cases in two rpcs each one
After the execution of the test, leave the modified fields as they were before testing. If the object was not created before the test, that object should be deleted in the tear down
| ni | protocol_tables | import-policy |
|---|
Is better if we divide this in 2 rpcs
For having an agnostic framework, try to make this process generic. Understand this as the identification and creation of the params, not the serialization
All common hw tests leave them in hw_component.yml.
Correct xml
Detection of the name of the variables needed for all tests from the GET operation, and automatic application in the respective YML.
Date: 02/10/2020
Username: Javier Benito
Issue: Selective test run
As a:
Currently, we have three ways to run the tests, By block, e.g.
By YML, e.g.
or by specific testcase, e.g.
I want:
The tool should have an interface where you can select which test you want to run:
So that:
This application will save time when testing in the different phases of testing because you can select the tests to launch faster instead of having to search for the specific command
Accept Criteria:
Testing tool.
Change from edit-config to get
In the dependencies, leave just the version of the library. The build is a requisite very complex to fulfill across platforms.
Implement a way to quickly insert or modify tests from the XML template for IP tests
Implement a dicard changes y cancel commit before the execution of each test
it would be possible for example to remove the discard-changes operation, or to choose the type of target (candidate or running) for edit-config tests.
Some devices do not support commit and only have a running datastore. Check solution for this.
- testcase:
name: if_ethernet_duplex_mode
id: 2
description: >
This test is to define the duplex mode in an interface.
rpcs:
- template: if_ethernet_duplex_mode.xml
target: candidate
operation: edit-config
commit: true
params:
name: "GigabitEthernet0/0/0/4"
duplex_mode: "FULL"
rpcs:
- template: if_ethernet_duplex_mode.xml
target: candidate
operation: edit-config
commit: true
params:
name: "GigabitEthernet0/0/0/4"
duplex_mode: "HALF"
| ni | rt_policy | export-policy |
|---|---|---|
| ni | rt_policy | import-policy |
Is better if we divide it in 2 different rpcs for each test cases
Date: 02/10/2020
Username: Daniel Hernández
Issue: XML Schema comparison according to Openconfig models. #125
As a:
Currently, we don't have a tool to compare any OC standards models with the vendor implementation.
Each network equipment has yang files charged in a folder, each yang files corresponding with the vendor implementation of OC models.
For example, there is an OC model (openconfig-routing-policy.yang) and the vendor implementation is (oc-routing-policy.yang).
At this moment we must review manually the correct standard compliance (paths of the parameters, parameters mandatories, value types) and compare with the corresponding OC model.
And determine the implementation deviation percentage of each vendor with their details and knows which one's parameters it does not support.
I want:
A tool that compares the OC Models standard with the implementation vendors OC, introducing both model's paths and generate an excel report with the below information:
Deviation percentage according to differences like a (paths of parameters, parameters mandatories, and value types).
List of differences (path of parameters, parameters mandatories, and value types.) showing which one is the correct path and the incorrect path, correct parameters mandatories and incorrect parameters mandatories, correct value types, and incorrect value types.
Which parameters are missing in the OC model implementation of the vendor.
This must compare with the standard OC models.
So that:
It will permit, that we will know the real support percentage of vendors per model and determine which parameters are supported or has any deviation to make the XML and YML according to this information. Other benefits without a doubt are the time that we must spend looking for parameter deviations.
Accept Criteria:
Testing tool.
For having an agnostic framework, try to make this process generic. For parsing we understand the serialization of the attributes from the xml responses
Use python logging library to generate the logs.
The ncclient logs are available at "'ncclient.manager'
logging.getLogger('ncclient.manager')
logger.setLevel(logging.DEBUG)
In case of get operations, it works good. But in case of edit-config, it does not work properly. Need to re-check where close session is made.
| ni | interface | interface |
|---|---|---|
| ni | interface | subinterface |
is better if we divide the test case in two rpcs
Now we have multiple branches, one per vendor.
For the results, just create a folder per vendor instead of using the same folder in different branches.
For the code, examine in detail the differences for each vendor and create "profiles" or "plugins" for the parts of the code that require adaptation.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.