azure / azure-functions-integration-tests Goto Github PK
View Code? Open in Web Editor NEWIntegration test infrastructure for Azure Functions
License: MIT License
Integration test infrastructure for Azure Functions
License: MIT License
This work item depends on setting up windows private stamp.
Here is an example of an issue that should be detected early or prevented: Azure/azure-functions-host#6545
Create a pipeline at each worker repro (example below focuses on the PowerShell)
Create a pipeline in the azure-function-integration-tests that checks out the Host dev branch, updates the references of the packages for the workers (created in 1), and builds the Host bits using the build-extensions.ps1
script.
Create a pipeline in the Core Tools or azure-function-integration-tests repo to build the Core Tools
Update existing Host pipeline to update the references of the packages for the PowerShell worker, build Host bits using the build-extensions.ps1 script. Push nuget package to our internal DevOps Artifacts feed
cc @safihamid
Tracking item to figure out how to automate ColdStart JIT Trace as part of nightly builds
Enumerate exact steps needed to update both the Rapid Update feed and the host bits in the associated storage account
time estimation: 3 days
1 day
After Azure/azure-functions-powershell-worker#521 is fixed, add an E2E test validating this
@brettsam - when you get a chance can you please add details here for metadata generator integration tests? Is this a good repo to track adding tests for this?
If this is not the right place, please close this issue.
1d
Possible options to look into are DevOps Releases or a Durable function.
Research options for a reporting system. This will depend on the type of orchestrator option.
Functions metrics tests
For the August demo, set test function app in Consumption and Premium and look at function executions. Send an email notification instead of ICM
Currently, if the request to Dev Ops for the build status fails, we failed the whole task. We should add retry logic and fail after 3 retries. For sample failed task, see https://azfunc.visualstudio.com/Azure%20Functions/_releaseProgress?releaseId=3371&_a=release-environment-logs&environmentId=6733#.
Create a function app which will:
time estimation: 5d
Research orchestrator options for the Integration Tests build.
Possible options are:
Automate those steps with a script
time estimation: 5 days
Create a pipeline in the Core Tools or azure-function-integration-tests repo to build the Core Tools
4d
1d
The commit id is returned with the build information after the pipeline is started.
cc @safihamid
Tracking item to figure out how to automate ColdStart JIT Trace as part of nightly builds
Create new Azure DevOps pipeline to build and execute the PowerShell E2E tests. These will need to run in the context of Integration Tests using the latest prerelease version of the Core Tools.
Create a pipeline in the PowerShell worker repo, build worker, skip tests, push nuget package to our internal DevOps Artifacts feed
Update PowerShell E2E tests to run in the context of Integration Tests (using the latest prerelease version of the Core Tools)
Once the private stamp is set up:
enumerate steps needed to run the tests themselves on the private stamp
answer the following question: How to schedule tests? How to run the tests? Where to see the test results?
Investigate both Windows and Linux scenarios
time estimation: 5 days
2d
Research private stamp testing using the latest Host and worker bits from the nightly build.
We will need these details for the test plan review which will take place at the end of August 2020.
Here is some additional details from the workitem (https://github.com/pragnagopa/azure-functions-integration-tests/issues/1) that @pragnagopa created on her repo.
Please reach out to her in case you have any questions on this area.
Here is a potential flow to get started, but again, I could be missing important details.
Once you have this information, please add it to the test doc.
Schedule Host pipeline to build for integration tests
Push the Functions zip package to blob storage
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.