Giter VIP home page Giter VIP logo

Comments (13)

PagelsR avatar PagelsR commented on June 3, 2024 1

I will start over and try again. Here is my pipeline and how I'm publishing results, got an example of your YML?

image

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024 1

I'm sure you're right, so I'll need to start over. Very strange for sure, I'm following your post (https://www.npmjs.com/package/@alex_neo/playwright-azure-reporter) to the letter.

The only pipeline command is "npx playwright test".

My used publish command isn't necessary I guess.

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024 1

Ha! I'm getting closer. Again, my work org may not allow Tokens. I'll try creating a new Token 1st. If not, I will all all this with my personal ADO account.

image

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024 1

Success!!!

Created new PAT, scope = Build, Release, and Test Management. I think this fixed it. But just in case, I changed token name to "AZURE_TOKEN", updated in playwright.config.ts file. Added to pipeline as variable. Done! now works like a charm, execution history, test runs, and report.

Thank you so much for the help Alex!

from playwright-azure-reporter.

alexneo2003 avatar alexneo2003 commented on June 3, 2024

Hi.
Sorry, but I don't know why it won't work for you. For me it work as expected, I can see executions history

Screenshot_2024-02-23-19-38-56-45_40deb401b9ffe8e1df2f1cc5ba480b12.jpg

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024

That's awesome and 100% what I'm expecting to see. Hmmm?

Where in ADO are you looking at this list "Test Case Results"? Maybe I'm looking in the wrong place. From Test Plans, Runs? From Build Pipeline output?

Is your screenshot from Azure DevOps Service or Server? I can't find the area where your screenshot is from

Does the ADO Token need to have FULL scope permissions?

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024

Does your Progress Report also get updated? Mine does not, not from any automation.

image

from playwright-azure-reporter.

alexneo2003 avatar alexneo2003 commented on June 3, 2024

@PagelsR sorry for delay
I open history from Test Plan - Test Case - More options - View executions history
Also I have not so perfect testcases)
Screenshot 2024-02-27 at 10 32 15

and also I have "Progress report"
Screenshot 2024-02-27 at 10 32 46

Can you check pipeline log? It should be contain log like "azure: Result published: {test case title}"

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024

So strange for sure. My Tests run successfully and results say they published. When I look at Execution History, I might see a few results.

Screenshot 2024-03-02 142940

I've run my pipeline dozens of times since Feb 8, so inconsistent.
Screenshot 2024-03-02 143513

I love how your progress report gets updated too, nice!!!

Is there any chance any way, you can give me "reader" on access to a ADO Team Project with all of thi working? Give to "[email protected]" account. Then maybe I can view how your setup is. If not, no worries.

Thank you Alex for the help.

from playwright-azure-reporter.

alexneo2003 avatar alexneo2003 commented on June 3, 2024

@PagelsR are you sure that you use correct package and steps to publish test results to ADO. because what I see does not correspond to the logs from this package, something else!

from playwright-azure-reporter.

alexneo2003 avatar alexneo2003 commented on June 3, 2024

@PagelsR let me ask you again - are you sure that you use correct package and steps to publish test results to ADO
because you doesn't use THIS package!! you used "PublishTestResults@2" task - it's ADO task, not mine package!

from playwright-azure-reporter.

PagelsR avatar PagelsR commented on June 3, 2024

Make me wonder if the ADO Org I created a Token from, is blocking updates. I might try your 2nd choice for orgURL

from playwright-azure-reporter.

alexneo2003 avatar alexneo2003 commented on June 3, 2024

Very strange for sure, I'm following your post to the letter.

maybe you weren't very careful but readme doesn't contain any things about pipeline
you used one thing but thought about another

for use this package for publishing test results you need to configure reporter section inside playwright.config.ts file and you test results will be published together with test run

from playwright-azure-reporter.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.