Hence, I get a you haven‘t selected your testing profile error.

Quite clearly related to my enhancements in #32

Steps:

1. go to "view test results" and do some filtering options
2. go to "home"
3. go back to "view test results"
   Issue: all filters are lost except the "conformance levels" radio buttons. i think that all filters should be kept throughout the session. if not then also the conformance levels" should be reset.

http://www.w3.org/WAI/accessibility-support/dev/#/test.html/ARIA1_0000082 click "open test page" it seems like a dead link?

Page: "details for technique h44 ..."
Issue: put list of test cases above the table (right under the heading "Test cases covering this technique"), and add new heading after that "Combined results for all test cases" (the table needs a separate heading from the test cases)

Note: consider putting the test cases into a table rather than a list.

To reproduce:

1. Go to Browse test results
2. Wait for the table to load

What should happen: There should be a loading indicator there.

would be good to have a back-button somewhere within the UI, for example to go back to the techniques results from test case results. the button could simply use the browser history to go back, so that the users go back to the pages that they came from.

Page: "details for test h44_0000034 ..."
Issue: make "Screen reader use the for attribute [...]" a sub-title ("Details for Test H44_0000034" should be the prominent heading)

Note: rename "Test" to "Test Case" in the heading too, please

make the entire row clickable on "select testing environment page"

Page: first page under "browse test results"
Issue: add a "clear filters" button or link somewhere on the left

After completing a test, I chose the "Skip test" button to see what
happened.
"Skip test and load next" button took me out of all selected tests, with no
apparent way back.
http://www.w3.org/WAI/accessibility-support/dev/#/test-run.html
I had a number of tests left to run, so expected to be taken to the next
one. If this was the intended result, then the button needs a "Skip all
further tests" label, and the landing page needs some clear instruction on
what to do next. If this is just a bug, then ignore me.

The content when adding an environment is not saved when you choose to edit the text having saved the profile

The layout in Safari on Mac, is broken for the home screen for the a11y support DB. See attached. Safari 7 and FF 30.

HTH

Josh

please add a confirmation that the user successfully logged out

http://www.w3.org/WAI/accessibility-support/dev/#/results-details.html/type/Technique/typevalue/H44/ua/Firefox/uaver/28/at/NVDA/atver/2013.3

does not show any content

Page: "details for technique h44 ..."
Step:

1. from "browse test results click on technique "H44"
2. filter for "Jaws"
   Issue: you get a table with 1 row for "Jaws" (correct) but three columns with "Internet Explorer 10" as "Not tested" -- that column should not be displayed.

If you repeat the steps of Issue #5, the heading reads

“Browse Test Results for Technique H49, Internet Explorer 11 with Jaws 15”

Expected:

“Browse Test Results for Technique C8, Internet Explorer 11 with NVDA 2013.3”

Browser: Firefox 29
Page: first page under "browse test results"
Issue: right-arrow in column "passed" appears outside the button
(screen shot sent to Eric)

rotating icons to communicate that data is loading need to stop rotating (movement) after 3 seconds or else they technically fail WCAG 2.0

Page: Run Test Cases -> Select Testing Environment
Issue: "Profile name" (and "Description") are not used -- maybe add the "Profile Name" in the "Select" column beside the radio button?

issue: first page says "View test results" and when you select that, you get to a page with the title "Browse test results" -- we should decide on one of the terms and use it consistently. need to check with EOWG on this one.

1. No "completed" flag on the "Select Profile" item in the progress bar on:
   http://www.w3.org/WAI/accessibility-support/dev/#/tests-run.html

In test results the style for cells containing "Not tested" the color contrast is 2.13:1 and needs to be improved to meet the 4.5:1 ratio required by WCAG 2.0.

When I click a certain item, the reults are not what I expect them to be. Example:

1. Click on browse test results
2. Search for C8
3. Click the button on the right of C8
4. You get to a table which says: Firefox/NVDA: 0/1. Also 1 related test case is shown.
5. Click onto the 0/1 result in the table
6. There are many different test cases listed, not only the ones that belong to technique C8

(The endpoint URL is http://www.w3.org/WAI/accessibility-support/#/results-details.html/ua/Internet%20Explorer/uaver/11/at/NVDA/atver/2013.3/filter/{%22page%22:%22axsdb-page-results-technique%22,%22userName%22:null,%22criteriosLevel%22:%22AAA%22,%22criterios%22:[],%22technologies%22:[],%22techniques%22:[],%22tests%22:[],%22ats%22:[],%22uas%22:[],%22oss%22:[]} – calling it directly unfortunately breaks the page.)

Run tests: After creating a new environment, I can't select it when
using Firefox. The list of available environments remains empty. In
Internet explorer, it was possible to select a newly created
environment.

Page: "details for technique h44 ..."
Issue: make "Creating a logical tab order" a sub-title ("Details for Technique H44" should be the prominent heading)

On dev, if you

1. go to browse test results
2. click an expand button
3. the test cases appear but the button is not transformed to a collapse button.

(Reported by Bim.)

Page: first page under "browse test results"
Issue: add "N/A" when OS version numbers are not known (currently empty)

Page: first page under "browse test results"
Issue: use consistent order of the items in the table -- probably best alphabetically

It is impossible to create a new profile, when the page with the create profile is submitted, I get returned to the select profile page but there is no profile.

Logged in!

Page: first page under "browse test results"
Issue: add expand/collapse all buttons to the table of results

1. add a page heading "Add Testing Environment" or "Edit Testing Environment"
2. add this sentence after the heading "Define an environment that you want to use to run test cases"
3. change "Additional Information" label to "About the Environment" and put it as first group
4. change "Profile name" to "Name" and "Profile comment" to "Comment"

The collapse/expand buttons which are used to open/close sets of test
cases is not updated correctly with Jaws. When using NVDA, everything
seems to work well.

The progress bar give the impression that something is happening in the background. The progress bar is a visual tool to indicate that something is happening in the background, and the the user should wait until it is complete. This is indicating the number of tests run... perhaps change that to 2 out of 15 test completed, and update that, or provide dots to show, or some other indication. Progress bar is confusing.

Just an idea, as I came across that article this morning: http://blog.paciellogroup.com/2014/06/filing-bugs/

confirmation displayed after successful login is confusing. suggestions:

1. put a very clearly highlighted message "Login Successful" or such right at the top.
2. remove first paragraph ("Note that login is not required ...") including its heading ("Login"), the "Forgot your username/password link", and "Why Login?" heading including the first paragraph after that (but not the bulleted list).
3. add a small sentence "Now that you are logged in, you can:" before the bulleted list
4. adapt the bullet points accordingly ("Saving" -> "Save", "Options to receive" -> "Receive", "Overview of the test results" -> "View the test results", "Contributing to" -> "Contribute to").

Page: first page under "browse test results"
Issue: use only the handles for principles, guidelines, and success criteria:

Principle 1: Perceivable

• 1.1: Text Alternatives

  -- 1.1.1: Non-text Content

Note: you /could/ link these handles to the corresponding sections in WCAG 2.0 (with the "opens in new window" icon used elsewhere on the page)

Windows version is being misquoted in my profile. I have it as Windows 7,
but it is recorded as Windows 14.

Browser: Firefox 29
Page: "details for test h44_0000034 ..."
steps:

1. from "browse test results" page, select H44
2. from "details for techniques H44", select test case H44_0000034
   Issue: results do not appear

Note: same result if you select H44_0000034 directly from the "browse test results" page

please change message to "Username or password wrong." also consider using the same notification as for login/logout, rather than a dialog box.

Browser: Firefox 29
Page: first page under "browse test results"
Issue: when an item (technique) is expanded in the table, the button disappears and a collapse button is not displayed

As we use JavaScript for routing, non-external links are now buttons. /via Bim

Page: "Browse test results for technique H44, Firefox 28 with NVDA 2013.3"
Issue: remove the word "browse"

The HTML 5 required yields an error if no radio button is selected:

• If the user has no environment yet, the first created environment should be selected.
• If a user has one environment, this environment should be selected.
• If a user has more than one environment, the environment selected on the last previous set of tests should be selected. (If impossible, select the first one.)

a testing environment could have more than one plugin but currently there is no way to add more than one plugin

1. Browse test results
2. Click on the expand on ARIA 1
3. Click the button with the arrow for ARIA1_0000082

Result: An empty page
Expected result: Results for that use case.

Note: Might be related to things I chose on the Browse Test Results filter??

http://www.w3.org/WAI/accessibility-support/dev/#/results-test.html/ARIA1_0000082