Security Crawl Maze is a comprehensive testbed for web security crawlers. It contains pages representing many ways in which one can link resources from a valid HTML document.
License: Apache License 2.0
I dont think the JavaScript Framework pages are set up correctly.
angular/ link (the others act in the same way)routerLink navigation linkbutton event handler navigation buttonIn these cases the following URLs are put into the URL bar:
In neither case are any requests made by the browser - checked in both Chrome, Firefox and using dev tools + ZAP.
In any case the above URLs both return "Not Found" - the correct URLs to detect are:
So it looks like theres a missing test/ at the start of the URL paths.
Is this a bug or am I misunderstanding how these tests work?
Ran into an issue building the docker image. Looks like it's because this part of the docker image was not using a pinned version.
RUN npm install -g @angular/cli
I was getting this error
Text of the error:
docker build -t crawlmaze .
[+] Building 109.8s (24/37) docker:desktop-linux
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 2.68kB 0.0s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 2B 0.0s
=> [internal] load metadata for docker.io/library/alpine:3.9 4.3s
=> [internal] load metadata for docker.io/library/node:14-alpine 4.1s
=> [auth] library/node:pull token for registry-1.docker.io 0.0s
=> [auth] library/alpine:pull token for registry-1.docker.io 0.0s
=> [builder 1/16] FROM docker.io/library/node:14-alpine@sha256:434215b487a329c9e867202ff89e704d3a75e554822e07f3e0c0f9e606121b33 5.3s
=> => resolve docker.io/library/node:14-alpine@sha256:434215b487a329c9e867202ff89e704d3a75e554822e07f3e0c0f9e606121b33 0.0s
=> => sha256:434215b487a329c9e867202ff89e704d3a75e554822e07f3e0c0f9e606121b33 1.43kB / 1.43kB 0.0s
=> => sha256:3380ed827b250d2db2bd38c15f090af2b303b3c9ebb42f5927cb5b9adeea7a6e 1.16kB / 1.16kB 0.0s
=> => sha256:d561716d42b6a03639723c382c62977347ed62f13925e836614583253308e6c3 6.45kB / 6.45kB 0.0s
=> => sha256:c41833b44d910632b415cd89a9cdaa4d62c9725dc56c99a7ddadafd6719960f9 3.26MB / 3.26MB 0.9s
=> => sha256:683339ce8d6b9be2ca150a8de67b895e20ea5594b91d3911c95b0b8fea3e314c 36.99MB / 36.99MB 4.0s
=> => sha256:4cf6a83c0e2af3c780abcda02cc33f9e812fdcb40b610ed1838281cc9ab94ec8 2.43MB / 2.43MB 1.5s
=> => extracting sha256:c41833b44d910632b415cd89a9cdaa4d62c9725dc56c99a7ddadafd6719960f9 0.1s
=> => sha256:686172e40c38722891b4004f55f6447548c8367968ac523a612591e0d92f9db3 447B / 447B 1.3s
=> => extracting sha256:683339ce8d6b9be2ca150a8de67b895e20ea5594b91d3911c95b0b8fea3e314c 1.2s
=> => extracting sha256:4cf6a83c0e2af3c780abcda02cc33f9e812fdcb40b610ed1838281cc9ab94ec8 0.0s
=> => extracting sha256:686172e40c38722891b4004f55f6447548c8367968ac523a612591e0d92f9db3 0.0s
=> [internal] load build context 0.0s
=> => transferring context: 107.14kB 0.0s
=> [stage-1 1/14] FROM docker.io/library/alpine:3.9@sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011 0.8s
=> => resolve docker.io/library/alpine:3.9@sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011 0.0s
=> => sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011 1.64kB / 1.64kB 0.0s
=> => sha256:f920ccc826134587fffcf1ddc6b2a554947e0f1a5ae5264bbf3435da5b2e8e61 528B / 528B 0.0s
=> => sha256:9afdd4a290bf60cc642c5c85a91da9e08d3908d16b8fc96b8efd65716c02f0bb 1.51kB / 1.51kB 0.0s
=> => sha256:941f399634ec37b35e6764d0e6cf350593652f06f76586d45ddfc0d77de7a701 2.69MB / 2.69MB 0.7s
=> => extracting sha256:941f399634ec37b35e6764d0e6cf350593652f06f76586d45ddfc0d77de7a701 0.0s
=> [stage-1 2/14] RUN apk add --no-cache python3 && python3 -m ensurepip && rm -r /usr/lib/python*/ensurepip && pip3 16.1s
=> [builder 2/16] RUN npm config set unsafe-perm true 0.3s
=> [builder 3/16] RUN npm install -g @angular/cli 34.1s
=> [stage-1 3/14] COPY requirements.txt /usr/src/app/ 0.0s
=> [stage-1 4/14] RUN pip install -r /usr/src/app/requirements.txt 4.3s
=> [stage-1 5/14] COPY app.py /usr/src/app/ 0.0s
=> [stage-1 6/14] COPY blueprints /usr/src/app/blueprints 0.0s
=> [stage-1 7/14] COPY templates /usr/src/app/templates 0.0s
=> [stage-1 8/14] COPY test-cases /usr/src/app/test-cases 0.0s
=> [stage-1 9/14] RUN rm -rf /usr/src/app/test-cases/javascript/frameworks/angular/* 0.1s
=> [builder 4/16] RUN npm install -g polymer-cli 31.7s
=> [builder 5/16] COPY test-cases/javascript/frameworks/angular /tmp/angular 0.0s
=> [builder 6/16] WORKDIR /tmp/angular 0.0s
=> [builder 7/16] RUN npm install 33.9s
=> ERROR [builder 8/16] RUN ng build --prod --baseHref=/javascript/frameworks/angular/ 0.1s
------
> [builder 8/16] RUN ng build --prod --baseHref=/javascript/frameworks/angular/:
0.124 Node.js version v14.21.3 detected.
0.124 The Angular CLI requires a minimum Node.js version of v18.13.
0.124
0.124 Please update your Node.js version or visit https://nodejs.org/ for additional instructions.
0.124
------
Dockerfile:18
--------------------
16 | WORKDIR /tmp/angular
17 | RUN npm install
18 | >>> RUN ng build --prod --baseHref=/javascript/frameworks/angular/
19 |
20 | # Build Polymer app.
--------------------
ERROR: failed to solve: process "/bin/sh -c ng build --prod --baseHref=/javascript/frameworks/angular/" did not complete successfully: exit code: 3
View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/c2s3yrfszkrejvql1od0wla56
To fix it, I had to change that line of code to a version of Angular CLI that supports Node 14.
Here is what it looks like when I build the image after the fix:
I'll submit this as a PR shortly.
I was looking to see if the docker version had the same problem as #8 but it doesnt build :(
Used docker build -t crawlmaze .
=> [builder 7/16] RUN npm install 34.7s
=> ERROR [builder 8/16] RUN ng build --prod --baseHref=/javascript/frameworks/angular/ 0.3s
------
> [builder 8/16] RUN ng build --prod --baseHref=/javascript/frameworks/angular/:
#24 0.264 Node.js version v10.24.1 detected.
#24 0.264 The Angular CLI requires a minimum Node.js version of either v12.20, v14.15, or v16.10.
#24 0.264
#24 0.264 Please update your Node.js version or visit https://nodejs.org/ for additional instructions.
#24 0.264
------
executor failed running [/bin/sh -c ng build --prod --baseHref=/javascript/frameworks/angular/]: exit code: 3
Is there a published image anywhere?
Doesnt appear to be one on DockerHub: https://hub.docker.com/search?q=crawlmaze
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.