Libraries and scripts for crawling the TYPO3 page tree. Used for re-caching, re-indexing, publishing applications etc.

Please see the Wiki Pages for Release notes and Known issues.

Please read the documentation

To render the documentation locally, please use the official TYPO3 Documentation rendering Docker Tool. https://github.com/t3docs/docker-render-documentation

When you have a PR, please run the following checks first.

• composer test:all
  • Requires a mysql-database, you can boot one with docker-compose from the .Docker-directory
• composer cs-fix
  • Ensures that coding standards are respected
• composer analyse
  • Will run PHPStan and do a static code analysis, this is not adjust completely in build yet, but please try to avoid adding new violations. ;)

If you don't have a setup already, where you can do development, bugfixing etc. for the crawler, don't worry.

We have included a ddev devbox to help the development.

• DDEV
• Docker

$ git clone [email protected]:AOEpeople/crawler.git
$ cd .devbox
$ ddev start

And start working.

INFO xdebug is disable as default, to speed up the devbox when xdebug isn't needed.

This can be activated in .devbox/.ddev/config.yaml and by ddev restart afterwards.