A tool for measuring changes in Ember to applications.
This uses chrome-tracing and har-remix to measure the effects of small changes to Ember on applications.
This is also a demonstration of using these tools to measure applications.
These instructions assume Mac and using homebrew.
Install R
brew tap homebrew/science
brew install r
Run R
R
Then install R packages:
install.packages("jsonlite")
install.packages("R6")
install.packages("ggplot2")
q()
Install yarn
brew install yarn
git clone [email protected]:krisselden/ember-macro-benchmark.git
cd ember-macro-benchmark
yarn
Edit the config.json
- har: the emberaddons.com HAR file, the example is a recording of emberaddons.com built with Ember 2.13.0-beta.1
- ember: path to an ember dist to splice into the vendor.js, the example results were tested against Ember commit 2c45a3b.
- dist: path to full emberaddons.com build. Use this when testing ember
versions that require wire format changes. Note that you must use an
unfingerprinted production build.
- If the
dist
property is set you may also setfingerprinted
to false to ensure that assets are correctly served when you have opted out of fingerprinting. Iffingerprinted
is undefined it will assume assets are fingerprinted.
- If the
Caveat: the templates are in the recorded app, you can only test with an Ember with compatible template wire-format as the recording.
yarn run serve
yarn run bench
To generate the report run:
yarn run plot
Which will generate a PDF in the results
folder with the reports from Chrome Tracing. It contains several graphs and plots for. Here are a few resources to help you read them:
If you'd like to see a smaller summary in your CLI you can run:
yarn run report
Which will give you an abbreviated report.