Comments (6)
What do you mean by barebones php?
from php-framework-benchmark.
No framework at all. Basically just uncomment
php-framework-benchmark/list.sh
Line 4 in 963f129
from php-framework-benchmark.
As you know, no-framework is just echo
ing Hello Word!
. But all the frameworks do more than just echo
ing Hello Word!
.
Do you think it makes sense to compare them? I doubt it.
If you compare them, can you know how much slower your app becomes by using a framework vs plain php? Absolutely no. It is impossible! Because hello world is not your app.
This benchmarking tries to measure minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.
from php-framework-benchmark.
Do you think it makes sense to compare them? I doubt it.
It makes much more sense to compare all the frameworks against the least common denominator, ie a PHP request that produces some output, than to have the relative numbers be against whichever framework that happens to be fastest during the test.
If you compare them, can you know how much slower your app becomes by using a framework vs plain php? Absolutely no. It is impossible! Because hello world is not your app.
This benchmarking tries to measure minimum overhead (minimum bootstrap cost) of PHP frameworks in the real world.
Of course "Hello World" is not your app. However, the minimum bootstrap cost of PHP frameworks is NOT what is being measured in the benchmark currently. It also includes the cost of the request being made, the PHP interpreter to be loaded in memory and output being transferred to the client. All these things affect the throughput, memory and response time. However, by measuring the throughput, memory and the response time of "No framework", we get to know the results that are completely based on the hardware/OS/stack and NOT including any bootstrap cost of a PHP framework. By comparing this "base level" result and the results of a framework, we get the actual minimum bootstrap cost of that framework.
This makes it possible to get an idea of the minimum bootstrap cost also of the fastest performing framework, which otherwise just gets the relative performance values of "1.0".
It also makes the relative numbers more comparable across different benchmarks where for some reason the same frameworks could not be tested (like in the case of HHVM with Phalcon and Ice).
The "No framework" option does not however need to be listed alongside the other frameworks in case you believe that causes confusion, all I am saying is that it makes sense to compare the "relative" numbers against the no-framework case.
from php-framework-benchmark.
Here is en example comparison against no-framework, including reversed relative throughput results (#39):
|framework |requests per second|relative|peak memory|relative|
|-------------------|------------------:|-------:|----------:|-------:|
|no-framework | 1,304.82| 100.0| 0.22| 1.0|
|phalcon-2.0 | 685.55| 52.5| 0.27| 1.2|
|ice-1.0 | 630.68| 48.3| 0.26| 1.2|
|tipsy-0.10 | 774.88| 59.4| 0.32| 1.4|
|fatfree-3.5 | 447.52| 34.3| 0.43| 1.9|
|slim-2.6 | 627.34| 48.1| 0.48| 2.1|
|ci-3.0 | 101.57| 7.8| 0.43| 1.9|
|nofuss-1.2 | 216.13| 16.6| 0.59| 2.6|
|slim-3.0 | 441.98| 33.9| 0.62| 2.8|
|bear-1.0 | 42.33| 3.2| 0.77| 3.4|
|lumen-5.1 | 270.75| 20.7| 0.00| 0.0|
|ze-1.0 | 259.65| 19.9| 0.80| 3.6|
|radar-1.0-dev | 249.12| 19.1| 0.71| 3.2|
|yii-2.0 | 259.94| 19.9| 1.36| 6.0|
|silex-1.3 | 329.12| 25.2| 0.00| 0.0|
|cygnite-1.3 | 116.15| 8.9| 0.76| 3.4|
|fuel-1.8-dev | 55.94| 4.3| 0.71| 3.2|
|phpixie-3.2 | 77.97| 6.0| 1.30| 5.8|
|aura-2.0 | 121.80| 9.3| 0.90| 4.0|
|cake-3.1 | 147.86| 11.3| 0.00| 0.0|
|symfony-2.7 | 56.43| 4.3| 0.00| 0.0|
|laravel-5.1 | 88.32| 6.8| 0.00| 0.0|
|zf-2.5 | 18.91| 1.4| 3.00| 13.3|
|typo3f-3.0 | 0.20| 0.0| 0.00| 0.0|
from php-framework-benchmark.
Please re-open since the issue is not fixed yet.
To re-cap, only by using a no-framework baseline can the actual performance of the frameworks be evaluated neutrally, without having to be dependent on which framework happens to be the fastest in a particular instance.
This is particularly relevant when running benchmarks on your own setup, since it may not be feasible to get phalcon/ice up and running. In that case, it will still be possible to get relevant relative numbers if a comparison to no-framework is included.
from php-framework-benchmark.
Related Issues (20)
- Mako framework?
- Nova Framework
- 'ab' is not fast enough HOT 5
- Framework Request: CodeIgniter 3 and 4? HOT 1
- Phalcon 3.0 + PHP 7 HOT 2
- Command Not Found? HOT 2
- typo3f-3.0 setup is broken HOT 4
- Raw php echo and include? HOT 2
- Seperate Framework, Micro-Framework, Library chart HOT 2
- [Feature request] Can you add Kraken as well?
- Can you add Nette please?
- Cakphp is faster than phalcon??? HOT 5
- [feature request] can you add easy-php as well?
- yaf yaf yaf
- O2System PHP Framework Benchmark HOT 1
- Bench AltoRouter and Klein.php HOT 1
- Error HOT 2
- php micro & router framework benchmark
- Flash web framework benchmark
- Add Unic Framework
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from php-framework-benchmark.