lttlabsoss / markbench-tests Goto Github PK
View Code? Open in Web Editor NEWHome of test harnesses used in LTT Labs MarkBench
License: GNU General Public License v3.0
Home of test harnesses used in LTT Labs MarkBench
License: GNU General Public License v3.0
No response
Hello,
My question is mainly about the game selected, and not to the program itself.
I noticed a while back that atomic heart was one of the games selected for benchmarking, and I didn't know where to better forward my question, so I hope that this is the most appropriate one.
AH is a very controversial game due to where it is being developed and where the revenue from this game goes, example:
https://www.denofgeek.com/games/atomic-heart-controversy-explained-boycott-protests-ukraine/
For me and my Ukrainian friends who watch various LTT channels, it was always sad to see this game being used (and effectively indirectly promoted) for benchmarking.
I don't ask to have a political stance here or anything like that. But please consider that out of all the recent games that were released this one is probably the only one that is that controversial, and I understand that you didn't know this part (it was only briefly mentioned a couple of times on TechLinked).
Replacing this game for benchmarking would be something huge for your Ukrainian audience.
I just wanted to give you a bit of context from one slice of your audience.
Thank you
No response
No response
No response
When viewing the CONTRIBUTE.md
you provide a link to your CODE_OF_CONDUCT.md
file however this link is incorrect.
This link points to: https://github.com/LTTLabsOSS/markbench-tests/blob/main/blob/master/CODE_OF_CONDUCT.m
The branch master doesn't exist, it should point to: https://github.com/LTTLabsOSS/markbench-tests/blob/main/CODE_OF_CONDUCT.md
Change to https://github.com/LTTLabsOSS/markbench-tests/blob/main/CODE_OF_CONDUCT.md
No response
No response
- MarkBench Test Version: commit 34ddbefaeda3192926c1f0459f790848e07f859a
- OS: Win11
- GPU: Intel Arc A770
- CPU: amd 5600x
When running poetry install
with a completely fresh python 3.11.5 install it complains about pyyaml (6.0) not supporting PEP 517 builds
and suggesting to run pip wheel --use-pep517 "pyyaml (==6.0)"
but after running that nothing changes.
Installing dependencies from lock file
Package operations: 1 install, 0 updates, 0 removals
• Installing pyyaml (6.0)
ChefBuildError
Backend subprocess exited when trying to invoke get_requires_for_build_wheel
running egg_info
writing lib\PyYAML.egg-info\PKG-INFO
writing dependency_links to lib\PyYAML.egg-info\dependency_links.txt
writing top-level names to lib\PyYAML.egg-info\top_level.txt
Traceback (most recent call last):
File "C:\Users\hello\AppData\Roaming\pypoetry\venv\Lib\site-packages\pyproject_hooks\_in_process\_in_process.py", line 353, in <module>
main()
File "C:\Users\hello\AppData\Roaming\pypoetry\venv\Lib\site-packages\pyproject_hooks\_in_process\_in_process.py", line 335, in main
json_out['return_val'] = hook(**hook_input['kwargs'])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\hello\AppData\Roaming\pypoetry\venv\Lib\site-packages\pyproject_hooks\_in_process\_in_process.py", line 118, in get_requires_for_build_wheel
return hook(config_settings)
^^^^^^^^^^^^^^^^^^^^^
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\build_meta.py", line 355, in get_requires_for_build_wheel
return self._get_build_requires(config_settings, requirements=['wheel'])
self.run_setup()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\build_meta.py", line 341, in run_setup
exec(code, locals())
File "<string>", line 288, in <module>
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\dist.py", line 989, in run_command
super().run_command(command)
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\command\egg_info.py", line 318, in run
self.find_sources()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\command\egg_info.py", line 326, in find_sources
mm.run()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\command\egg_info.py", line 548, in run
self.add_defaults()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\command\egg_info.py", line 586, in add_defaults
sdist.add_defaults(self)
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\command\sdist.py", line 113, in add_defaults
super().add_defaults()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\command\sdist.py", line 251, in add_defaults
self._add_defaults_ext()
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\command\sdist.py", line 336, in _add_defaults_ext
self.filelist.extend(build_ext.get_source_files())
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<string>", line 204, in get_source_files
File "G:\Temp\tmpss1jx_vg\.venv\Lib\site-packages\setuptools\_distutils\cmd.py", line 107, in __getattr__
raise AttributeError(attr)
AttributeError: cython_sources
at ~\AppData\Roaming\pypoetry\venv\Lib\site-packages\poetry\installation\chef.py:147 in _prepare
143│
144│ error = ChefBuildError("\n\n".join(message_parts))
145│
146│ if error is not None:
→ 147│ raise error from None
148│
149│ return path
150│
151│ def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:
Note: This error originates from the build backend, and is likely not a problem with poetry but with pyyaml (6.0) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "pyyaml (==6.0)"'.
No response
- MarkBench Test Version: Latest
- OS: N/A
- GPU: N/A
- CPU: N/A
For various reasons, including importing an existing steam library, Uninstall entries for steam apps may not be written to registry. This may cause get_app_install_location to return empty erroneously
A better flow would be the following:
I am not great with python but I can attempt to make a pull request if wanted.
No response
No response
For more general users who aren't familiar with programming or even the command line, a single executable file would simplify the launch process for these people.
There are a few solutions to this, such as:
pyinstaller
program to generate the executable. It may take a bit of work to get the proper files and dependences packaged into the executable, but it is relatively straightforward.py2exe
program. Similar to pyinstaller
Nuitka
program to compile and package the code. Whereas the prior two solutions package the python code and an entire python runtime into a single executable, Nuitka
instead compiles portions of the code down to C for a decent gain in performance (depending on the workload). This may take more work than either of the other solutions, but it'll make the overall program performance much better on top of being packaged into an executable.You may also consider creating GitHub Actions to automate this compiling / packaging / releasing process.
First of all: Thank you for open sourcing what you have! It's wonderful to see the work being shared.
I was wondering if there was intention to open source the markbench tool itself. Having reviewed the code in this repo I would love to contribute, but without markbench being available it will be very hard to ensure changes don't break compatability. At the very least it would be great to get some kind of documentation, or test cases, which help make sure that interface isn't broken.
Again, thanks for open sourcing this repo. I look forward to what else your team has in store. :)
- MarkBench Test Version: 1.0.0
- OS: Windows 11 22H2
- GPU: RX 6650M
- CPU: Ryzen 7 6800H
I am trying to make a harness for Furmark but I am having some issues.
python .\furmark_runner.py --benchmark_mode "GPU stress test" --resolution "1920x1080" --resolution_scale "2x" --anti_aliasing "4x MSAA" is the command that I am running and all it does it open FurMark and then doesnt do anything.
This is my YMAL Manifest :
friendly_name: "FurMark Benchmark"
executable: "FurMark.exe"
process_name: "FurMark.exe"
disable_presentmon: false
hidden: 1
output_dir: "results"
options:
This is my python script: (Copy and Paste from your github since I am new to this and learning)
import os
import sys
DEFAULT_FURMARK_DIR = "C:\Program Files (x86)\Geeks3D\Benchmarks\FurMark"
EXECUTABLE = "FurMark.exe"
ABS_EXECUTABLE_PATH = os.path.join(DEFAULT_FURMARK_DIR, EXECUTABLE)
if not os.path.isfile(ABS_EXECUTABLE_PATH):
raise ValueError('No FurMark installation detected! Default installation expected to be present on the system.')
args = sys.argv[1:]
command = f'"{ABS_EXECUTABLE_PATH}" '
for arg in args:
command += arg + ' '
command = command.rstrip()
os.system(command)
File name is furmark_runner.py
No response
No response
- MarkBench Test Version: 1.0.0
- OS: Win 11 22H2
- GPU: RX 6650M
- CPU: Ryzen 7 6800H
When running python .\msikombuster.py --test vkfurrytorus --resolution "1080,1920" -b true , it will launch with iGPU instead of dGPU. What do I need to do to ensure that it always launches with the correct GPU? When going into device manager and disabling the iGPU, only then will it launch with the dGPU. Please help :P
No response
No response
No response
cs 2 replaced csgo
No response
No response
As recent threadripper videos have referenced, there are some chips and gpus that are targets at AI Engineers.
It would be nice for there to be a standardized test harness for evaluating Hardware for LLM usage.
Here's a bit of background on the goals and objectives of evaluating an LLM:
https://www.baseten.co/blog/llm-transformer-inference-guide/
I will note this is a complex and ever-evolving field and fully understand if this is closed without comment.
I also acknowledge this may not be something you want to be wholly responsible for and instead call to a service that does this.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.