Giter VIP home page Giter VIP logo

Comments (2)

matthewturk avatar matthewturk commented on August 23, 2024

@Xarthisius I think you and possibly @cindytsai have looked at this. Would you be able to take this on and look at producing some simple scaling plots, even if they don't demonstrate great performance?

from yt-4.0-paper.

Xarthisius avatar Xarthisius commented on August 23, 2024

I found something I did on 03/08/2023:

import time
import yt
from yt.config import ytcfg

yt.enable_parallelism()

ds = yt.load("/dpool/kacperk/second_star/DD0182/DD0182")
ds.index

start_time = time.time()
v, c = ds.find_max(("gas", "density"))
if yt.is_root():
    print(v, c)
    max_time = time.time() - start_time
    print("--- (max) %.2f seconds ---" % max_time)

start_time = time.time()
p = yt.ProjectionPlot(ds, "z", ("gas", "density"), width=(1.0, 'unitary'))

if yt.is_root():
    prj_time = time.time() - start_time
    print("--- (prj) %.2f seconds ---" % prj_time)
    nprocs = int(ytcfg.get("yt", "internals", "global_parallel_size")) 
    with open("results.csv", "a") as fp:
        fp.write("%i,%.2f,%.2f\n" % (nprocs, max_time , prj_time))
    p.save()

Run via:

#!/bin/bash

for i in {1..10}; do
   for n in 1 2 4 8 16 32 ; do
       mpiexec -n $n -bind-to core python canary.py --parallel
   done
done

on Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz (20 cores, but 40 with HT)

Results:
results.csv

You explained to me why max was so slow and not scaling on slack, but it's lost in +30d history and I don't remember.

from yt-4.0-paper.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.