Comments (3)
avik-pal
commented on May 18, 2024
1
I added it for ReshapedArray doesn't seem to have a dispatch for that
from lux.jl.
ianatol
commented on May 18, 2024
I think the poor broadcasting performance likely has to do with some missed chance to perform our memory optimization in the broadcast logic somewhere (i.e., we think it is unsafe to optimize in a place where it's actually safe to do so). I will take a look into this when I get a chance, but thanks for putting this together and providing a nice, realistic benchmark for performance going forward!
from lux.jl.
ianatol
commented on May 18, 2024
Also, minor nit, but ImmutableArray will copy by itself if we can't optimize, so don't think copy is necessary here:
make_immutable(x::AbstractArray) = ImmutableArray(copy(x))from lux.jl.
Related Issues (20)
- Allow "const" arrays as inputs to `@compact`
- Capture DifferentiationInterface calls for efficient Nested AD HOT 5
- Pullback over jacobian (with CUDA) HOT 4
- Zygote nested AD failure HOT 1
- Meta Issue for proper Enzyme Integration into Lux HOT 3
- Meta-Issue for improvements to `@compact`
- Rework ChainRules for DynamicExpressions HOT 1
- Nested AD for Parameter Gradient/Jacobian HOT 7
- Pullback over twice jacobian HOT 9
- Rewrite `@layer_map` to use KeyPath from Functors
- Extracting part of a model, with the corresponding parameters and states HOT 1
- Serializing/Deserializing Lux Models
- Differentiating `Zygote.pullback` HOT 9
- Batched Jacobian Functions
- Error for JVP by Enzyme HOT 6
- [Nested AD] Incorrect gradient when taking a gradient over a gradient using StatefulLuxLayer HOT 7
- batched_jacobian + CUDA => InvalidIRError HOT 2
- Add a compiled tape version for ReverseDiff
- SimpleChains integration doesn't work with Enzyme HOT 3
- Simple MLP requires Enzyme runtimeActivity HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lux.jl.