Comments (4)
Hi!
Did you use dense_training.ini
or dense_training_ndc.ini
? For the LLFF datasets, we generated our results with NDC sampling, so you'll likely want to use dense_training_ndc.ini
first.
In particular, for Fern, we used lossWeights = [0.005, 1.0]
. If this does not resolve your issue, we can follow up with more debugging :)
from adanerf.
Hi! Thank you for your quick response.
I tried with dense_training_ndc.ini with lossWeights = [0.005, 1.0], and succeeded on dense training!
I have some additional questions,
I also tried fine training with the ndc file, and I got some gray areas with small sample numbers ( < 16)
Is there particular parameters, such as adaptiveSamplingThreshold, for Fern dataset?
And when I ran test.py, I think it takes me about 1 second to render depth and rgb image. (504x376 resolution)
Is it slower than the results in the paper because I didn't use Tensor RT and cuda?
from adanerf.
Awesome that you got the dense training to run, that's great news.
Could you maybe clarify what exactly you mean by "gray areas", i.e., which output has these gray areas?
In the mean time we'll check to see if there are some parameters or other things that could cause such an issue.
About the test/inference performance: The results in our paper regarding run-time performance were computed on our TensorRT/CUDA viewer (which we will upload soon - stay tuned).
from adanerf.
I'm very excited to hear test viewer will be uploaded soon!
I guess when my fine-tuned network fails to locate depth, it gets blurry or gives gray color.
In fern dataset, I got some gray part on top-left window, top-right ceiling, bottom-right floor, and some blurry leaves.
I had similar results on DONeRF dataset pavillon and classroom, the sky and ceiling were covered gray.
Comparing estimated_depth images, the gray areas are more yellow in dense training and more purple in fine training. (Probably yellow areas are closer and purple areas are farther in depth image?)
So I thought sampling network gave shading network wrong depth, and shading network failed to produce the right color.
I got satisfying result with sample_num=16, but I found it hard to fine-tune the network with smaller sample_num.
I tried training with adaptiveSamplingThreshold=0.2, 0.1, 0.001, lossWeights = [0.005, 1.0], and used latest relu and nerf weights of dense training for pretrained weights.
from adanerf.
Related Issues (9)
- Potential for a AMD ROCm port? HOT 1
- unrecognized arguments: --numRayMarchSamples 8 --numRayMarchSamples 8 HOT 2
- Generate more images! HOT 2
- Where can I find supplementary material? HOT 1
- X Error of failed request: GLXBadFBConfig
- about Epoch HOT 5
- Fine-tuning stage process and filtering sample adaptively
- Image output quality when using Plenoxel with the DONeRF Dataset
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from adanerf.