Comments (2)
Hey @jpoberhauser, thanks for checking out the repo!
Currently we do not support multi-agent pose estimation. While we think the techniques we've introduced (context architecture, unsupervised losses) will work in this problem setting, we have not yet pursued this.
However, we have been experimenting with the ensemble kalman smoother in the multi-agent setting with good results, so if you have some multi-agent data I'd suggest trying that out. You can find the repo here: https://github.com/paninski-lab/eks.
The repo contains example scripts, including this most basic one that just uses temporal information (no pose pca/multiview information): https://github.com/paninski-lab/eks/blob/main/scripts/singlecam_example.py. This would be the easiest place to start.
from lightning-pose.
Thanks for the info. I will certainly take a look.
from lightning-pose.
Related Issues (20)
- scripts/predict_new_vids.py should save loss metrics as csv HOT 6
- TypeError: entry_points() got an unexpected keyword argument 'group' HOT 9
- Query regarding use of Filtered_predictions in LightningPose model HOT 1
- Error loading checkpoint for vit_b_sam backbone
- multiple csv files HOT 2
- how to carry out multi-GPU with lightning-pose? HOT 1
- error in prediction HOT 2
- how to set up min_epochs and max_epochs HOT 5
- how to understand unlabeled frames vs temporal context frames? HOT 3
- How many labeled frames should we have? HOT 3
- Starts training from specific checkpoint HOT 3
- any manual refining and re-training function in lightning pose? HOT 1
- Compatible with Windows? HOT 22
- Set different temporal loss parameters for each body parts HOT 2
- support for avi formats HOT 2
- issue with lightning pose installation HOT 3
- Pose-app crushed at the last moment of training. HOT 2
- can lightning pose predict images? HOT 6
- Would it be possible to use a pretrained model (such as Topview Mouse from DLC animal zoo)? HOT 3
- Issue with installing HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from lightning-pose.