Giter VIP home page Giter VIP logo

chirodiff's Introduction

Hello ๐Ÿ‘‹, I am Ayan Das (@dasayan05)

I am a full-time Senior AI Research Scientist at MediaTek Research UK, working on Diffusion Models & Generative AI in general. I am also about to finish my Ph.D. (writing thesis) at SketchX Lab, University of Surrey working in the field of Vision and Graphics. My focus is on analysing and modelling human sketches and drawings from a computational as well as theretical perspective.

โšก๏ธ Me in a nutshell:

  • Love programming: C/C++, Python for daily job & Lisp, Julia, Web Technologies (moderate-level) for fun.
  • Fond of Math: Daily research work involves lot of maths like Linear Algebra, Probabilities and Optimization.
  • Love to teach: Eager to share knowledge; publish full-fledged (comprehensive) blogs/articles on various research topics.
  • Voluntary: Serving as reviewer at top conferences (NeurIPS, CVPR, ECCV, ICCV, BMVC, SIGGRAPH) and journals (TMLR, Elsevier NN).
  • Extra: Love Music, Junk foods and Animals (specially Cats).

๐Ÿ“ Portfolio:

Research Papers Projects Blogs/Articles
1. DEIS-SN: Score normalization .. 1. A modular Deep RL library 1. Score & Diffusion Models ..
2. Shortest-Path Diffusion 2. Typst-AI-conf-templates 2. Differentiable Programming: Computing ..
3. ChiroDiff: Modelling chirographic data ... 3. anyx (in progress) 3. Energy Based Models (EBMs) ..
4. SketchODE: Learning sketch representation .. 4. Probabilistic Programming ..
Full List .. More ..

Go through my personal website "ayandas.me" to know more about me and my work. Want to contact me? Check out the Contact Page.

chirodiff's People

Contributors

dasayan05 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

chirodiff's Issues

Issues on training model "_classcond"

Hey! I was trying to play with threeseqdel_classcond (or threeseqabs_classcond) however two problems came out.

  1. preprocessing the directory into a .npz is not possible, i.g.
python data/qd.py /the/output/dir/cat threeseqdel_classcond

raises errors

Traceback (most recent call last):
  File "SOMEPATH/chirodiff_test/data/qd.py", line 281, in <module>
    dummy_sample = ds[0]
  File "SOMEPATH/chirodiff_test/data/qd.py", line 140, in __getitem__
    return self.represent(self.get_sketch(i))
  File "SOMEPATHchirodiff_test/data/qd.py", line 201, in represent
    label = torch.tensor(sketch.label, dtype=torch.int64)
TypeError: an integer is required (got type NoneType)
  1. If i skip this step as suggested in README.md, and start the training. In the config.yml, I changed repr into threeseqdel_classcond. And for example, under the /the/output/dir/ I have two folders, cat and dog, seperately including some sketches, and therefore I setup num_classes: typing.Optional[int] = 2 in config.yml , as suggesed in ln 74 in main.py, and therefor I have root_dir in config.yml to be /the/output/dir/, and naturally the error becomes
SOMEPATH/pytorch_lightning/utilities/data.py:103: UserWarning: Total length of `CombinedLoader` across ranks is zero. Please make sure this was your intention.
  rank_zero_warn(
`Trainer.fit` stopped: No training batches.

I guess this could be easily fixed if you could remind some special settings/path selections specifically for the class condition?

Many thanks!

training problem

Thanks for you work! when i training follow your guidance, i have a error as follows, can you give me some suggestions? Thank you vey much.

Traceback (most recent call last):
File "/home/libj/LBJ/chirodiff2/main.py", line 692, in
cli = LightningCLI(SketchDiffusion, GenericDM, run=True,
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 515, in init
self.setup_parser(run, main_kwargs, subparser_kwargs)
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 551, in setup_parser
self._add_subcommands(self.parser, **subparser_kwargs)
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 624, in _add_subcommands
subcommand_parser = self._prepare_subcommand_parser(trainer_class, subcommand, **kwargs.get(subcommand, {}))
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 632, in _prepare_subcommand_parser
self._add_arguments(parser)
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 594, in _add_arguments
parser.add_lr_scheduler_args(LR_SCHEDULER_REGISTRY.classes)
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 213, in add_lr_scheduler_args
self.add_subclass_arguments(lr_scheduler_class, nested_key, **kwargs)
File "/home/libj/.conda/envs/CONTROLNET2/lib/python3.8/site-packages/jsonargparse/_signatures.py", line 503, in add_subclass_arguments
raise ValueError(f"Expected 'baseclass' argument to be a class or a tuple of classes: {baseclass}")
ValueError: Expected 'baseclass' argument to be a class or a tuple of classes: ()

The version of jsonargparse

Hello, I have the following problem while running the "python main.py fit --config config.yml --model.arch_layer 3 --model.noise_T 100 ..." command. Is this something to do with the jsonargparse version?

(M2021-YDY-chirodiff) M2021-YDY@hndx-R8424-G12:~/chirodiff-master$ python main.py fit --config config.yml --model.arch_layer 3 --model.noise_T 100 ...
Traceback (most recent call last):
  File "main.py", line 692, in <module>
    cli = LightningCLI(SketchDiffusion, GenericDM, run=True,
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 515, in __init__
    self.setup_parser(run, main_kwargs, subparser_kwargs)
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 551, in setup_parser
    self._add_subcommands(self.parser, **subparser_kwargs)
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 624, in _add_subcommands
    subcommand_parser = self._prepare_subcommand_parser(trainer_class, subcommand, **kwargs.get(subcommand, {}))
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 632, in _prepare_subcommand_parser
    self._add_arguments(parser)
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 594, in _add_arguments
    parser.add_lr_scheduler_args(LR_SCHEDULER_REGISTRY.classes)
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/pytorch_lightning/utilities/cli.py", line 213, in add_lr_scheduler_args
    self.add_subclass_arguments(lr_scheduler_class, nested_key, **kwargs)
  File "/home/hndx/anaconda3/envs/M2021-YDY-chirodiff/lib/python3.8/site-packages/jsonargparse/signatures.py", line 477, in add_subclass_arguments
    doc_group = get_doc_short_description(baseclass[0], logger=self.logger)
IndexError: tuple index out of range

My version of jsonargparse is as followsjsonargparse 4.21.2

My Python version is 3.8.17 and pytorch-lightning version is 1.5.9

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.