There is a error during loading data about pyirt HOT 8 CLOSED

good job !!! However, I can't wait to fix it and wrote a tensorflow_irt by myself 23333

from pyirt.

Hi, WallE-Chang! I'm having the same situation here.
Although I was able to run it successfully once, now I see this error log

(Have you found any solution?)

2018-09-21 16:38:48 INFO: start loading data
start loading data
************************** ['11001138433007', '11001138433007'] ['1', '2'] [1, 0]
2018-09-21 16:38:48 INFO: data loaded
data loaded
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 639.77it/s]
0%| | 0/2 [00:00<?, ?it/s]6666666666666666666666666666666666666CHAMADAGET_MAP 0
TTTTTTTTTTTTTTTTTTTTTTTTTTTTTTGET_MAP3 ['1', '0']

--- Logging error ---
Traceback (most recent call last):
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 368, in update
map_user_idx_vec = self.dao.get_map(item_idx, ['1', '0'])
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in get_map
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
KeyError: 0

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3.6/logging/init.py", line 993, in emit
msg = self.format(record)
File "/usr/lib/python3.6/logging/init.py", line 839, in format
return fmt.format(record)
File "/usr/lib/python3.6/logging/init.py", line 576, in format
record.message = record.getMessage()
File "/usr/lib/python3.6/logging/init.py", line 338, in getMessage
msg = msg % self.args
TypeError: not all arguments converted during string formatting
Call stack:
File "", line 1, in
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/_pyirt.py", line 46, in irt
mod.solve_EM()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 101, in solve_EM
self._exp_step()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 161, in _exp_step
self.__get_expect_count()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 395, in __get_expect_count
procs = procs_operator(procs, 7200, 0.1)
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 27, in procs_operator
p.start()
File "/usr/lib/python3.6/multiprocessing/process.py", line 105, in start
self._popen = self._Popen(self)
File "/usr/lib/python3.6/multiprocessing/context.py", line 223, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
File "/usr/lib/python3.6/multiprocessing/context.py", line 277, in _Popen
return Popen(process_obj)
File "/usr/lib/python3.6/multiprocessing/popen_fork.py", line 19, in init
self._launch(process_obj)
File "/usr/lib/python3.6/multiprocessing/popen_fork.py", line 73, in _launch
code = process_obj._bootstrap()
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 374, in update
self.logger.critical("Unexpected error:", str(e))
Message: 'Unexpected error:'
Arguments: ('0',)
--- Logging error ---
Traceback (most recent call last):
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 368, in update
map_user_idx_vec = self.dao.get_map(item_idx, ['1', '0'])
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in get_map
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
KeyError: 0

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/python3.6/logging/init.py", line 993, in emit
msg = self.format(record)
File "/usr/lib/python3.6/logging/init.py", line 839, in format
return fmt.format(record)
File "/usr/lib/python3.6/logging/init.py", line 576, in format
record.message = record.getMessage()
File "/usr/lib/python3.6/logging/init.py", line 338, in getMessage
msg = msg % self.args
TypeError: not all arguments converted during string formatting
Call stack:
File "", line 1, in
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/_pyirt.py", line 46, in irt
mod.solve_EM()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 101, in solve_EM
self._exp_step()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 161, in _exp_step
self.__get_expect_count()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 395, in __get_expect_count
procs = procs_operator(procs, 7200, 0.1)
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 27, in procs_operator
p.start()
File "/usr/lib/python3.6/multiprocessing/process.py", line 105, in start
self._popen = self._Popen(self)
File "/usr/lib/python3.6/multiprocessing/context.py", line 223, in _Popen
return _default_context.get_context().Process._Popen(process_obj)
File "/usr/lib/python3.6/multiprocessing/context.py", line 277, in _Popen
return Popen(process_obj)
File "/usr/lib/python3.6/multiprocessing/popen_fork.py", line 19, in init
self._launch(process_obj)
File "/usr/lib/python3.6/multiprocessing/popen_fork.py", line 73, in _launch
code = process_obj._bootstrap()
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 374, in update
self.logger.critical("Unexpected error:", str(e))
Message: 'Unexpected error:'
Arguments: ('0',)
Process Process-4:
Traceback (most recent call last):
File "/usr/lib/python3.6/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 375, in update
raise e
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 368, in update
map_user_idx_vec = self.dao.get_map(item_idx, ['1', '0'])
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in get_map
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/dao.py", line 152, in
return [self.database.item2user_map[str(ans_key)][item_idx] for ans_key in ans_key_list]
KeyError: 0
Traceback (most recent call last):
File "", line 1, in
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/_pyirt.py", line 46, in irt
mod.solve_EM()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 101, in solve_EM
self._exp_step()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 161, in _exp_step
self.__get_expect_count()
File "/home/graciela/descomplica/pyirt/pyirt/pyirt/solver/model.py", line 400, in __get_expect_count
self.item_expected_right_by_theta[:, item_idx] = procs_repo[item_idx][1]
File "", line 2, in getitem
File "/usr/lib/python3.6/multiprocessing/managers.py", line 772, in _callmethod
raise convert_to_error(kind, result)
KeyError: 0

from pyirt.

Hi, guys. Thanks for reporting the bug. This bug likely to be caused by a mismatch when pyirt map the long format to user2item and item2user sparse storage. Can you kindly share the data with me so that I can use it as unit-test in the bug-fix test.

from pyirt.

Hi the issue is still persisting. Is it fixed in the latest release?

from pyirt.

I think the problem should be fixed @ 0.3.4, which is just released on pypi. However, I never get to add the unittest so I cannot be sure it is so. I re-open this issue so if it is not fixed, pls let me know.

from pyirt.

Hi I updated to 0.3.4.

Its working now. Thanks a lot :).

from pyirt.

I would love to see that on your github if you can share it. I did not even know you can put structure on neural network

from pyirt.

@junchenfeng Sorry, I can not share it owing of copyright of my ex company. However, you can use gradient decent replacing EM algorithm.

from pyirt.