Running GEM on large graphs - memory isses about gem HOT 7 CLOSED

On Oct 30, 2017 3:18 AM, "Stephen Bonner" ***@***.***> wrote: Hey Palash, Thanks so much for the work on this! I've been trying to replicate your results for SDNE on some of the larger graphs in your paper. However i always hit an out of memory error when the code is trying to allocate a numpy zeros array for the adjacency matrix. I was wondering how you managed to over come this and if we could make improvements to the code to help running with larger datasets? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_palash1992_GEM_issues_13&d=DwMCaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=I_A-ZJGnHcHAuxuBmINQ-Q&m=ZpZ5Si8wf2P0-zg6Ibu3UlUF2pJxwuc_wRkYLvBjXDo&s=uoHzsmFQksszVhpqb3YJdVN8wSbKVXkESpCHiCJqnso&e=>, or mute the thread <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_ABH2Rdi4OPccDE3FOsq28b0QfAsL7NTiks5sxaKPgaJpZM4QK8ya&d=DwMCaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=I_A-ZJGnHcHAuxuBmINQ-Q&m=ZpZ5Si8wf2P0-zg6Ibu3UlUF2pJxwuc_wRkYLvBjXDo&s=-D8SMr5UZeH9ph4PBY06NELG6Xsi25wVxk84DldCt3M&e=> .

On Oct 30, 2017 9:33 AM, "Stephen Bonner" ***@***.***> wrote: Hi Palash, Thanks so much for this, i look forward to seeing the code. I thought it would be possible as i guess you only require the current batch of adjacency matrix rows? Many thanks! — You are receiving this because you commented. Reply to this email directly, view it on GitHub <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_palash1992_GEM_issues_13-23issuecomment-2D340503130&d=DwMCaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=I_A-ZJGnHcHAuxuBmINQ-Q&m=Afim-otwXRu-G5UvzW3WqMe62NVBhVl1vWpud6j-d-Y&s=llZHu7LXTFgdi5Y7UBnXMLy66rVt_xmgMPWDC7CijPc&e=>, or mute the thread <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_ABH2RQslPOql0RN0PamDvQQRyFi4Hugcks5sxfpXgaJpZM4QK8ya&d=DwMCaQ&c=clK7kQUTWtAVEOVIgvi0NU5BOUHhpN0H8p7CSfnc_gI&r=I_A-ZJGnHcHAuxuBmINQ-Q&m=Afim-otwXRu-G5UvzW3WqMe62NVBhVl1vWpud6j-d-Y&s=9S4WUfo7VeVrmPAu0ZnRbNLqvUrU4MG2YsPuUjIVuAQ&e=> .