posthog / posthog-plugin-migrator3000 Goto Github PK

Migrate your events to a new PostHog instance.

License: MIT License

JavaScript 13.63% TypeScript 86.37%

posthog-plugin-migrator3000's Introduction

This app is no longer available on PostHog cloud, use Replicator instead.

PostHog Plugin: Migrator 3000

This plugin allows you to migrate events from one PostHog instance to another. You can migrate between self-hosted instances, or from a self-hosted instance to PostHog Cloud (and vice-versa).

Please note that this plugin will only migrate events and objects derived from events such as persons. Dashboards, insights, feature flags, etc. will not be migrated.

Installation

Self-hosted

Search for this plugin on the "Repository" tab of the plugins page (/plugins) and install it.

PostHog Cloud

This plugin will already be installed. Enable it from your plugins page.

Configuration

Host

Host of your PostHog instance (without http or https). Set this to app.posthog.com if migrating to PostHog Cloud.

Project API Key

Project API key (token) of the instance you wish to migrate to.

Date to start exporting from

Use format YYYY-MM-DD.

PostHog version

Self-hosted users can find their PostHog version from /instance/status

posthog-plugin-migrator3000's People

Contributors

Stargazers

Watchers

Forkers

flniu yakkomajuri stvhanna isabella232 dan-dr pluies novabenefits allanjard viniciusfaitao antonsacred

posthog-plugin-migrator3000's Issues

Ability to make it faster?

Hello - im currently migrating to PH cloud. We have used a reverse proxy to start sending events to PH cloud so our old instance is now just migrating events to PH cloud. I notice that its doing about 3-5 days of events each day.

I was wondering if it would make sense to have some option or lever that could try and control the flow/speed of events it migrates. It seems like its fairly conservative, which i liked and made sense when we were both receiving incoming events and replicating them to PH cloud and also trying to migrate at same time, but no I'd like it to go a big faster since there is still about 7-8 months of events on one project that I'd like it to migrate so we can scale our instances down to 0.

So really this is just an idea for future for some sort of way to engage "insane mode" or something and get the events migrating much faster if a user just wants speed over stability.

ability to migrate events from newest and backwards would be good

it would be good if would be possible to migrate most recent events first and work backwards. Since often more recent historic events are more important that the most recent.

Steps needed to run this plugin on cloud?

What do we need to do to run this on cloud? Are we concerned about people abusing this export/causing lots of resource usage for us?

@yakkomajuri

Done exporting all events, but can't see them

I'm migrating from a self-hosted version (Postgres) to a new Cloud org.

I launched the plugin, it says it migrated the events but when I refresh the events page from my new Posthog instance, I can't see any event.

Logs:

2021-11-10 08:09:00.185 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T06:54:00.027Z to  2021-11-10T07:04:00.027Z.
-- | -- | -- | --
2021-11-10 08:09:00.155 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:09:00.087 UTC | CONSOLE | LOG | Now starting export of events from 2021-11-10T06:54:00.027Z to 2021-11-10T07:09:00.032Z
2021-11-10 08:08:39.197 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T06:40:00.000Z to  2021-11-10T06:50:00.000Z.
2021-11-10 08:08:39.185 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Done exporting all events
2021-11-10 08:08:39.183 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T06:30:00.000Z to  2021-11-10T06:40:00.000Z.
2021-11-10 08:08:39.173 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.171 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.171 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T06:40:00.000Z to  2021-11-10T06:50:00.000Z.
2021-11-10 08:08:39.164 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T06:10:00.000Z to  2021-11-10T06:20:00.000Z.
2021-11-10 08:08:39.156 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.153 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T06:20:00.000Z to  2021-11-10T06:30:00.000Z.
2021-11-10 08:08:39.152 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.143 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T06:10:00.000Z to  2021-11-10T06:20:00.000Z.
2021-11-10 08:08:39.142 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.136 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T05:50:00.000Z to  2021-11-10T06:00:00.000Z.
2021-11-10 08:08:39.134 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.131 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.131 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T06:00:00.000Z to  2021-11-10T06:10:00.000Z.
2021-11-10 08:08:39.129 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T05:40:00.000Z to  2021-11-10T05:50:00.000Z.
2021-11-10 08:08:39.097 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.095 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.095 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T05:40:00.000Z to  2021-11-10T05:50:00.000Z.
2021-11-10 08:08:39.093 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T05:20:00.000Z to  2021-11-10T05:30:00.000Z.
2021-11-10 08:08:39.078 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.076 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T05:10:00.000Z to  2021-11-10T05:20:00.000Z.
2021-11-10 08:08:39.075 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.075 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T05:30:00.000Z to  2021-11-10T05:40:00.000Z.
2021-11-10 08:08:39.064 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.064 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T05:20:00.000Z to  2021-11-10T05:30:00.000Z.
2021-11-10 08:08:39.059 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.057 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T05:10:00.000Z to  2021-11-10T05:20:00.000Z.
2021-11-10 08:08:39.056 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.050 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:39.048 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T05:00:00.000Z to  2021-11-10T05:10:00.000Z.
2021-11-10 08:08:39.047 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.026 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T04:40:00.000Z to  2021-11-10T04:50:00.000Z.
2021-11-10 08:08:39.025 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:39.025 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T04:50:00.000Z to  2021-11-10T05:00:00.000Z.
2021-11-10 08:08:39.005 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T04:20:00.000Z to  2021-11-10T04:30:00.000Z.
2021-11-10 08:08:38.993 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.990 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.990 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T04:30:00.000Z to  2021-11-10T04:40:00.000Z.
2021-11-10 08:08:38.973 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.951 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T04:00:00.000Z to  2021-11-10T04:10:00.000Z.
2021-11-10 08:08:38.942 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T03:50:00.000Z to  2021-11-10T04:00:00.000Z.
2021-11-10 08:08:38.931 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.929 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.929 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T04:00:00.000Z to  2021-11-10T04:10:00.000Z.
2021-11-10 08:08:38.912 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T03:40:00.000Z to  2021-11-10T03:50:00.000Z.
2021-11-10 08:08:38.907 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.906 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.906 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T03:50:00.000Z to  2021-11-10T04:00:00.000Z.
2021-11-10 08:08:38.899 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T03:30:00.000Z to  2021-11-10T03:40:00.000Z.
2021-11-10 08:08:38.886 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.883 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.883 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T03:40:00.000Z to  2021-11-10T03:50:00.000Z.
2021-11-10 08:08:38.877 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T03:20:00.000Z to  2021-11-10T03:30:00.000Z.
2021-11-10 08:08:38.877 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.877 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T03:10:00.000Z to  2021-11-10T03:20:00.000Z.
2021-11-10 08:08:38.870 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T03:30:00.000Z to  2021-11-10T03:40:00.000Z.
2021-11-10 08:08:38.869 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.861 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.858 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T03:20:00.000Z to  2021-11-10T03:30:00.000Z.
2021-11-10 08:08:38.857 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.853 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T03:00:00.000Z to  2021-11-10T03:10:00.000Z.
2021-11-10 08:08:38.841 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.839 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.839 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T03:10:00.000Z to  2021-11-10T03:20:00.000Z.
2021-11-10 08:08:38.829 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.828 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T02:50:00.000Z to  2021-11-10T03:00:00.000Z.
2021-11-10 08:08:38.826 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.826 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T03:00:00.000Z to  2021-11-10T03:10:00.000Z.
2021-11-10 08:08:38.823 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T02:40:00.000Z to  2021-11-10T02:50:00.000Z.
2021-11-10 08:08:38.807 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T02:20:00.000Z to  2021-11-10T02:30:00.000Z.
2021-11-10 08:08:38.801 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.798 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T02:50:00.000Z to  2021-11-10T03:00:00.000Z.
2021-11-10 08:08:38.797 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.794 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T02:30:00.000Z to  2021-11-10T02:40:00.000Z.
2021-11-10 08:08:38.781 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.777 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T02:00:00.000Z to  2021-11-10T02:10:00.000Z.
2021-11-10 08:08:38.775 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T02:40:00.000Z to  2021-11-10T02:50:00.000Z.
2021-11-10 08:08:38.774 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.766 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.763 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T02:30:00.000Z to  2021-11-10T02:40:00.000Z.
2021-11-10 08:08:38.762 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.759 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T02:10:00.000Z to  2021-11-10T02:20:00.000Z.
2021-11-10 08:08:38.757 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.755 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.755 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-10T02:20:00.000Z to  2021-11-10T02:30:00.000Z.
2021-11-10 08:08:38.749 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T01:50:00.000Z to  2021-11-10T02:00:00.000Z.
2021-11-10 08:08:38.742 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.740 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.740 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T02:10:00.000Z to  2021-11-10T02:20:00.000Z.
2021-11-10 08:08:38.731 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.729 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.729 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T02:00:00.000Z to  2021-11-10T02:10:00.000Z.
2021-11-10 08:08:38.719 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-10T01:40:00.000Z to  2021-11-10T01:50:00.000Z.
2021-11-10 08:08:38.717 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-10T01:30:00.000Z to  2021-11-10T01:40:00.000Z.
2021-11-10 08:08:38.716 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T01:50:00.000Z to  2021-11-10T02:00:00.000Z.
2021-11-10 08:08:38.715 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.714 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.704 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:38.701 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:38.701 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-10T01:40:00.000Z to  2021-11-10T01:50:00.000Z.
2021-11-10 08:08:37.150 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:37.148 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T11:20:00.000Z to  2021-11-09T11:30:00.000Z.
2021-11-10 08:08:37.147 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.137 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:37.136 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T11:10:00.000Z to  2021-11-09T11:20:00.000Z.
2021-11-10 08:08:37.135 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.134 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T10:50:00.000Z to  2021-11-09T11:00:00.000Z.
2021-11-10 08:08:37.133 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:37.132 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T11:00:00.000Z to  2021-11-09T11:10:00.000Z.
2021-11-10 08:08:37.131 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.122 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T10:50:00.000Z to  2021-11-09T11:00:00.000Z.
2021-11-10 08:08:37.115 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.101 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:37.100 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.100 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T10:40:00.000Z to  2021-11-09T10:50:00.000Z.
2021-11-10 08:08:37.094 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T10:20:00.000Z to  2021-11-09T10:30:00.000Z.
2021-11-10 08:08:37.088 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T10:30:00.000Z to  2021-11-09T10:40:00.000Z.
2021-11-10 08:08:37.087 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.075 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:37.075 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T10:20:00.000Z to  2021-11-09T10:30:00.000Z.
2021-11-10 08:08:37.066 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T10:00:00.000Z to  2021-11-09T10:10:00.000Z.
2021-11-10 08:08:37.062 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:37.044 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T09:50:00.000Z to  2021-11-09T10:00:00.000Z.
2021-11-10 08:08:36.990 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.988 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.988 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T09:50:00.000Z to  2021-11-09T10:00:00.000Z.
2021-11-10 08:08:36.976 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.975 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.975 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T09:40:00.000Z to  2021-11-09T09:50:00.000Z.
2021-11-10 08:08:36.967 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T09:20:00.000Z to  2021-11-09T09:30:00.000Z.
2021-11-10 08:08:36.959 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T09:30:00.000Z to  2021-11-09T09:40:00.000Z.
2021-11-10 08:08:36.958 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.945 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T09:10:00.000Z to  2021-11-09T09:20:00.000Z.
2021-11-10 08:08:36.928 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.928 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T09:20:00.000Z to  2021-11-09T09:30:00.000Z.
2021-11-10 08:08:36.912 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T09:00:00.000Z to  2021-11-09T09:10:00.000Z.
2021-11-10 08:08:36.910 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.908 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.908 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T09:10:00.000Z to  2021-11-09T09:20:00.000Z.
2021-11-10 08:08:36.908 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T08:50:00.000Z to  2021-11-09T09:00:00.000Z.
2021-11-10 08:08:36.896 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.893 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.893 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T09:00:00.000Z to  2021-11-09T09:10:00.000Z.
2021-11-10 08:08:36.890 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T08:40:00.000Z to  2021-11-09T08:50:00.000Z.
2021-11-10 08:08:36.880 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.878 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.878 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T08:50:00.000Z to  2021-11-09T09:00:00.000Z.
2021-11-10 08:08:36.873 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T08:20:00.000Z to  2021-11-09T08:30:00.000Z.
2021-11-10 08:08:36.871 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T08:30:00.000Z to  2021-11-09T08:40:00.000Z.
2021-11-10 08:08:36.865 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.865 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T08:40:00.000Z to  2021-11-09T08:50:00.000Z.
2021-11-10 08:08:36.864 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.855 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.855 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T08:30:00.000Z to  2021-11-09T08:40:00.000Z.
2021-11-10 08:08:36.854 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.848 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T08:10:00.000Z to  2021-11-09T08:20:00.000Z.
2021-11-10 08:08:36.837 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.835 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T08:20:00.000Z to  2021-11-09T08:30:00.000Z.
2021-11-10 08:08:36.834 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.831 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T08:00:00.000Z to  2021-11-09T08:10:00.000Z.
2021-11-10 08:08:36.826 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.825 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T08:10:00.000Z to  2021-11-09T08:20:00.000Z.
2021-11-10 08:08:36.824 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.815 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T07:50:00.000Z to  2021-11-09T08:00:00.000Z.
2021-11-10 08:08:36.814 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.812 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T07:40:00.000Z to  2021-11-09T07:50:00.000Z.
2021-11-10 08:08:36.803 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.803 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T08:00:00.000Z to  2021-11-09T08:10:00.000Z.
2021-11-10 08:08:36.791 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.790 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T07:30:00.000Z to  2021-11-09T07:40:00.000Z.
2021-11-10 08:08:36.788 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T07:50:00.000Z to  2021-11-09T08:00:00.000Z.
2021-11-10 08:08:36.787 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.779 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.777 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T07:40:00.000Z to  2021-11-09T07:50:00.000Z.
2021-11-10 08:08:36.776 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.770 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T07:20:00.000Z to  2021-11-09T07:30:00.000Z.
2021-11-10 08:08:36.765 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T07:10:00.000Z to  2021-11-09T07:20:00.000Z.
2021-11-10 08:08:36.757 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.756 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T07:30:00.000Z to  2021-11-09T07:40:00.000Z.
2021-11-10 08:08:36.755 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.748 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T06:50:00.000Z to  2021-11-09T07:00:00.000Z.
2021-11-10 08:08:36.747 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.745 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.745 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 100-200 from 2021-11-09T07:20:00.000Z to  2021-11-09T07:30:00.000Z.
2021-11-10 08:08:36.741 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T06:40:00.000Z to  2021-11-09T06:50:00.000Z.
2021-11-10 08:08:36.739 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.734 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T07:10:00.000Z to  2021-11-09T07:20:00.000Z.
2021-11-10 08:08:36.733 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.726 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73)  Successfully processed events 0-100 from 2021-11-09T06:00:00.000Z to  2021-11-09T06:10:00.000Z.
2021-11-10 08:08:36.725 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 0-100 from 2021-11-09T07:00:00.000Z to  2021-11-09T07:10:00.000Z.
2021-11-10 08:08:36.725 UTC | SYSTEM | LOG | (017ceeed-f7ea-0000-078a-80d3dea0ef73) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.724 UTC | CONSOLE | LOG | Skipping empty batch of events
2021-11-10 08:08:36.722 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892) Export progress: ■■■■■■■■■■■■■■■■■■■■
2021-11-10 08:08:36.720 UTC | SYSTEM | LOG | (017ceeed-f818-0000-a964-79d35c45d892)  Successfully processed events 100-200 from 2021-11-09T06:50:00.000Z to  2021-11-09T07:00:00.000Z.

Be able to set a date range to import until

Currently you are able to specify a date to start importing from.

It would be good to be able to also specify a date to import until.

This would allow you to turn on event mirroring at any point in time and then to the migrate historical data up until the timestamp when the event mirroring was started.

Is there a method to migrate data with manage.py?

I searched unsuccessfully for a method to migrate the events... data from PostgreSQL to ClickHouse (on Self Hosted instance).
I think SKIP_ASYNC_MIGRATIONS_SETUP=0 python manage.py migrate_clickhouse only creates the data model but does not migrate the data.

Question: is there any other method than posthog-plugin-migrator3000 to migrate the data?

I think a direct migration from PostgreSQL to ClickHouse must be faster than going through the Rest API (although I know it is not suitable for migrating data to or from a cloud instance).

If there is no other migration method, how about adding this information in the README? And add the rational?

How to know the progress of the migration?

After tens of minutes of running posthog-plugin-migrator3000, I can see a lot of migrated data in the "Persons & Groups" list:

but only 2 in the "Events & Actions" list:

Data in "System status" page:

# docker-compose logs -f plugins
...
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42024 (pluginJob) with success (0.19ms)
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42025 (pluginJob) with success (0.25ms)
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42026 (pluginJob) with success (0.25ms)
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42027 (pluginJob) with success (0.21ms)
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42028 (pluginJob) with success (0.23ms)
plugins_1     | [worker(worker-ed70b072de91b701e6)] INFO: Completed task 42029 (pluginJob) with success (0.22ms)

Migration fails with "Export historical events not found for plugin" error

We are trying to migrate our data from a hobby instance at version 1.35.0 to a self hosted kubernetes instance at version 1.39.1 and getting the following error after configuring and enabling the migrator plugin with version config set to 1.30.0+.

Task "Export historical events" not found for plugin "Migrator 3000 (Beta)" with config id [object Object]

With debug on, after the above log, there are no more logs and no events are migrated.

"No JobQueue available" error logged migrating between self hosted deployments

Migrating from a self hosted version 1.30.0, the following error is logged by the plugin.

Error: No JobQueue available
    at JobQueueManager.enqueue (/home/posthog/code/plugin-server/dist/main/job-queues/job-queue-manager.js:78:15)
    at runJob (/home/posthog/code/plugin-server/dist/worker/vm/extensions/jobs.js:34:38)
    at Object.runNow (/home/posthog/code/plugin-server/dist/worker/vm/extensions/jobs.js:54:31)
    at Object.base.apply (/home/posthog/code/plugin-server/node_modules/vm2/lib/contextify.js:644:32)
    at runEveryMinute (vm.js:131:10)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)

Error: Export historical events not found for plugin

I've installed the plugin into my hosted posthog instance. After enabling and configuring of the plugin i've alway get the Error: "Task "Export historical events" not found for plugin "Migrator 3000 (Beta)" with config id [object Object]".

Is there any solution for this problem? Thanks in advance!

Log export progress boxes not showing

Bug description

I assume that the boxes in the message for Export progress are meant to represent progress, but they are just empty for me (the progress percentage updates fine).

How to reproduce

Configure, start export
Open log
See progress message, percentage updates but boxes don't.

Environment

PostHog Cloud
self-hosted PostHog, version/commit: please provide

Additional context

At 50%, it switches to being entirely filled in.

Another fun update

Thank you for your bug report – we love squashing them!

Min version of Posthog to run?

What's the minimum version of Posthog this plugin runs on? When I tried on Posthog 1.29, I saw this ERROR in the plugin log:

Task "Export historical events" not found for plugin "Migrator 3000 (Beta)" with config id [object Object]

Invalid time value

When not setting the "Date to start exporting events from" input I get this error:

Failed to parse start date. Make sure to use the format YYYY-MM-DD

Default Date From seems to fail

What happened

Error from Posthog Cloud Plugin Output

2022-06-30 13:11:00.304 UTC | PLUGIN | ERROR | Error: Unable to determine the lower timestamp bound for the export automatically. Please specify a 'dateFrom' value.     at Proxy.meta.global.initTimestampsAndCursor (/code/plugin-server/dist/worker/vm/upgrades/historical-export/export-historical-events.js:164:23)     at Object.exec (/code/plugin-server/dist/worker/vm/upgrades/historical-export/export-historical-events.js:79:31)     at runMicrotasks (<anonymous>)     at processTicksAndRejections (node:internal/process/task_queues:96:5)     at async runPluginTask (/code/plugin-server/dist/worker/plugins/run.js:88:20)     at async /code/plugin-server/dist/worker/worker.js:49:49     at async /code/plugin-server/node_modules/@posthog/piscina/dist/src/worker.js:149:26
-- | -- | -- | --

Field implies empty is fine

Expectation

It exports all events if no date is given (as per field help text)

Issue running the migrator plugin

User reported this:

Any ideas on how to solve this bug with the migrator?:

[___7] 19:46:40 🔔 TypeError: el.attr__class?.split is not a function                                                                                                                                              │
│     at /home/posthog/code/plugin-server/dist/utils/db/utils.js:179:40                                                                                                                                              │
│     at Array.map (<anonymous>)                                                                                                                                                                                     │
│     at extractElements (/home/posthog/code/plugin-server/dist/utils/db/utils.js:175:21)                                                                                                                            │
│     at EventsProcessor.capture (/home/posthog/code/plugin-server/dist/worker/ingestion/process-event.js:324:56)                                                                                                    │
│     at EventsProcessor.processEvent (/home/posthog/code/plugin-server/dist/worker/ingestion/process-event.js:125:67)                                                                                               │
│     at runMicrotasks (<anonymous>)                                                                                                                                                                                 │
│     at processTicksAndRejections (internal/process/task_queues.js:95:5)                                                                                                                                            │
│     at async ingestEvent (/home/posthog/code/plugin-server/dist/worker/ingestion/ingest-event.js:35:24)                                                                                                            │
│     at async Object.ingestEvent (/home/posthog/code/plugin-server/dist/worker/tasks.js:38:16)                                                                                                                      │
│     at async /home/posthog/code/plugin-server/dist/worker/worker.js:49:49

Might be related to autocapture?

Slack thread (asking for more details there): https://posthogusers.slack.com/archives/C01PPBY3G6Q/p1642166866060200

cc @yakkomajuri

Issue migrating and outdated readme

I was trying to migrate events from a self hosted instance with 1.39.0 to the cloud via the migrator3000 plugin, but there were no logs or progress bars when running the migrator3000 on the self hosted instance. Are there some more in depth logs for PostHog Apps somewhere on the machine running the self hosted instance that i can check out?

Also here in the readme of this repo it says to set the host in the migrator to app.posthog.com, yet i'm on the eu.posthog.com because i'm in the EU region and i suspect that it should be the latter one?

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.