fedstoa / moa Goto Github PK

View Code? Open in Web Editor NEW

355.0 4.0 19.0 688 KB

A Mastodon, Twitter, and Instagram Cross-poster

Home Page: https://moa.party

License: MIT License

Python 93.98% CSS 1.19% Shell 0.64% HTML 0.03% Mako 0.22% Jinja 3.94%

python flask mastodon twitter flask-sqlalchemy flask-wtf instagram

moa's Introduction

Hello! We are prepping to run Moa as a public utility!

Thank you to James Moore as the original creator and maintainer of both the code and the public service.

Join us on Matrix chat #moaparty:matrix.org to get involved, or file an issue here.

                 _ __ ___   ___   __ _
                | '_ ` _ \ / _ \ / _` |
                | | | | | | (_) | (_| |
                |_| |_| |_|\___/ \__,_|

┌──────────────┐     ╔══════════════╗      ┌──────────────┐
│  Instagram   │────▶║  moa.party   ║◀────▶│   Twitter    │
└──────────────┘     ╚══════════════╝      └──────────────┘
                             ▲
                             │
                             ▼
                     ┌──────────────┐
                     │   Mastodon   │
                     └──────────────┘

Link your Mastodon account to Twitter and Instagram

https://moa.party

Install

Requires python 3.6+

Moa is a flask app and can be run with python or proxied via WSGI.

clone it
On Debian/Ubuntu you'll need to apt install python-dev python3-dev build-essential
Install pipenv pip3 install pipenv
PIPENV_VENV_IN_PROJECT=1 pipenv install
cp config.py.sample config.py and override the settings from defaults.py
MOA_CONFIG=config.DevelopmentConfig /usr/local/bin/pipenv run python -m moa.models to create the DB tables
MOA_CONFIG=config.DevelopmentConfig /usr/local/bin/pipenv run python app.py
run the worker with MOA_CONFIG=DevelopmentConfig /usr/local/bin/pipenv run python -m moa.worker

Features

preserves image alt text
handles boosts/retweets

Some code lifted from https://github.com/halcy/MastodonToTwitter

Twitter App setup

If you plan to use twitter then you'll need to create a twitter app first so the required crednetials can be obtained.

Follow the steps here to get started https://python-twitter.readthedocs.io/en/latest/getting_started.html
For the Callback URL use [moa_base_url]/twitter_oauthorized e.g. https://example.com/twitter_oauthorized
Access Permissions need to be "read" and "write"

Example nginx/passenger configuration

server {
    listen 80;
    server_name moa.party;
    return 301 https://$server_name$request_uri;
}

server {
    listen 443 ;
    server_name moa.party;
    
    # SSL
    
    ssl on;
    ssl_certificate     /etc/certificates/moa.crt;
    ssl_certificate_key /etc/certificates/moa.key;
    
    client_max_body_size 1G;
    
    access_log /var/www/moa/logs/access.log;
    error_log /var/www/moa/logs/error.log;
    
    location = /favicon.ico { log_not_found off; access_log off; }
    location = /robots.txt  { log_not_found off; access_log off; }
    
    passenger_enabled on;
    passenger_app_env production;
    passenger_python /var/www/moa/.venv/bin/python3;
    passenger_env_var MOA_CONFIG config.ProductionConfig;
    
    root /var/www/moa/public;
}

moa's People

Contributors

Stargazers

Watchers

Forkers

offbyone samr1 distantorigin pietvanzoen muellermartin rjp uetchy xurizaemon tristanlins sjbat yzernik ninjayoto rlywtf tugatech bolzon sivabudati nplongoria adstfowlerj ohsevin

moa's Issues

Provide a separate CW option for RTs

add an toggle to post boosts to twitter

apostrophe's used with twitter handles mess up expansion

Also, there's an unexpanded handle here

https://pdx.social/web/statuses/99020990343903002

error when instagram is added before bridge has been saved

https://sentry.io/james-moore-p3/moa/issues/450587114/

AttributeError: 'NoneType' object has no attribute 'instagram_access_code'
(2 additional frame(s) were not displayed)
...
  File "moa/app.py", line 394, in instagram_oauthorized
    bridge.instagram_access_code = access_token[0]

AttributeError: 'NoneType' object has no attribute 'instagram_access_code'

Add a way to notify users about new features

An opt-out checkbox for both services.

add a healthchecks badge to the readme

Can't post just an image to mastodon

if an RT ends with a URL the trailing quote can cause problems

Long posts broken into short for twitter bug

Hi! Just wanted to let y'all know that the "Split long toots on Twitter?" option ended up taking this from Mastodon and turning it into this truncated section without previous attached.

Also, may I suggest that such broken-up tweets be actually threaded as replies to yourself on Twitter?

Thanks for this!

wrap status fetching in try/except

https://sentry.io/james-moore-p3/moa/issues/403807870/

JSONDecodeError: Expecting value: line 1 column 1 (char 0)
  File "mastodon/Mastodon.py", line 1108, in __api_request
    response = response_object.json(object_hook=self.__json_date_parse)
  File "requests/models.py", line 892, in json
    return complexjson.loads(self.text, **kwargs)
  File "json/__init__.py", line 367, in loads
    return cls(**kw).decode(s)
  File "json/decoder.py", line 339, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "json/decoder.py", line 357, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None

MastodonAPIError: Could not parse response as JSON, response code was 504, bad json content was 'b'<!DOCTYPE html>\n<html lang=\'en\'>\n<head>\n<meta content=\'text/html; charset=UTF-8\' http-equiv=\'Content-Type\'>\n<meta charset=\'utf-8\'>\n<title>This page is not correct\n - Mastodon</title>\n<meta content=\'width=device-width,initial-scale=1\' name=\'viewport\'>\n<link rel="stylesheet" media="all" href="/_maas/500.css" />\n</head>\n<body class=\'error\'>\n<div class=\'dialog\'>\n<img alt=\'Mastodon\' src=\'/_maas/oops.gif\'>\n<div>\n<h1>We&#39;re sorry, but something went wrong on our end.\n</h1>\n</div>\n</div>\n</body>\n</html>\n''
  File "python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "moa/worker.py", line 64, in <module>
    since_id=bridge.mastodon_last_id
  File "mastodon/Mastodon.py", line 387, in account_statuses
    return self.__api_request('GET', url, params)
  File "mastodon/Mastodon.py", line 1113, in __api_request
    response_object.content))

MastodonAPIError: Could not parse response as JSON, response code was 504, bad json content was 'b'<!DOCTYPE html>\n<html lang=\'en\'>\n<head>\n<meta content=\'text/html; charset=UTF-8\' http-equiv=\'Content-Type\'>\n<meta charset=\'utf-8\'>\n<title>This page is not correct\n - Mastodon</title>\n<meta content=\'width=device-width,initial-scale=1\' name=\'viewport\'>\n<link rel="stylesheet" media="all" href="/_maas/500.css" />\n</head>\n<body class=\'error\'>\n<div class=\'dialog\'>\n<img alt=\'Mastodon\' src=\'/_maas/oops.gif\'>\n<div>\n<h1>We&#39;re sorry, but something went wrong on our end.\n</h1>\n</div>\n</div>\n</body>\n</html>\n''

How do self-replies on either system work?

As a user I want to add a prefix/suffix string into every federated post #Feature #Idea

https://mastodon.social/@ldexterldesign/100435379111321491

Hi!

Hope you're well

Thanks for 🔥 software

As title

A dynamic template string giving me access to Mastodon URLs (e.g. profile, toot) would be amazing a la https://ifttt.com/applets/73077886 but I imagine this is a lot more work and could come later?

If you're reading this and agree please up-vote and/or reply +1

Let me know if you have any issues - happy to help

Hope this is clear/useful and to hear back

Keep up good work!

Yours hopefully

Invalid syntax at line 88 app.py

So far so good, running Ubuntu 16.04 with python 3.5.2 (troubleshooting issues updating to 3.6). When i run app.py from the /moa user directory, i get the following syntax error. Some googling has not turned up a simple solution yet.

(.moa-venv) who@where:~/moa$ python app.py
  File "app.py", line 88
    app.logger.debug(f"Existing settings found: {enabled} {settings.__dict__}")
                                                                             ^
SyntaxError: invalid syntax

disable bridges when tokens are revoked

Post only retweets to Mastodon

Hi,

I'm using other means to post to both Mastodon and Twitter, and my original posts are already synced. So I thought I'd use this tool (which btw looks great, good job!) to only post retweets back to Mastodon and perhaps boosts over to birdsite.

On the settings page it looks like that's actually possible. This is my current config:

However, it doesn't actually sync my retweets at the moment. Not sure if that's intended, or a bug.

Cheers

add a stats table to record events

things like new users add, tweets/toots delivered

When a toot contains a masto ID and twitter ID that are the same the tweet gets the wrong mention

https://twitter.com/foozmeat/status/935248122334216192

Add some handling in case mysql is down.

https://sentry.io/james-moore-p3/moa/issues/404132119/

Empty: 
  File "sqlalchemy/pool.py", line 1122, in _do_get
    return self._pool.get(wait, self._timeout)
  File "sqlalchemy/util/queue.py", line 145, in get
    raise Empty

ConnectionRefusedError: [Errno 111] Connection refused
  File "pymysql/connections.py", line 916, in connect
    **kwargs)
  File "python3.6/socket.py", line 724, in create_connection
    raise err
  File "python3.6/socket.py", line 713, in create_connection
    sock.connect(sa)

OperationalError: (2003, "Can't connect to MySQL server on 'localhost' ([Errno 111] Connection refused)")
(11 additional frame(s) were not displayed)
...
  File "sqlalchemy/engine/strategies.py", line 105, in connect
    return dialect.connect(*cargs, **cparams)
  File "sqlalchemy/engine/default.py", line 393, in connect
    return self.dbapi.connect(*cargs, **cparams)
  File "pymysql/__init__.py", line 90, in Connect
    return Connection(*args, **kwargs)
  File "pymysql/connections.py", line 706, in __init__
    self.connect()
  File "pymysql/connections.py", line 963, in connect
    raise exc

OperationalError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'localhost' ([Errno 111] Connection refused)")
(26 additional frame(s) were not displayed)
...
  File "sqlalchemy/engine/strategies.py", line 105, in connect
    return dialect.connect(*cargs, **cparams)
  File "sqlalchemy/engine/default.py", line 393, in connect
    return self.dbapi.connect(*cargs, **cparams)
  File "pymysql/__init__.py", line 90, in Connect
    return Connection(*args, **kwargs)
  File "pymysql/connections.py", line 706, in __init__
    self.connect()
  File "pymysql/connections.py", line 963, in connect
    raise exc

OperationalError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'localhost' ([Errno 111] Connection refused)")

Fix how quoted tweets are tooted

when a toot is over the limit try and fix it

Optionally put twitter posts behind a CW

decouple twitter and mastodon so only one is required in order to set things up.

InstagramClientError: (502) Unable to parse response, not valid JSON.

https://sentry.io/james-moore-p3/moa/issues/463164907/

JSONDecodeError: Expecting value: line 1 column 1 (char 0)
  File "instagram/bind.py", line 130, in _do_api_request
    content_obj = simplejson.loads(content)
  File "simplejson/__init__.py", line 518, in loads
    return _default_decoder.decode(s)
  File "simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())

InstagramClientError: (502) Unable to parse response, not valid JSON.
(1 additional frame(s) were not displayed)
...
  File "python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "moa/worker.py", line 164, in <module>
    recent_media, _ = api.user_recent_media(user_id=bridge.instagram_account_id)
  File "instagram/bind.py", line 207, in _call
    return method.execute()
  File "instagram/bind.py", line 198, in execute
    content, next_url = self._do_api_request(url, method, body, headers)
  File "instagram/bind.py", line 132, in _do_api_request
    raise InstagramClientError('Unable to parse response, not valid JSON.', status_code=response['status'])

InstagramClientError: (502) Unable to parse response, not valid JSON.