vinayak-mehta / conrad Goto Github PK

Like a positive fortune with quotes about submitting a proposal and taking that first step forward.

Using colorama.

Reset everything, even the reminders!

We could have a threshold (0.5 or 0.7) above which a conference could be flagged as a duplicate during import.

When show is run.

A bot should use the scrapers to get new/updated events and raise a PR with an updated data/events.json.

Hi, I was looking through Hacktoberfest issues when I found your module and downloaded it.
When I first ran pip install conference-radar, the pip installer froze for a good 2-3 minutes before I CTRL+C quit out of it. Running it again seemed to have zero effect, so I continued onward.

Running conrad show returned a DB error, perhaps a DB is not properly created before running conrad refresh? I don't personally know since I have yet to understand the project.

Full Terminal Output

https://github.com/ildoc/awesome-italy-events

https://qconferences.com/#next-conference

HI, anyone have that issue ? how to fix that , the module SQLITE3 was installed.... thanks

Operating System: CentOS Linux 7 (Core)
CPE OS Name: cpe:/o:centos:centos:7
Kernel: Linux 3.10.0-123.4.2.el7.x86_64

[[email protected]]# conrad show
Traceback (most recent call last):
File "/usr/local/bin/conrad", line 6, in
from conrad.cli import cli
File "/usr/local/lib/python3.7/site-packages/conrad/cli.py", line 14, in
from .db import engine, Session
File "/usr/local/lib/python3.7/site-packages/conrad/db.py", line 42, in
configure_orm()
File "/usr/local/lib/python3.7/site-packages/conrad/db.py", line 22, in configure_orm
engine = create_engine(SQL_ALCHEMY_CONN, **engine_args)
File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/init.py", line 479, in create_engine
return strategy.create(*args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/sqlalchemy/engine/strategies.py", line 87, in create
dbapi = dialect_cls.dbapi(**dbapi_args)
File "/usr/local/lib/python3.7/site-packages/sqlalchemy/dialects/sqlite/pysqlite.py", line 382, in dbapi
from sqlite3 import dbapi2 as sqlite
File "/usr/local/lib/python3.7/sqlite3/init.py", line 23, in
from sqlite3.dbapi2 import *
File "/usr/local/lib/python3.7/sqlite3/dbapi2.py", line 27, in
from _sqlite3 import *
ModuleNotFoundError: No module named '_sqlite3'

Using #33

Hi all, I found very interesting this tool.
I tried to used but It doesn't work on ZSH.
When using the command: conrad show, I obtain the message: zsh: command not found: conrad.
Do I have to do some configurations before using it?
I tried to find some documentation, but there isn't one for the configuration so I will be helpful to add some for a first run.

Thanks in advance.

Compare user's conrad.__version__ with the latest release on PyPI and suggest them to upgrade conrad periodically.

...so that I can filter events by country.

More use-cases can be show events in the next 3 months, things like that.

Remove underscores and convert them into normal capital case words.

Show events that were added on the last refresh.

Additionally, show the number of events added on each refresh.

$ conrad refresh
10 new events added!

https://sorse.github.io/

Based on a parameter used when setting the reminder.

1. Detect the current shell
2. Find/create a shell startup file for the current user
3. Add "conrad remind" at the end of file

Could use Nominatim

We could do it using an environment variable.

https://click.palletsprojects.com/en/7.x/documentation/#help-texts

conrad import should delete conferences with start_date < dt.datetime.now().

Doc:
"Before raising a PR with a crawler, run it with python -m crawlers CreepyCrawler to see if it works.".

CI:
A PR with a crawler should start a CI job which tries to run for one event.

#139 adds a change (addition of a location field) which would break earlier conrad versions. One way to make this change backwards compatible would be to have two event files, the current one (events.json) and a new one (events_v2.json). Will need to import new events into both files when the scrapers run. Can support both files for two minor versions, but since schema changes like #139 could happen in the future too, it might make sense to keep events.json, events_v2.json, events_v3.json and so on, and keep them all updated.

Tried conrad import with conrad.zip (extract for json)

The first time It gave me a validation error even though there are no duplicates event names

Another time it updated events.json but did not echo the string saying that these were updated...it ran successfully silently.

The third time it runs successfully

Right now if you have a clean conrad env and you run conrad remind it will fail bc the DB doesn't exist yet. You need to execute refresh first.

Before executing remind command might be a good idea to check if the db exists and suggest the user to run refresh first.

Scrape conferences from https://www.dataengineeringpodcast.com/conferences/

Hi!

We're building tulu.la. A service that helps new speakers.
One part of tulu.la is an event/conference aggregator.
Events about python https://tulu.la/events/?about=Python&view=calendar
CFP list https://tulu.la/call-for-papers/?from=2019-10-28

We use graphql and don't have public API right now. But I will be happy to add support to conrad.
What do you think?

Adding the stacktrace for conrad show here:

Traceback (most recent call last):
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1249, in _execute_context
    cursor, statement, parameters, context
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 580, in do_execute
    cursor.execute(statement, parameters)
sqlite3.OperationalError: no such column: event.by

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/Users/nirant/miniconda3/envs/toys/bin/conrad", line 10, in <module>
    sys.exit(cli())
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/conrad/cli.py", line 169, in invoke
    return orig_invoke(ctx)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/click/decorators.py", line 17, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/conrad/cli.py", line 284, in _show
    session.query(Event).filter(*filters).order_by(Event.start_date).all()
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/orm/query.py", line 3186, in all
    return list(self)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/orm/query.py", line 3342, in __iter__
    return self._execute_and_instances(context)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/orm/query.py", line 3367, in _execute_and_instances
    result = conn.execute(querycontext.statement, self._params)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 988, in execute
    return meth(self, multiparams, params)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/sql/elements.py", line 287, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1107, in _execute_clauseelement
    distilled_params,
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1253, in _execute_context
    e, statement, parameters, cursor, context
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1473, in _handle_dbapi_exception
    util.raise_from_cause(sqlalchemy_exception, exc_info)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 398, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/util/compat.py", line 152, in reraise
    raise value.with_traceback(tb)
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/base.py", line 1249, in _execute_context
    cursor, statement, parameters, context
  File "/Users/nirant/miniconda3/envs/toys/lib/python3.7/site-packages/sqlalchemy/engine/default.py", line 580, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such column: event.by
[SQL: SELECT event.id AS event_id, event.name AS event_name, event.url AS event_url, event.city AS event_city, event.state AS event_state, event.country AS event_country, event.cfp_open AS event_cfp_open, event.cfp_end_date AS event_cfp_end_date, event.start_date AS event_start_date, event.end_date AS event_end_date, event.source AS event_source, event.tags AS event_tags, event.kind AS event_kind, event."by" AS event_by 
FROM event ORDER BY event.start_date]
(Background on this error at: http://sqlalche.me/e/e3q8)

https://wiki.python.org/moin/PythonEventsCalendar

Please go ahead :)

Originally posted by @vinayak-mehta in #58 (comment)