I like this package and I am starting to use it to automate some of my note taking. I noticed if I want to add a page into database, only full database url works but not the short version database ID. For downloading, both short ID and full url works. This is a minor issue. I mentioned it just in case you want to fix it.

Thank you!
Eric

When I try to read a databse from notion, the column that shows the name of the mate assigned to this task is shown as a code but not the name. But the property last edited shows the name. Someone knows what is happening ?

Thanks

https://developers.notion.com/reference/request-limits

I've tried resolve_relation_values=True and False... no change

For example, if you have a relation column inside a table, which points to an relation that the Notion integration doesn't have access to, then

1. the downloaded data will contain that column
2. the downloaded schema will not contain that column

In notion documentation, there are:

• Property Object
  • XXX Confinguration
• Property Value Object
  • XXX property values
• [XX Object]
  • User Object ...
  • File Object...

Could you relax the pydantic requirements to allow for 1.10? Note that pydantic released 2.0 with breaking changes so supporting all versions might be difficult. Thanks in advance!

Hello,

New to this library and very interested!

Trying to import my database into pandas but got a KeyError: 'status' error.
It seems that the status type property is not supported? Is there any workaround to avoid this?

Regards

Here is the full error log :

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/_pandas.py in read_notion(notion_url, nrows, resolve_relation_values, errors, api_key)
37 pd.DataFrame: the loaded dataframe.
38 """
---> 39 return download(
40 notion_url,
41 nrows=nrows,

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/agent.py in wrapper(*args, **kwargs)
52 api_key = _load_api_key(kwargs.pop("api_key", None))
53 client = Client(auth=api_key)
---> 54 out = func(client=client, *args, **kwargs)
55
56 if orig_client is None:

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/agent.py in download(notion_url, nrows, resolve_relation_values, errors, api_key, client)
195 client: Client = None,
196 ):
--> 197 df = download_df_from_database(
198 notion_url=notion_url,
199 nrows=nrows,

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/agent.py in download_df_from_database(notion_url, client, nrows, errors)
138 try:
139 retrieve_results = client.databases.retrieve(database_id=database_id)
--> 140 schema = DatabaseSchema.from_raw(retrieve_results["properties"])
141 except HTTPStatusError:
142 error_msg = (

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/configs.py in from_raw(cls, configs)
298 def from_raw(cls, configs: Dict) -> "DatabaseSchema":
299
--> 300 configs = {key: parse_single_config(config) for key, config in configs.items()}
301 return cls(configs)
302

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/configs.py in (.0)
298 def from_raw(cls, configs: Dict) -> "DatabaseSchema":
299
--> 300 configs = {key: parse_single_config(config) for key, config in configs.items()}
301 return cls(configs)
302

~/anaconda3/envs/py39_env/lib/python3.9/site-packages/notion_df/configs.py in parse_single_config(data)
230
231 def parse_single_config(data: Dict) -> BasePropertyConfig:
--> 232 return parse_obj_as(CONFIGS_MAPPING[data["type"]], data)
233
234

KeyError: 'status'

Or just the response in the df?

looking forward to seeing this coming.

mode (str, optional):
(the function is not supported yet.)
Whether to append to the database or overwrite.

Currently when downloading an empty table, it will have no column information, which can cause errors for subsequent steps.

Hey!
In contrast to #26 , I can see rollups an relations when resolve_relation_values =False. When I set resolve_relation_values=True, I get the following error:

Traceback (most recent call last):
  File "C:\Users\m_thi\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\indexes\base.py", line 3621, in get_loc
    return self._engine.get_loc(casted_key)
  File "pandas\_libs\index.pyx", line 136, in pandas._libs.index.IndexEngine.get_loc
  File "pandas\_libs\index.pyx", line 163, in pandas._libs.index.IndexEngine.get_loc
  File "pandas\_libs\hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item
  File "pandas\_libs\hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item
KeyError: 'Beschreibung'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "a:\xxx\notion_fin_test.py", line 10, in <module>
    df = notion_df.download(page_url, resolve_relation_values=True)
  File "C:\Users\m_thi\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\notion_df\agent.py", line 54, in wrapper
    out = func(client=client, *args, **kwargs)
  File "C:\Users\m_thi\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\notion_df\agent.py", line 216, in download
    relation_df.notion_ids, relation_df[rel_title_col]
  File "C:\Users\m_thi\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\frame.py", line 3505, in __getitem__
    indexer = self.columns.get_loc(key)
  File "C:\Users\m_thi\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pandas\core\indexes\base.py", line 3623, in get_loc
    raise KeyError(key) from err
KeyError: 'Beschreibung'

e.g., ["a", "b,c"] is not valid.

Now the UserObject just has very rudimentary functions ...

Is it possible to get the page id of a database item into the data frame? This way I can map relations without setting resolve_relation_values=True and I won't have a problem with relation values that are named the same.

The current way of saving notion_urls in notion_df is not perfect:

df.notion_urls = pd.Series([ele["url"] for ele in database_query_results])
df.notion_ids = pd.Series([ele["id"] for ele in database_query_results])

For example, after running df.copy(), this value would disappear. Try to figure out a better way to do so.