Argilla is a collaboration platform for AI engineers and domain experts that require high-quality outputs, full data ownership, and overall efficiency.
Home Page: https://argilla-io.github.io/argilla/latest/
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot]")
![pre-commit-ci[bot] avatar](https://avatars.githubusercontent.com/in/68672?v=4 "pre-commit-ci[bot]")
When we add an annotation, and before validating it, show Edited status
It will be eventually be supported as a theme option (issue os sphinx referencing it). If not, it would require CSSing it out, or picking another base theme. Pytorch-lighting is able to do this in their docs
This concept is called local_toc.
Applying a wildcard search for text classification like *as returns results but record text are not shown
Keywords are quite useful on annotation phase.
Adding the streamlit app section on documentation. Streamlit app is already developed.
How shall I proceed @dvsrepo ? Making a quick .rst file just showing how to run the app (as all the explanations are in the code) or explaining the app/what the app shows in the .rst ?
Review ux-ui
I'm getting this error when running the third tutorial for tomorrow's release, wondering if you know what's going on @dvsrepo .
import torch
from torch_geometric.data import Data
tensor = torch.tensor(edge_list, dtype=torch.long).t().contiguous()
edge_index, edge_type = tensor[:2], tensor[2]
data = Data(edge_index=edge_index)
data.edge_type = edge_typeThe error is:
OSError: dlopen(/Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so, 6): Symbol not found: __ZNK2at6Tensor6deviceEv
Referenced from: /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so
Expected in: /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch/lib/libtorch_cpu.dylib
in /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so
---------------------------------------------------------------------------
OSError Traceback (most recent call last)
<ipython-input-14-844cb8b9dd75> in <module>
1 import torch
----> 2 from torch_geometric.data import Data
3
4 tensor = torch.tensor(edge_list, dtype=torch.long).t().contiguous()
5 edge_index, edge_type = tensor[:2], tensor[2]
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_geometric/__init__.py in <module>
3
4 from .debug import is_debug_enabled, debug, set_debug
----> 5 import torch_geometric.data
6 import torch_geometric.transforms
7 import torch_geometric.utils
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_geometric/data/__init__.py in <module>
----> 1 from .data import Data
2 from .temporal import TemporalData
3 from .batch import Batch
4 from .dataset import Dataset
5 from .in_memory_dataset import InMemoryDataset
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_geometric/data/data.py in <module>
6 import torch
7 import torch_geometric
----> 8 from torch_sparse import coalesce, SparseTensor
9 from torch_geometric.utils import (contains_isolated_nodes,
10 contains_self_loops, is_undirected)
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/__init__.py in <module>
13 ]:
14 torch.ops.load_library(importlib.machinery.PathFinder().find_spec(
---> 15 f'{library}_{suffix}', [osp.dirname(__file__)]).origin)
16
17 if torch.cuda.is_available(): # pragma: no cover
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch/_ops.py in load_library(self, path)
102 # static (global) initialization code in order to register custom
103 # operators with the JIT.
--> 104 ctypes.CDLL(path)
105 self.loaded_libraries.add(path)
106
~/anaconda3/envs/rubrix0.1.1/lib/python3.7/ctypes/__init__.py in __init__(self, name, mode, handle, use_errno, use_last_error)
362
363 if handle is None:
--> 364 self._handle = _dlopen(self._name, mode)
365 else:
366 self._handle = handle
OSError: dlopen(/Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so, 6): Symbol not found: __ZNK2at6Tensor6deviceEv
Referenced from: /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so
Expected in: /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch/lib/libtorch_cpu.dylib
in /Users/ignaciotalaveracepeda/anaconda3/envs/rubrix0.1.1/lib/python3.7/site-packages/torch_sparse/_convert_cpu.so
While implementing the new readme, and adding one of the amazing svg images we have to explain Rubrix, and as a dark mode Github user, I came across this:
Is it possible to make it a png-like background, or we stick to the light mode approach?
Integrate new feature "show mentions in Explore view"
3 mentions by labels (full list colapsed)
Active scroll
When clicking on the images in the docs you get to a not found url. There are several solutions:
I don't know which one is easier to do, maybe 2 is the most difficult, I let you decide. In general I would avoid sending the users to other urls and leaving the docs, even if it's our image
At the moment Safari does not support webm format
When all records are anotated, the annotation progress bar is wrongly filled
In header and task name it should be Open sans
Integrate new user flow
Cuando te pongas hablamos para validarlo
Display records group like blogs
Align the creation of labels and entities
I've noticed that we have an empty api folder, and the api reference is inside reference folder. We can merge both into the api folder, if you see it right @dcfidalgo
The create new label accepts create empty labels, bringing into null values. This behaviour should be skipped.
Here are a few features for the UI that would be awesome to have :)
Replace Annotation tool create a short text with Track and iterate on data for AI
Let's avoid
raise Exception("Unidentified error, it should not get here.")
Showing info about the error response (status, body, etc.)
Thanks, very good job in general👍
The idea is to cover the interaction between the main NLP libraries. So far, I've found these to include:
If we found any other, it should be quick to add.
Addressing the name, I've found several examples of cheatsheet but none of cookbook. It has more personality and makes more sense to me (as we are explaining how to include other services into our app is kind of mixing different ingredients), but cheatsheet is by far the standard.
One very cool example is streamlit doc. I was wondering if that was a ipynb, but it is an standalone streamlit app, that they have running in a separate repo and uploaded to their premium hosting service. I don't know if something similar can be done from our starting point (a notebook), but would be cool. Other approaches, like readthedocs, are pngs. Maybe not difficult to replicate with our current style, but not very maintainable. So for now, a jupyter is a cool start, and maybe a destination (?).
When i create new labels in the UI, and do not annotate anything with these new labels, these new labels will not be copied when doing a rubrix.load&rubrix.log.
It would be nice to be able to completely copy a data set and its "state".
Section with Number of records in dataset should be task name and not dataset name.
documentation from the pathindex.rst should be what's now Introduction to Rubrix. Ideally, this page will still be the first item of the Getting started block (I've seen this in other docs) but if it's not easy to do, no problem.Cuando hacemos scroll de la zona central el ancho del right sidebar se reduce no debería cambiar.
Propongo tb comentar el widget contador de records porqué esta escondido detrás
UI components that already have a dataset as input param, should avoid require other params that can be easily computed from dataset.
For examle:
<GlobalActions :annotationEnabled="annotationEnabled" :dataset="dataset" />The GlobalActions component receive 2 params: dataset and annotationEnabled, but the second one can be easily computed from dataset
dataset.viewSettings.annotationEnabledAlso, we can consider create getter for common computed properties.
class Dataset {
get annotationEnabled (this) {
return this.viewSettings.annotationEnabled;
}
}Design an alternative to improve the UX and catch the complexity of a record with the aim to help the model
The search in the "Annotated as" filter does not work properly.
Including a Reference section. For now it can have links to Python API docs, and we can think of more elements to add. @dvsrepo told me that you were working on the API reference, @dcfidalgo , how is it going?
{'detail': ['1 validation error for CreationDatasetRequest\nname\n string does not match regex "^(?!-|_)[a-z0-9-_]+$" (type=value_error.str.regex; pattern=^(?!-|_)[a-z0-9-_]+$)']}
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
<ipython-input-1-a00c59b53ee8> in <module>
26
27 # Logging into Rubrix
---> 28 rb.log(records=[record], name="zeroshot-NER")
~/Documents/RecognAI/rubrix/src/rubrix/__init__.py in log(records, name, tags, metadata, chunk_size)
112 records = [records]
113
--> 114 return _client_instance().log(
115 records=records, name=name, tags=tags, metadata=metadata, chunk_size=chunk_size
116 )
~/Documents/RecognAI/rubrix/src/rubrix/client/__init__.py in log(self, records, name, tags, metadata, chunk_size)
166 chunk = records[i : i + chunk_size]
167
--> 168 response = bulk_records_function(
169 client=self._client,
170 name=name,
~/Documents/RecognAI/rubrix/src/rubrix/sdk/api/token_classification/bulk_records.py in sync_detailed(client, name, json_body)
85 )
86
---> 87 return _build_response(response=response)
88
89
~/Documents/RecognAI/rubrix/src/rubrix/sdk/api/token_classification/bulk_records.py in _build_response(response)
65 content=response.content,
66 headers=response.headers,
---> 67 parsed=_parse_response(response=response),
68 )
69
~/Documents/RecognAI/rubrix/src/rubrix/sdk/api/token_classification/bulk_records.py in _parse_response(response)
52 if response.status_code == 422:
53 print(response.json())
---> 54 response_422 = HTTPValidationError.from_dict(response.json())
55
56 return response_422
~/Documents/RecognAI/rubrix/src/rubrix/sdk/models/http_validation_error.py in from_dict(cls, src_dict)
39 _detail = d.pop("detail", UNSET)
40 for detail_item_data in _detail or []:
---> 41 detail_item = ValidationError.from_dict(detail_item_data)
42
43 detail.append(detail_item)
~/Documents/RecognAI/rubrix/src/rubrix/sdk/models/validation_error.py in from_dict(cls, src_dict)
35 @classmethod
36 def from_dict(cls: Type[T], src_dict: Dict[str, Any]) -> T:
---> 37 d = src_dict.copy()
38 loc = cast(List[str], d.pop("loc"))
39
AttributeError: 'str' object has no attribute 'copy'
The problem comes for the response with the regex.
Gold same as Annotation: Green
Gold different as Annotation: Red
No Annotation or no Gold : No icon
When running the docker-compose file in the readme, the rubrix_1 service fails with the following exception stack trace:
[2021-05-04 16:23:21 +0000] [40] [ERROR] Traceback (most recent call last):
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 170, in _new_conn
rubrix_1 | (self._dns_host, self.port), self.timeout, **extra_kw
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", line 96, in create_connection
rubrix_1 | raise err
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/util/connection.py", line 86, in create_connection
rubrix_1 | sock.connect(sa)
rubrix_1 | ConnectionRefusedError: [Errno 111] Connection refused
rubrix_1 |
rubrix_1 | During handling of the above exception, another exception occurred:
rubrix_1 |
rubrix_1 | Traceback (most recent call last):
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/connection/http_urllib3.py", line 252, in perform_request
rubrix_1 | method, url, body, retries=Retry(False), headers=request_headers, **kw
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 756, in urlopen
rubrix_1 | method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/util/retry.py", line 507, in increment
rubrix_1 | raise six.reraise(type(error), error, _stacktrace)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/packages/six.py", line 735, in reraise
rubrix_1 | raise value
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 706, in urlopen
rubrix_1 | chunked=chunked,
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connectionpool.py", line 394, in _make_request
rubrix_1 | conn.request(method, url, **httplib_request_kw)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 234, in request
rubrix_1 | super(HTTPConnection, self).request(method, url, body=body, headers=headers)
rubrix_1 | File "/usr/local/lib/python3.7/http/client.py", line 1252, in request
rubrix_1 | self._send_request(method, url, body, headers, encode_chunked)
rubrix_1 | File "/usr/local/lib/python3.7/http/client.py", line 1298, in _send_request
rubrix_1 | self.endheaders(body, encode_chunked=encode_chunked)
rubrix_1 | File "/usr/local/lib/python3.7/http/client.py", line 1247, in endheaders
rubrix_1 | self._send_output(message_body, encode_chunked=encode_chunked)
rubrix_1 | File "/usr/local/lib/python3.7/http/client.py", line 1026, in _send_output
rubrix_1 | self.send(msg)
rubrix_1 | File "/usr/local/lib/python3.7/http/client.py", line 966, in send
rubrix_1 | self.connect()
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 200, in connect
rubrix_1 | conn = self._new_conn()
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/urllib3/connection.py", line 182, in _new_conn
rubrix_1 | self, "Failed to establish a new connection: %s" % e
rubrix_1 | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fd72c079b50>: Failed to establish a new connection: [Errno 111] Connection refused
rubrix_1 |
rubrix_1 | During handling of the above exception, another exception occurred:
rubrix_1 |
rubrix_1 | Traceback (most recent call last):
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 526, in lifespan
rubrix_1 | async for item in self.lifespan_context(app):
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 467, in default_lifespan
rubrix_1 | await self.startup()
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/starlette/routing.py", line 502, in startup
rubrix_1 | await handler()
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/rubrix/server/server.py", line 71, in configure_elasticsearch
rubrix_1 | datasets: DatasetsDAO = create_datasets_dao(es=es_wrapper)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/rubrix/server/datasets/dao.py", line 271, in create_datasets_dao
rubrix_1 | _instance = DatasetsDAO(es)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/rubrix/server/datasets/dao.py", line 66, in __init__
rubrix_1 | self.init()
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/rubrix/server/datasets/dao.py", line 73, in init
rubrix_1 | force_recreate=True,
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/rubrix/server/commons/es_wrapper.py", line 140, in create_index_template
rubrix_1 | self.__client__.indices.put_template(name=name, body=template)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/client/utils.py", line 153, in _wrapped
rubrix_1 | return func(*args, params=params, headers=headers, **kwargs)
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/client/indices.py", line 647, in put_template
rubrix_1 | body=body,
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/transport.py", line 413, in perform_request
rubrix_1 | raise e
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/transport.py", line 388, in perform_request
rubrix_1 | timeout=timeout,
rubrix_1 | File "/usr/local/lib/python3.7/site-packages/elasticsearch/connection/http_urllib3.py", line 264, in perform_request
rubrix_1 | raise ConnectionError("N/A", str(e), e)
rubrix_1 | elasticsearch.exceptions.ConnectionError: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7fd72c079b50>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7fd72c079b50>: Failed to establish a new connection: [Errno 111] Connection refused)
rubrix_1 |
rubrix_1 | [2021-05-04 16:23:21 +0000] [40] [ERROR] Application startup failed. Exiting.
On small browser, move the button to not hide the "create label feature". Show it under, aligned with the first record line
When a refresh is applied on exploration/annotation mode, the pagination status is lost.
Using current pagination style, the solution is not simple:
A classic pagination style (with pages) could mitigate these problems. What do you think @Amelie-V and @leiyre ??
Hi! I think we've moved enought in the documentation process to update our beautiful README. In my opinion, two main tasks have to be adressed:
So we can discuss here how to approach this. My proposal:
Tell me what do you think 🤠
Make it more explicit. (To design)
Similar to streamlit doc, with direct links instead of local link to pages.
When deleting a data set in the UI, a confirmation modal pops up if you really want to delete the data set. It would be nice if this modal explicitly states the name of the data set to be deleted.
/stable/ and not latest.Add this somewhere in the docs (probably in the Rubrix UI guide):
// Commons search fields
annotated_as
annotated_by
event_timestamp
id
last_updated
metadata.*
multi_label
predicted
predicted_as
predicted_by
status
words
// Text classification
inputs.*
score
// Token classification
tokens
To show in upper readme, where RUBRIX was written.
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.