Comments (4)
Consider this situation from a PublishedRecords
view, where the URL for access is split between two parsed fields:
mods_location_url_@usage_primary (38,269)
mods_location_url_@usage_primary_@access_object_in_context (1,422)
The 1,422 are from Western, and parse slightly different. Would it make sense to allow for multiple field mapping? n:1
?
from combine.
Some experimental progress on this:
- new
DPLAJobMap
model- with default
None
values for a handful of useful fields from here
- with default
- indexed fields table identifies mappings, shows in table
- Record page identifiers mappings, shows mapped DPLA fields at top (including thumbnail)
Next steps:
- UI for mapping fields
- dropdown in indexed fields table from Job details?
- associate at the field details level, one-by-one?
- for sanity's sake, will need to be able to save mappings
- current
DPLAJobMap
instances are associated with job, but when hypothetically selecting a saved mapping, could select a previously used one? do they need a name?
- current
Selecting mappings from previous jobs solves some problems, like how to propagate from job-to-job in a natural harvest --> transform --> merge (maybe) --> publish workflow. But, because they are linked to job, you run the risk of it disappearing if you delete that job.
from combine.
After some conversations, the point was made that it might make sense to "pin" this DPLA mapping to the transformation, and not the Job.
Pros
- would persist if jobs deleted
- after a transform, mappings would already be in place (very nice)
- could tweak mapping from within a job (field-by-field), which would save to the more global mapping
Cons
- what about jobs that are not transforms? would selecting a mapping from a transform be awkward? is that, in fact, pointing at some other underlying issue?
- if mapping includes fields that are not present for a job, but were then mapped from a job on-the-fly, the user would unwittingly be removing a mapping they could not see
from combine.
For the time being, leaving "pinned" to Job. Might revisit when looking into actual DPLA mapping with Ingestion3 code.
from combine.
Related Issues (20)
- Investigate migrating to PostgreSQL HOT 1
- Clarify wording on configuration 'payloads'
- Add data migration to seed standard local xslt includes
- Update to Django 2.2
- have discussion about tabular / spreadsheet harvesting
- Release 0.10 HOT 4
- Implement clever workaround for accessing livy and spark sessions w/o opening ports HOT 1
- Local-ified HTTP includes should add the name of the include?
- Wrap user-provided python code in RestrictedPython HOT 1
- use refactored OAI engine from Ingestion3
- Release 0.11, docker-ized HOT 2
- Add a more accurate message to the "Is Valid" field when a job did not include validation HOT 1
- Disable user-submitted python code by default HOT 3
- Add 'Last Modified' column to Organization Record Groups page HOT 1
- Gracefully import TransformationScenarios and TransformJobs HOT 1
- Some combine administrative pages don't forward anonymous users to the login page.
- XML errors not accurately transmitted
- Stop having foreign key references to User on exportable objects
- Display of /combine/organization/SomeOrgNum fails when Record Groups have no corresponding Jobs
- Combine Playbook URL does not work
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from combine.