nestauk / arxlive Goto Github PK

• introductory text
• explanations for charts

• API key
• ES Endpoint

Static files are served from S3 due to an issue with serving the JS for react from the static folder in the Lambda.

Due to using the flask_bootstrap plugin the static files from bootstrap are not located in the static folder. flask_s3 picks them up and pushes them to s3 during a create_all but they are still loaded from the local static folder by flask.

As a result, the static files are duplicated, in both the S3 bucket and also uploaded to Lambda.

I wasn't able to find a way to point bootstrap at s3 without setting up a CDN.

Once this is solved the static folder can be excluded from upload to lambda by amending zappa_settings.json

The analysis gives quite different results to the original paper and the charts need improvements. The following are known issues but is not exhaustive and not much feedback from the team has been incorporated yet.

• review the analysis in-depth in comparison to the original methods and fix any problems
• bar charts are hard to read, consider adjusting the colours (within brand), making them wider, increasing the spacing between bars, implementing horizontal lines on the tick marks, reducing the number of countries shown. (but keep them clean)
• figure 4 needs a fair amount of work: removal of lines joining the points as they are not related, rotating 90˚ so the labels are easier to read. Or, preferably: rebuilding as a slope chart
• figure 5 has considerably different results to the original paper. the analysis needs to be checked. different methods of geocoding were used (in particular Hong Kong is gone and Taiwan has appeared). This could also be better as a slope chart.
• Juan has requested another version of figure 5 by region/city
• It was planned to include one of the violin charts as they tell an interesting story, but perhaps as multiple area charts as the most interesting part (IMO) is the change in distribution
• the pre/post 2012 threshold needs to be reconsidered for a changing dataset
• figure 3 is interesting but won't change very often. Could this be accompanied by an additional, more zoomed in version with a moving window.
• it was initially planned to include a league table, this could be accomplished by exporting to json and then loading this in the front end, perhaps using: https://flask-table.readthedocs.io/en/stable/
• it would be useful to export a json file containing summary statistics from the latest run and displaying these in the front end, eg data of last run, latest article date, total articles
• Clio doesn't allow scrolling
• Consider calculating RCA with topic weight, rather than binary (means we don't need to select a filter weight, and should automatically account for baseline noise)

Perhaps the side bar component can have functionality to open and close it

Consider doing this with cloudfront.
Good tutorial here: https://www.freecodecamp.org/news/how-to-create-a-serverless-service-in-15-minutes-b63af8c892e5/

Lambda url appears to be static.

currently the settings are called dev but once it's publicised a second set of settings should be created to allow for a live and development environment

Home page

• Description of pipeline
• Links to the code
• Future development

Deep Learning Deep Change

• Description of what we found
• A statement that it's a live paper, with details of how collected, enriched, what tools etc.
• Link to blog
• Link to paper

HierarXy

• Hosting a React framework in the same repo
• Description of clio
• Description of novelty

Comms

• Launch conversation
• Branding conversation
• Subdomain conversation
• Subdomain integration

Deployment

• Full task chain runs in test and production mode
• Full task chain runs on a schedule, based on the latest tag of nestauk/nesta

Very basic user testing

• Share with IM team

Issues

• Write a list of issues based on all of the above, detailing extensions.
• Develop the spec for MVP+

Consider other options for nav that keep links to all the pages visible in the nav bar on mobile.

Bootstap navbar is responsive by default and seems tricky to make static.

Optional extra

• Highlight active menu item: https://jinja.palletsprojects.com/en/2.10.x/tricks/#highlighting-active-menu-items

Dear colleague,

In the interest of Nesta's charitable objects we recommend that you set an Open Source license. For more information, please read our guidelines.

Kind regards,

NestaBot

now there are some...

jquery should be added to the react code, hopefully this should fix it:

import 'jquery/src/jquery';