pomber / covid19 Goto Github PK

why this repo too slow not making it accurate atall

I am experimenting with the API and it would be useful to add country codes corresponding to each country.

Hi! I created a Ruby gem that can send GET requests to this URL with the region that they're looking for. You can access it here:

https://github.com/everythings-cancelled/pomber_covid19

I was thinking about adding in the README a list of adapters/wrappers for this data that are available. Would people have objections to that?

The data isn't updated today. At what time do you update 20th March's data? It's 8 PM EST. Please let me know if you ll be updating it everyday.

If it's a data issue please check the source repo first. We use the data from these files:

• Confirmed csv
• Deaths csv
• Recovered csv

If the error is there too, open an issue in that repo.

Is there any option to add testing numbers, to calculate the rate of postive tests daily.

Hi and thanks for the great work.
It seems that the data for the 23/03 and 24/04 seem to be exactly the same.
Thanks

Hey @pomber - awesome data source you've built here! I thought you'd want to know that US deaths have dropped to 0 over the last few dates.

I propose updating the JSON format to have a JSON array to make it simpler to parse it easily in a dynamic manner.

Current JSON format

{
	"Afghanistan": [{
			"date": "2020-1-22",
			"confirmed": 0,
			"deaths": 0,
			"recovered": 0
		},
		{
			"date": "2020-1-23",
			"confirmed": 0,
			"deaths": 0,
			"recovered": 0
		}
	],
	"Albania": [{
			"date": "2020-1-22",
			"confirmed": 0,
			"deaths": 0,
			"recovered": 0
		},
		{
			"date": "2020-1-23",
			"confirmed": 0,
			"deaths": 0,
			"recovered": 0
		}
	]
}

Proposed JSON format

{
	"countryWise": [
		{
			"country": "Afghanistan",
			"timeSeries": [
				{
					"date": "2020-4-16",
					"confirmed": 840,
					"deaths": 30,
					"recovered": 54
				},
				{
					"date": "2020-4-16",
					"confirmed": 840,
					"deaths": 30,
					"recovered": 54
				}
			]
		},
		{
			"country": "Albania",
			"timeSeries": [
				{
					"date": "2020-4-16",
					"confirmed": 840,
					"deaths": 30,
					"recovered": 54
				},
				{
					"date": "2020-4-16",
					"confirmed": 840,
					"deaths": 30,
					"recovered": 54
				}
			]
		},
		{
			"country": "Unknown",
			"timeSeries": [
				{
					"date": "2020-4-16",
					"confirmed": 840,
					"deaths": 30,
					"recovered": 54
				}
			]
		}
	]
}

Please reference the new files time_series_covid19_confirmed_global.csv and time_series_covid19_deaths_global.csv

News from CSSEGISandData / COVID-19 repository
---DEPRECATED WARNING---
The files below will no longer be updated. With the release of the new data structure, we are updating our time series tables to reflect these changes. Please reference time_series_covid19_confirmed_global.csv and time_series_covid19_deaths_global.csv for the latest time series data.

time_series_19-covid-Confirmed.csv
time_series_19-covid-Deaths.csv
time_series_19-covid-Recovered.csv

Hey, great project! It's nice having a cached JSON representation of CSSEGISandData/COVID on github!

What do you think about adding lat / long attributes? Also province/states (maybe in a separate JSON file)?

I can help if it is something you're interested in.

It looks like CSSE is reorganizing their data, and they are removing recovered, and adding a testing file.

Here

Without breaking current api, we can add a timestamp.json file that contains
{ lastUpdated: timestamp }

pls why is the cases taking too long to update, how can that be improved

I think the data should provide a JSON key of source for each country, where's the data fetch from?

For example:

Thailand: {
      ...currentData,
      source: {
          provider: "government",
          link: "some URL",
          update: "some date format"
     }
}

The description says "Updated three times a day using GitHub Actions." but the last data (Germany) is from 2020-03-17 and today is 2020-03-18. In your json there are 9257 currently infected and the data of CSSEGISandData/COVID-19 says there are already 11.973.

I hope you can fix this.

If it's a data issue please check the source repo first. We use the data from these files:

• Confirmed csv
• Deaths csv
• Recovered csv

If the error is there too, open an issue in that repo.

hello pomber you have been doing a great job so far but let make it more super , data from US are not always up to date for the past days please Add more time schedule and more run like 10-15 more runs is not bad Thanks .

Recovered csv --- PAGE MISSING

As of 2020-03-26, both the Bahamas and Gambia return None instead of 0 for every value of corresponding to the recovered key. No issues with any other country and no issues with deaths or confirmed keys.

python3 code

import requests
import json
rq = requests.get("https://pomber.github.io/covid19/timeseries.json")
data = json.loads(rq.content)

for country in data.keys():                                                    
    for dt in data[country]:                                                   
        if not isinstance(dt['recovered'], int):                               
            print(f"{country} - {dt['date']} - {dt['recovered']} - {type(dt['recovered'])}")

Bahamas - 2020-1-22 - None - <class 'NoneType'>
Bahamas - 2020-1-23 - None - <class 'NoneType'>
Bahamas - 2020-1-24 - None - <class 'NoneType'>
Bahamas - 2020-1-25 - None - <class 'NoneType'>
Bahamas - 2020-1-26 - None - <class 'NoneType'>
Bahamas - 2020-1-27 - None - <class 'NoneType'>
Bahamas - 2020-1-28 - None - <class 'NoneType'>
Bahamas - 2020-1-29 - None - <class 'NoneType'>
Bahamas - 2020-1-30 - None - <class 'NoneType'>
Bahamas - 2020-1-31 - None - <class 'NoneType'>
Bahamas - 2020-2-1 - None - <class 'NoneType'>
Bahamas - 2020-2-2 - None - <class 'NoneType'>
Bahamas - 2020-2-3 - None - <class 'NoneType'>
Bahamas - 2020-2-4 - None - <class 'NoneType'>
Bahamas - 2020-2-5 - None - <class 'NoneType'>
Bahamas - 2020-2-6 - None - <class 'NoneType'>
Bahamas - 2020-2-7 - None - <class 'NoneType'>
Bahamas - 2020-2-8 - None - <class 'NoneType'>
Bahamas - 2020-2-9 - None - <class 'NoneType'>
Bahamas - 2020-2-10 - None - <class 'NoneType'>
Bahamas - 2020-2-11 - None - <class 'NoneType'>
Bahamas - 2020-2-12 - None - <class 'NoneType'>
Bahamas - 2020-2-13 - None - <class 'NoneType'>
Bahamas - 2020-2-14 - None - <class 'NoneType'>
Bahamas - 2020-2-15 - None - <class 'NoneType'>
Bahamas - 2020-2-16 - None - <class 'NoneType'>
Bahamas - 2020-2-17 - None - <class 'NoneType'>
Bahamas - 2020-2-18 - None - <class 'NoneType'>
Bahamas - 2020-2-19 - None - <class 'NoneType'>
Bahamas - 2020-2-20 - None - <class 'NoneType'>
Bahamas - 2020-2-21 - None - <class 'NoneType'>
Bahamas - 2020-2-22 - None - <class 'NoneType'>
Bahamas - 2020-2-23 - None - <class 'NoneType'>
Bahamas - 2020-2-24 - None - <class 'NoneType'>
Bahamas - 2020-2-25 - None - <class 'NoneType'>
Bahamas - 2020-2-26 - None - <class 'NoneType'>
Bahamas - 2020-2-27 - None - <class 'NoneType'>
Bahamas - 2020-2-28 - None - <class 'NoneType'>
Bahamas - 2020-2-29 - None - <class 'NoneType'>
Bahamas - 2020-3-1 - None - <class 'NoneType'>
Bahamas - 2020-3-2 - None - <class 'NoneType'>
Bahamas - 2020-3-3 - None - <class 'NoneType'>
Bahamas - 2020-3-4 - None - <class 'NoneType'>
Bahamas - 2020-3-5 - None - <class 'NoneType'>
Bahamas - 2020-3-6 - None - <class 'NoneType'>
Bahamas - 2020-3-7 - None - <class 'NoneType'>
Bahamas - 2020-3-8 - None - <class 'NoneType'>
Bahamas - 2020-3-9 - None - <class 'NoneType'>
Bahamas - 2020-3-10 - None - <class 'NoneType'>
Bahamas - 2020-3-11 - None - <class 'NoneType'>
Bahamas - 2020-3-12 - None - <class 'NoneType'>
Bahamas - 2020-3-13 - None - <class 'NoneType'>
Bahamas - 2020-3-14 - None - <class 'NoneType'>
Bahamas - 2020-3-15 - None - <class 'NoneType'>
Bahamas - 2020-3-16 - None - <class 'NoneType'>
Bahamas - 2020-3-17 - None - <class 'NoneType'>
Bahamas - 2020-3-18 - None - <class 'NoneType'>
Bahamas - 2020-3-19 - None - <class 'NoneType'>
Bahamas - 2020-3-20 - None - <class 'NoneType'>
Bahamas - 2020-3-21 - None - <class 'NoneType'>
Bahamas - 2020-3-22 - None - <class 'NoneType'>
Bahamas - 2020-3-23 - None - <class 'NoneType'>
Bahamas - 2020-3-24 - None - <class 'NoneType'>
Bahamas - 2020-3-25 - None - <class 'NoneType'>
Bahamas - 2020-3-26 - None - <class 'NoneType'>
Gambia - 2020-1-22 - None - <class 'NoneType'>
Gambia - 2020-1-23 - None - <class 'NoneType'>
Gambia - 2020-1-24 - None - <class 'NoneType'>
Gambia - 2020-1-25 - None - <class 'NoneType'>
Gambia - 2020-1-26 - None - <class 'NoneType'>
Gambia - 2020-1-27 - None - <class 'NoneType'>
Gambia - 2020-1-28 - None - <class 'NoneType'>
Gambia - 2020-1-29 - None - <class 'NoneType'>
Gambia - 2020-1-30 - None - <class 'NoneType'>
Gambia - 2020-1-31 - None - <class 'NoneType'>
Gambia - 2020-2-1 - None - <class 'NoneType'>
Gambia - 2020-2-2 - None - <class 'NoneType'>
Gambia - 2020-2-3 - None - <class 'NoneType'>
Gambia - 2020-2-4 - None - <class 'NoneType'>
Gambia - 2020-2-5 - None - <class 'NoneType'>
Gambia - 2020-2-6 - None - <class 'NoneType'>
Gambia - 2020-2-7 - None - <class 'NoneType'>
Gambia - 2020-2-8 - None - <class 'NoneType'>
Gambia - 2020-2-9 - None - <class 'NoneType'>
Gambia - 2020-2-10 - None - <class 'NoneType'>
Gambia - 2020-2-11 - None - <class 'NoneType'>
Gambia - 2020-2-12 - None - <class 'NoneType'>
Gambia - 2020-2-13 - None - <class 'NoneType'>
Gambia - 2020-2-14 - None - <class 'NoneType'>
Gambia - 2020-2-15 - None - <class 'NoneType'>
Gambia - 2020-2-16 - None - <class 'NoneType'>
Gambia - 2020-2-17 - None - <class 'NoneType'>
Gambia - 2020-2-18 - None - <class 'NoneType'>
Gambia - 2020-2-19 - None - <class 'NoneType'>
Gambia - 2020-2-20 - None - <class 'NoneType'>
Gambia - 2020-2-21 - None - <class 'NoneType'>
Gambia - 2020-2-22 - None - <class 'NoneType'>
Gambia - 2020-2-23 - None - <class 'NoneType'>
Gambia - 2020-2-24 - None - <class 'NoneType'>
Gambia - 2020-2-25 - None - <class 'NoneType'>
Gambia - 2020-2-26 - None - <class 'NoneType'>
Gambia - 2020-2-27 - None - <class 'NoneType'>
Gambia - 2020-2-28 - None - <class 'NoneType'>
Gambia - 2020-2-29 - None - <class 'NoneType'>
Gambia - 2020-3-1 - None - <class 'NoneType'>
Gambia - 2020-3-2 - None - <class 'NoneType'>
Gambia - 2020-3-3 - None - <class 'NoneType'>
Gambia - 2020-3-4 - None - <class 'NoneType'>
Gambia - 2020-3-5 - None - <class 'NoneType'>
Gambia - 2020-3-6 - None - <class 'NoneType'>
Gambia - 2020-3-7 - None - <class 'NoneType'>
Gambia - 2020-3-8 - None - <class 'NoneType'>
Gambia - 2020-3-9 - None - <class 'NoneType'>
Gambia - 2020-3-10 - None - <class 'NoneType'>
Gambia - 2020-3-11 - None - <class 'NoneType'>
Gambia - 2020-3-12 - None - <class 'NoneType'>
Gambia - 2020-3-13 - None - <class 'NoneType'>
Gambia - 2020-3-14 - None - <class 'NoneType'>
Gambia - 2020-3-15 - None - <class 'NoneType'>
Gambia - 2020-3-16 - None - <class 'NoneType'>
Gambia - 2020-3-17 - None - <class 'NoneType'>
Gambia - 2020-3-18 - None - <class 'NoneType'>
Gambia - 2020-3-19 - None - <class 'NoneType'>
Gambia - 2020-3-20 - None - <class 'NoneType'>
Gambia - 2020-3-21 - None - <class 'NoneType'>
Gambia - 2020-3-22 - None - <class 'NoneType'>
Gambia - 2020-3-23 - None - <class 'NoneType'>
Gambia - 2020-3-24 - None - <class 'NoneType'>
Gambia - 2020-3-25 - None - <class 'NoneType'>
Gambia - 2020-3-26 - None - <class 'NoneType'>

Thank you for providing this data. Can you provide the last updated timestamp in the object? That would be helpful to understand the last time the numbers where run.

Thanks for your work to help the people in need! Your site has been added! I currently maintain the Open-Source-COVID-19 page, which collects all open source projects related to COVID-19, including maps, data, news, api, analysis, medical and supply information, etc. Please share to anyone who might need the information in the list, or will possibly contribute to some of those projects. You are also welcome to recommend more projects.

http://open-source-covid-19.weileizeng.com/

Cheers!

Recovered data is not available for 24/03/2020.

I tried to add my project to "Projects using this dataset" however its not showing up in
https://github.com/pomber/covid19

I am not a collaboration expert. So I think I was missing a step.

Here is what I did:

I clicked on "+Add yours" then appended my item at the bottom of the appropriate list then hit "Propose Change":

My edit was something like this:

• covid19.py(repo): Charts in normal and log axes, shows ratio of changes per day as well.

I created this website with a voting system and filter by country (http://covid-19-coronavirus.tools) where dashboards and datasets, related to the coronavirus, will be collected.
I just added your repository. I hope you appreciate this.

Github repository of the React website: https://github.com/Biuni/covid-19

Please, can you provide date in ISO 8601 format?

checkout their crowdsourced site:
www.covid19india.org
and API:
https://api.covid19india.org/

Hi,

I am not able to fetch data for 2nd April 2020

Please could you enable CORS server-side?

It's still stuck at 21st March 2020. The timeliness of the data is crucial.

If it's a data issue please check the source repo first. We use the data from these files:

• Confirmed csv
• Deaths csv
• Recovered csv

If the error is there too, open an issue in that repo.

As of march 27th:

In JSON: 3291
Real: 26853

1. What should I do to get the data only from France?

I open the (https://covid19-graphql.now.sh/) site and play the following query

{
  country(name:"France") {
    results {
      date
      confirmed
      recovered
      deaths
      growthRate
    }
  }
}

I need only France, so I copy the query as fetch

fetch("https://covid19-graphql.now.sh/", {
        "credentials": "omit",
        "headers": {
            "accept": "*/*",
            "accept-language": "fr,ru;q=0.9,en;q=0.8,en-US;q=0.7,ro;q=0.6,de;q=0.5",
            "cache-control": "no-cache",
            "content-type": "application/json",
            "pragma": "no-cache",
            "sec-fetch-dest": "empty",
            "sec-fetch-mode": "cors",
            "sec-fetch-site": "same-origin"
        },
        "referrer": "https://covid19-graphql.now.sh/",
        "referrerPolicy": "no-referrer-when-downgrade",
        "body": "{\"operationName\":null,\"variables\":{},\"query\":\"{\\n  country(name: \\\"France\\\") {\\n    results {\\n      date\\n      confirmed\\n      recovered\\n      deaths\\n      growthRate\\n    }\\n  }\\n}\\n\"}",
        "method": "POST",
        "mode": "cors"
    })

expecting to obtain

{
  "data": {
    "country": {
      "results": [
        {
          "date": "2020-1-22",
          "confirmed": 0,
          "recovered": 0,
          "deaths": 0,
          "growthRate": 0
        },
        {
          "date": "2020-1-23",
          "confirmed": 0,
          "recovered": 0,
          "deaths": 0,
          "growthRate": null
        },

        { ... },

        {
          "date": "2020-3-27",
          "confirmed": 33402,
          "recovered": 5707,
          "deaths": 1997,
          "growthRate": 0.13031707894825895
        },
        {
          "date": "2020-3-28",
          "confirmed": 38105,
          "recovered": 5724,
          "deaths": 2317,
          "growthRate": 0.14079995209867674
        }
      ]
    }
  }
}

2. Is it possible, in order do not need to parse the data, the date to be in UTC milliseconds?

Can you make a "country" called "Global" or "Total" which is just the sum of all of the countries?
its up to you
I personally do it my self in my tool:
https://github.com/bhbmaster/covid19/blob/master/README.md
It will benefit all of the tools that use yours as users will be able to see global.
Curious what the global logarithmic best fit is (some of your json users provide this metric)

What would the level of effort be for you to provide a historical analysis identical to timeseries.json but for US states?

In order to compile that data from JHU, I would currently have to make an API call for every single date since 2020-01-22. (i.e. https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_daily_reports_us/04-16-2020.csv)

Make sense?

Data not updated for any country since 21st March 2020

I would like to pass the data from a json url to jquery array.

The URL is as follows https://pomber.github.io/covid19/timeseries.json

She returns me IDS as below:

{"Afghanistan": [{"date": "2020-1-22", "confirmed": 0, "deaths": 0, "recovered": 0}, {"date": "2020-1-23" , "confirmed": 0, "deaths": 0, "recovered": 0}, {"date": "2020-1-24", "confirmed": 0, "deaths": 0, "recovered": 0

}, ....
However, I would like to ignore the country ID and group all the data in date, confirmed cases, deaths, recovered, to have a complete series.

It would look something like this:

["2020-1-22", 156, 211, 418], ["2020-1-23", 310, 245, 301], ...

If you can help me, I would be grateful.

New Caledonia is not in your JSON but is available in the source.

Some news state that China got 1st case by November 17th

I don't know how to fetch multiple country data in android. I can fetch a single country data I cannot iterate for all.please help me to find a way

Data unavailable for April 23rd, 2020.
Data present here https://github.com/CSSEGISandData/COVID-19.
Please check!

I have observed that data have repetition for many countries. for example data of 22nd march and 23rd march is same for many countries. This is a bug.

I have an issue with the data for Poland. It shows 13 people who have recovered on 18th but only 1 person on 19th. Shouldn't it remain the same or increase?

Minor priority

Would greatly increase performance. Then the fetching wont download via network all the countries.

Right now ->
https://pomber.github.io/covid19/timeseries.json

Could be ->
https://pomber.github.io/covid19/timeseries.json?country=thailand

As per CSSEGISandData/COVID-19#2369 the cron job on this repo should be updated accordingly.

of all the analyses derived from and listed on https://github.com/pomber/covid19/ of which i like https://paroj.github.io/arewedeadyet/ the most i couldnot yet find any single one charting the spacetime evolution of the epidemiological https://en.wikipedia.org/wiki/basic_reproduction_number https://en.wiktionary.org/wiki/R₀ supposed to have fallen from >1.0 via 0.9 to now 0.7 in Germany this week, so can somebody quicker than me in the necessary calculations add that somewhere?

Today the values stopped updating. I think the values today and yesterday are the same for all countries

Support for something like query parameters is very vital for use in any project. Sorting by countries, and time in the endpoint itself is important than just dumping all data since the mentioned date.

If it's a data issue please check the source repo first. We use the data from these files:

• Confirmed csv
• Deaths csv
• Recovered csv

If the error is there too, open an issue in that repo.

The current data set is now reporting all recovered values as null.

The upstream data source has changed their data structure and file naming convention. See the README.

time_series_19-covid-Recovered.csv is no longer available. It has been replaced with time_series_covid19_recovered_global.csv.

Turkey's data not updated since 2 days. Plase update it

Hello 🙌🏻

What do you think about adding global (total) data for all countries?
It will be helpful for my charts, but I not sure that count it every time is best idea.