Import Medicare Data into Neo4j

This project uses maven, to build a jar-file with the procedure in this project, simply package the project with maven:

mvn clean package

This will produce a jar-file, target/medicare-1.0-SNAPSHOT.jar, that can be copied to the plugin directory of your Neo4j instance.

cp target/medicare-1.0-SNAPSHOT.jar neo4j-enterprise-3.5.6/plugins/.

Restart your Neo4j Server. Your new Stored Procedures are available:

CALL com.maxdemarzi.schema.generate();

CALL com.maxdemarzi.import(reltype, file)
CALL com.maxdemarzi.import("PRESCRIBED_2017", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_17.txt")

CALL com.maxdemarzi.import.shared(reltype, file)
CALL com.maxdemarzi.import.shared("SHARED_2015", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2015-days30.txt")

Download and unzip data (warning, large files ahead):

Medicare Provider Charge Data

• 2017
• 2016
• 2015
• 2014
• 2013

Exclusion List (fraudsters)

• Latest

FDA Drug Data

• Latest

CMS Physician Shared Patient Patterns Data

• 2015 30 Day
• 2014 30 Day
• 2013 30 Day
• 2012 30 Day
• 2011 30 Day
• 2010 30 Day
• 2009 30 Day

1. Create the Schema:

    CALL com.maxdemarzi.schema.generate();
   

2. Import the PartD files in reverse order (10-15 minutes each):

    CALL com.maxdemarzi.import("PRESCRIBED_2017", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_17.txt")
    CALL com.maxdemarzi.import("PRESCRIBED_2016", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_16.txt")
    CALL com.maxdemarzi.import("PRESCRIBED_2015", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_15.txt")
    CALL com.maxdemarzi.import("PRESCRIBED_2014", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_14.txt")
    CALL com.maxdemarzi.import("PRESCRIBED_2013", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/PartD_Prescriber_PUF_NPI_Drug_13.txt")
   

3. Import the Exclusions (10 seconds):

    USING PERIODIC COMMIT 
    LOAD CSV WITH HEADERS FROM "file:///exclusions-06-2019.csv" AS line WITH line
    MATCH (p:Provider {npi: line.NPI})
    SET p:Fraudster, p.excluded_date = date(line.EXCLDATE)
   

4. Import the Shared Patients:

    CALL com.maxdemarzi.import.shared("SHARED_2015", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2015-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2014", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2014-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2013", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2013-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2012", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2012-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2011", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2011-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2010", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2010-days30.txt")
    CALL com.maxdemarzi.import.shared("SHARED_2009", "/Users/maxdemarzi/Documents/Projects/medicare/neo4j-enterprise-3.5.7/import/physician-shared-patient-patterns-2009-days30.txt")