mlbazaar / piex Goto Github PK

View Code? Open in Web Editor NEW

17.0 17.0 6.0 5.86 MB

Pipeline Explorer - Explore and analyze millions of pipelines learned using MLBlocks and MLPrimitives.

Home Page: https://mlbazaar.github.io/piex/

License: MIT License

Makefile 2.42% Python 7.88% Shell 0.71% Jupyter Notebook 88.99%

piex's People

Contributors

Stargazers

Watchers

Forkers

csala pvk-developer hyperdimensions pythiac minghao2016 stjordanis

piex's Issues

Attempt unsigned downloads if AWS credentials not found

D3M Pipeline Explorer version: 0.1.1
Python version: 3.6.8
Operating System: Linux eb804d3cf037 4.9.125-linuxkit #1 SMP Fri Sep 7 08:20:28 UTC 2018 x86_64 GNU/Linux

Description

piex fails to download publicly-available pipelines if the user has not populated an AWS credentials files. This should succeed without any configuration.

What I Did

I try to run the following in an environment without AWS credentials

import piex.explorer
ex = piex.explorer.S3PipelineExplorer('ml-pipelines-2018')
ex.get_pipelines()

But I get the following credential-related error.

Traceback (most recent call last):       
  File "./main.py", line 238, in <module>                                                                                        
    main()                      
  File "./main.py", line 226, in main                                                                                            
    make_table_1()                           
  File "./main.py", line 117, in make_table_1                                                                                    
    df = load_pipelines_df(ex=ex)
  File "/usr/local/lib/python3.6/site-packages/funcy/calc.py", line 44, in wrapper                                               
    value = memory[key] = func(*args, **kwargs)
  File "./main.py", line 40, in load_pipelines_df                                                                                
    df = ex.get_pipelines() 
  File "/usr/local/lib/python3.6/site-packages/piex/explorer.py", line 280, in get_pipelines                                     
    df = self._load_table('pipelines')
  File "/usr/local/lib/python3.6/site-packages/piex/explorer.py", line 252, in _load_table
    df = self._get_table(table_name)                                                                                             
  File "/usr/local/lib/python3.6/site-packages/piex/explorer.py", line 234, in _get_table
    obj = s3.get_object(Bucket=self.bucket, Key=key)
  File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 320, in _api_call                                       
    return self._make_api_call(operation_name, kwargs)
  File "/usr/local/lib/python3.6/site-packages/botocore/client.py", line 611, in _make_api_call                                  
    operation_model, request_dict)
  File "/usr/local/lib/python3.6/site-packages/botocore/endpoint.py", line 102, in make_request                                  
    return self._send_request(request_dict, operation_model)
  File "/usr/local/lib/python3.6/site-packages/botocore/endpoint.py", line 132, in _send_request                                 
    request = self.create_request(request_dict, operation_model)
  File "/usr/local/lib/python3.6/site-packages/botocore/endpoint.py", line 116, in create_request                                
    operation_name=operation_model.name)
  File "/usr/local/lib/python3.6/site-packages/botocore/hooks.py", line 356, in emit                                             
    return self._emitter.emit(aliased_event_name, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/botocore/hooks.py", line 228, in emit                                             
    return self._emit(event_name, kwargs)
  File "/usr/local/lib/python3.6/site-packages/botocore/hooks.py", line 211, in _emit                                            
    response = handler(**kwargs)
  File "/usr/local/lib/python3.6/site-packages/botocore/signers.py", line 90, in handler                                         
    return self.sign(operation_name, request)
  File "/usr/local/lib/python3.6/site-packages/botocore/signers.py", line 157, in sign                                           
    auth.add_auth(request)
  File "/usr/local/lib/python3.6/site-packages/botocore/auth.py", line 425, in add_auth                                          
    super(S3SigV4Auth, self).add_auth(request)
  File "/usr/local/lib/python3.6/site-packages/botocore/auth.py", line 357, in add_auth                                          
    raise NoCredentialsError
botocore.exceptions.NoCredentialsError: Unable to locate credentials                                                             
make: *** [run] Error 1

get_templates ignores filters

D3M Pipeline Explorer version: 0.1.1
Python version: 3.6.2
Operating System: Ubuntu 16.04.5 LTS

Description

I expect ex.get_templates(data_type='image') to return only template for images, but it returns all templates. Looking at the source, **filters is unused.

Furthermore, it is confusing that ex.get_templates returns data_type as a column whereas ex.get_datasets and ex.get_pipelines return data_modality as a column. There are probably other name mismatches.

Pin setup.py versions

After some of our dependencies made new releases, the scores have started not being reproducible.
We need to pin the setup.py dependencies to exact versions to ensure reproducibility.

Make MLBlocks an optional dependency

MLBlocks is a pretty heavy-weight dependency as it requires tensorflow, xgboost, etc. to be installed. To just "explore" pipelines from S3, users shoudn't need MLBlocks.

Desired functionality:

for all methods except PipelineExplorer.score_pipeline and Pipeline.score_template, MLBlocks should not need to be installed
if the user wants to score pipelines or templates using PipelineExplorer.score_pipeline and Pipeline.score_template, they can enable this by pip install piex[mlblocks] (or piex[scoring] or piex[all] or some other variant)

Note that this would require a workaround for using MLPipeline to load pipelines/templates for the express purpose of extracting metadata from them

Integrate with Codecov

Integrate with Codecov to make sure all the changes from PR improve the code coverage of tests.
Update the readme file with the new badge.

get_best_pipeline should support filters

D3M Pipeline Explorer version: 0.2.0

Description

Most methods of PipelineExplorer and subclasses accept **filters kwargs, but some do not:

get_best_pipeline
load_best_pipeline
get_best_template
load_best_template

These methods should be modified to support filters.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.