Giter VIP home page Giter VIP logo

pepealessio / cr_pepper_shoppingbot Goto Github PK

View Code? Open in Web Editor NEW
4.0 0.0 2.0 197.3 MB

ROS implementation of shopping bot manager on Pepper. This is for an university project.

License: MIT License

CMake 20.29% Python 79.29% Shell 0.42%
conversational-ai conversational-bots pepper pepper-robot naoqi naoqi-python pyaudio speech-recognition shopping-cart shopping-bot cognitive cognitive-robotics artificial-intelligence ai artificial-vision deep-speaker

cr_pepper_shoppingbot's Introduction

Cognitive Robotics

Final project - Pepper list assistant

In this file you can see how to launch all things described in the file report.pdf.

Application Demo

Application Demo

Authors:

How to run the application

  1. Find the michrophone index using the code

    import sounddevice as sd
    sd.query_devices()
    
  2. Set the index just found in the config file (line 41) as:

    # pyAudio microphone idex. That need to be changed basing on the device. 
    MICROPHONE_INDEX = 2
    
  3. Launch the chatbot server. This take about 60 seconds to start.

    # go in your ros workspace
    source devel/setup.bash
    roslaunch ros_chatbot chatbot.launch
    
  4. Launch the pepper nodes.

    # go in your ros workspace
    source devel/setup.bash
    roslaunch pepper_nodes pepper.launch
    
  5. Launch the core application (wait until the other two are ready).

    # go in your ros workspace
    source devel/setup.bash
    roslaunch fp_audio core.launch
    

Alternatively to the step 3, 4, and 5, you can launch as

# go in your ros workspace
source devel/setup.bash
roslaunch fp_audio all.launch

How to run the application (simulating pepper)

  1. Set the index as default in the config file (line 41) as:

    # pyAudio microphone idex. That need to be changed basing on the device. 
    MICROPHONE_INDEX = None
    

    and, at line 45,

    # Flag: If False, the services who need Pepper are not called. Useful for debug.
    # -- In the use must be True.
    ON_PEPPER = False
    
  2. Launch the chatbot server. This take about 60 seconds to start.

    # go in your ros workspace
    source devel/setup.bash
    roslaunch ros_chatbot chatbot.launch
    
  3. Launch the core application that simulate the pepper webcam (wait until the other two are ready).

    # go in your ros workspace
    source devel/setup.bash
    roslaunch fp_audio core_s.launch
    

How to run the tests

To run the re-identification test, use the following commands:

# go in your ros workspace
source devel/setup.bash
roslaunch fp_audio test_reidentification.launch

To run the detector test, use the following commands:

# go in your ros workspace
source devel/setup.bash
roslaunch fp_audio test_detector.launch

To run th integration test ROS and RASA

# go in your ros workspace
source devel/setup.bash
roslaunch ros_chatbot dialogue.xml

cr_pepper_shoppingbot's People

Contributors

alfonsocom avatar pepealessio avatar

Stargazers

 avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.