This sample shows how to call the Google Assistant API from Android Things.

It records a spoken request from the connected microphones, sends it to the Google Assistant API and plays back the Assistant's spoken response on the connected speaker. Implements an API.AI Agent with a Firebase Function fulfillment backend, with a Firebase Database to syinc data to Android Things. Fulfillment of spoken request can be generated by Android Things or API.AI, then plays back the Assistant's spoken response on the connected speaker.

• Android Studio 2.2+.
• Android Things Joule Board.
• Android Things: supported microphone, speaker, and usb hub.
• Grove - LCD RGB Backlight.
• Google API Console Project.
• API.AI Agent An Actions project defines metadata about your app and lets you track your app through the approval process. An API.AI agent defines intents that map what users can say to a corresponding response, which is returned by fulfillment.
• Actions on Google lets developers build apps for the Google Assistant.
• Firebase Tools from Google for developing great apps, engaging with your users

• Configure the Google API Console Project to use the Google Assistant API.
• Download the client_secret_NNNN.json file from the credentials section of the Console.
• Use the google-oauthlib-tool to generate credentials:

pip install google-auth-oauthlib[tool]
google-oauthlib-tool --client-secrets client_secret_NNNN.json \
                     --credentials app/src/main/res/raw/credentials.json \
                     --scope https://www.googleapis.com/auth/assistant-sdk-prototype \
                     --save

• Make sure to set the Activity Controls for the Google Account using the application.
• Deploy the firebase-assistant-androidthings function, the PROJECT_ID need to match the one created in the above steps. Save the Function URL from the firebase deploy command.
• Go to the Actions on Google Developer Console.
  • Click on Add/Import project,
  • Click on Enter name or choose a project,
  • Find and Click on the project created in the above steps,
  • Click on Import Project,
• API.AI
  • Fill out the newAgent page
    • GOOGLE PROJECT: Needs to be set to the same project as created in the above steps.
    • Save
  • Click the settings icon next to the name of the Agent.
    • Click on Export and Import
    • Click on Import from Zip, Upload the JouleBoard.zip
    • Save
  • Click Integrations
    • Enable Actions on Google.
    • Set any Additional triggering intents.
    • Save/Update
  • Click Fulfillment
    • ENABLED Webhooks
    • set URL* to the firebase function URL from the above steps.
    • set DOMAINS to Enable webhook for all domains.
    • Save

• Connect the mic and speeker to a usb hub and plug the hub into the usb port on theJoule Board.
• Connect theGrove - LCD RGB Backlightto I2C0 on theJoule Board
• On the first install, grant the sample required permissions for audio and internet access:

./gradlew assembleDebug
adb install -g app/build/outputs/apk/app-debug.apk

• On Android Studio, click on the "Run" button or on the command line, type:

./gradlew installDebug
adb shell am start com.example.androidthings.assistant/.AssistantActivity

• Try the assistant Action on Google:
  • Press the button: recording starts.
  • Use the microphone to say "talk to" name of Action on Google you setup.
  • Release the button: recording stops.
  • The Google Assistant answer should playback on the speaker that it is featching the test vertion of your Action on Google.
  • Try saying things like:
    • "Display Hello World on LCD"
    • "Turn on LED 1"
    • "Turn off LED 1"
  • To Stop your Action on Google say "stop".

Copyright 2017 The Android Open Source Project, Inc.

Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to you under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.