Bookshelf has a test for MySQL:

    host := os.Getenv("GOLANG_SAMPLES_MYSQL_HOST")
    port := os.Getenv("GOLANG_SAMPLES_MYSQL_PORT")

Either use Cloud SQL or run a local MySQL to test them.

The sample code wasn't working for me due to a GRPC setting error:

2017/04/27 18:23:36 Could not recognize: code:3 message:"Client GRPC deadline too short. Should be at least: 3 * audio-duration + 5 seconds. Current deadline is: 199.99940906430129 second(s). Required at least: 204 second(s)." 

I fixed that by extending the deadline in the context:

        bgctx := context.Background()
	ctx, _ := context.WithDeadline(bgctx, time.Now().Add(240*time.Second))
	conn, err := transport.DialGRPC(ctx,
		option.WithEndpoint("speech.googleapis.com:443"),
		option.WithScopes("https://www.googleapis.com/auth/cloud-platform"),
	)

We create GCP resources such as Storage buckets and Pub/Sub topics to run the integration tests. These resources should be deleted if tests fail to clean them.

Build an internal package to generate timestamped resource names and provide a function to garbage collect existing resources if they have been around more than one day.

We can run collection in the beginning of every test or separately once every night once we have scheduled builds.

Please make some example that includes use of arrays.

I tried 'unmarshalling' the row element type []string into *[]string and []string, but it fails with this:

type []string cannot be used for decoding ARRAY[STRING]

I've tried running through the instructions, deploying both to GKE and GCE, but in both cases I get the same error when running the client:

$ go run client/main.go -api-key=$API_KEY -addr=$EXTERNAL_IP:80 hi
2017/10/29 14:58:34 could not greet: rpc error: code = Unavailable desc = transport is closing

I'm fairly new to gRPC, so this may not be applicable, but I tried using grpcc to connect, which gives me Error: Trying to connect an http1.x server. I've confirmed that the port specification in container-engine.yaml is correct (-P, not -p).

Our current approach to test these sample programs is tedious and repetitive. I end up writing the same amount of boring code again and again; first to construct the program and then to test the pieces of the same program.

Rather than writing an actual main package, we should consider the entire repo to be test files that will both illustrate how to use the cloud packages and to assert them.

Since we will tag the reference code with [START *] and [END *], I do think that the tests will be stll readable.

I wanna start doing this when writing snippets for the storage/objects.

/cc @broady

The cloud iot beta has examples for python node and java. Examples for golang are also needed thanks.

A Cloud Bigtable engineer suggested that the Cloud Bigtable search example could use a README. Ideally the README would cover all of the following information:

• Prerequisites (e.g., creating the table shakespearetemplate)
• Running the example
• Command-line options
• What port the server is listening on

Originally filed as googleapis/google-cloud-go#252, before the search example moved to this repo.

Need more support for doing temporary string replacements before deployment. Or adding files to the deployment (e.g., to set up config.go for bookshelf)

Tests don't use a unique topic/subscription name, so they're flaky.

They need to incorporate the project ID in them to ensure they don't conflict with tests run in parallel.

Build is broken:
https://travis-ci.org/GoogleCloudPlatform/golang-samples/builds/159763624

pubsub/subscriptions/main.go:43: sub.Name undefined (type *"cloud.google.com/go/pubsub".Subscription has no field or method Name, but does have "cloud.google.com/go/pubsub".name)

/cc @rakyll

Principle of least required data retention.

I followed the instructions for the Cloud Datastore getting started guide with Go:
https://cloud.google.com/datastore/docs/datastore-api-tutorial

Then I followed the instructions to run the local Datastore emulator:
https://cloud.google.com/datastore/docs/tools/datastore-emulator

Then I restarted my app:
go run tasks.go

The output looks like this (with the connection reset message just continuing indefinitely):
Cloud Datastore Task List

Usage:

new Adds a task with a description
done Marks a task as done
list Lists all tasks by creation time
delete Deletes a task

2016/04/04 21:56:30 transport: http2Client.notifyError got notified that the client transport was broken read tcp 127.0.0.1:51418->127.0.0.1:8687: read: connection reset by peer.
2016/04/04 21:56:30 transport: http2Client.notifyError got notified that the client transport was broken read tcp 127.0.0.1:51419->127.0.0.1:8687: read: connection reset by peer.
2016/04/04 21:56:30 transport: http2Client.notifyError got notified that the client transport was broken read tcp 127.0.0.1:51420->127.0.0.1:8687: read: connection reset by peer.

If I download and run the appengine_flexible/helloworld app, everything is fine.

If I make the tiniest adjustment and add appengine.NewContext(r) right above fmt.Fprint(w, "Hello world!") then I get a huge panic that results in appengine: NewContext passed an unknown http.Request

Is there something about this that's fundamentally wrong? Please help me, this has been absolutely bedeviling me.

This one doesn't work for me:
https://github.com/GoogleCloudPlatform/golang-samples/blob/master/datastore/snippets/snippet_test.go#L641-L663

query := datastore.NewQuery("__namespace__").
		Filter("__key__ >=", startNamespace).
		Filter("__key__ <", endNamespace).
		KeysOnly()

I see:
client.GetAll: rpc error: code = InvalidArgument desc = key filter value must be a Key
exit status 1

Looking at the ruby/gql examples, maybe it should be something like

.Filter("__key__ >=", datastore.NameKey("__namespace__", startNamespace, nil)

but I really have no idea.

@broady @rakyll

Seems stuck and no words are transcribed when run on macos desktop

Thank you for the great examples!

Could you add independent titles to the bookshelf app? I.e.

base.html

<title>
  {{ template "title" . }}
</title>

detail.html

{{ define "title" }}
  Detail
{{ end }}

{{ define "body" }}
...
{{ end }}

At the moment that doesn't work because all the included template content is put into "body". I'm having trouble finding an elegant solution with ParseGlob.

Any hints?

Hi,

I am trying to download the latest chrome browser from here and I am not able to access it anonymously. I have this script to download the chrome file, but it needs my service account creds created from my personal gmail account. Is there a way I can create a storage client without passing any sort of creds?

Thanks in advance.

The bigquery appengine example in Go uses (what I believe is) the old library

"google.golang.org/api/bigquery/v2"

instead of

"cloud.google.com/go/bigquery"

https://github.com/GoogleCloudPlatform/golang-samples/blob/master/appengine/bigquery/app.go

https://github.com/GoogleCloudPlatform/golang-samples/blob/master/datastore/snippets/snippet_test.go#L566

I don't think GetMulti guarantees that the order of the result is the same as the given keys. Please close if it does, but please fix this otherwise.

Across languages, we're trying to trim down the number of flags we include in the default app.yaml. In the case of Managed VMs, we should really only have:

runtime: go
vm: true

Specifically we want to avoid including resources and auto scaling, unless we're specifically showing a sample that works with those settings:

[START resources]

resources:
cpu: .5
memory_gb: 1.3
disk_size_gb: 10

[END resources]

[START scaling]

automatic_scaling:
min_num_instances: 1
max_num_instances: 5
cool_down_period_sec: 60
cpu_utilization:
target_utilization: 0.5

[END scaling]

Getting an error with the bookshelf app after accepting oauth scopes from login link:

could not save session: securecookie: the value is too long

Guessing it's coming from: https://github.com/gorilla/securecookie/blob/master/securecookie.go#L288

Occurring with deployed app. Any way I can debug this?

I'm setting up an Go App Engine flexible environment that can connect to Second Gen Cloud SQL instance.

The method provided in this repo requires authorizations for 0.0.0.0/0 so it's really insecure.

There is suppose to be another method: https://cloud.google.com/sql/docs/app-engine-connect#gaev2-csqlv2
However, it leads to an unknown network cloudsql or if the cloudsql dialer is added cloudsql: not supported in App Engine "flexible environment" error. (here is the reason for the second error https://github.com/golang/appengine/blob/master/cloudsql/cloudsql_vm.go)

Is the document on the cloud.google.com page suppose to work? If so, could the example in this repo be updated to show how to do this?

@broady

https://github.com/GoogleCloudPlatform/golang-samples/blob/master/datastore/snippets/snippet_test.go#L612

The linked example is supposed to check if an entity exists, and if it does not exist create it. It doesn't seem to actually verify if the entity exists between the get and create.

We currently have a big table with all examples for all GCP tools in the same place. I'm suggesting organizing the examples by category so they would be easier to browse.

Suggested categories:

• Management
• Compute
• Storage
• Networking
• Big Data
• Machine Learning

Please see:
https://www.slideshare.net/DanielaPetruzalek/google-cloud-platform-um-portal-para-a-era-do-machine-learning/21?src=clipshare

I've just submitted a bug fix (PR #305) for some broken samples for the vision API. The code used in the detectDocumentText sample is used on the website as well and hence needs fixing too: https://cloud.google.com/vision/docs/detecting-fulltext

Hello,

When following the tutorial, I'm unable to display images.
I'm using mongo for the DB, so I took a look at a record I created:

{ "_id" : ObjectId("565a09fbbc16007f3ce3bed6"), "id" : NumberLong("6011543483995065438"), "title" : "Hmm", "author"
 : "", "publisheddate" : "", "imageurl" : "https://storage.googleapis.com/&{%!s(*storage.ACLHandle=&{0xc8201d42c0 g
o-cloud-engine-tutorial  false}) %!s(*storage.ACLHandle=&{0xc8201d42c0 go-cloud-engine-tutorial  true}) %!s(*storag
e.Client=&{0xc8201dc240 0xc8201d6180}) go-cloud-engine-tutorial}/73dd02f2-5a76-4a6b-b4ed-787df5502cfc.png", "descri
ption" : "", "createdby" : "", "createdbyid" : "anonymous" }

It seems that uploadFileFromForm is using the go object print notation for bookshelf.StorageBucket which results in an invalid URL.

https://cloud.google.com/sql/docs/dev-access#gaev2-csqlv2

I get the following error when trying to install google's SDK For their Cloud Storage product.

go get -u cloud.google.com/go/storage
# cloud.google.com/go/storage
../../../../cloud.google.com/go/storage/copy.go:81: cannot use res.TotalBytesRewritten (type int64) as type uint64 in argument to c.ProgressFunc
../../../../cloud.google.com/go/storage/copy.go:81: cannot use res.ObjectSize (type int64) as type uint64 in argument to c.ProgressFunc

what about use new spanner database from standard appengine (golang)

Is it a good practice and recommended?

Hello i'm problem in run main.go.
Go version 1.9.2

go get -u cloud.google.com/go/...
go get -u cloud.google.com/go/speech/apiv1

go run main.go

Result:

../../cloud.google.com/go/longrunning/autogen/operations_client.go:26:2: cannot find package "google.golang.org/api/iterator" in any of:
        /usr/local/go/src/google.golang.org/api/iterator (from $GOROOT)
        /home/jefferson/Projects/GO/src/google.golang.org/api/iterator (from $GOPATH)
../../cloud.google.com/go/longrunning/autogen/operations_client.go:27:2: cannot find package "google.golang.org/api/option" in any of:
        /usr/local/go/src/google.golang.org/api/option (from $GOROOT)
        /home/jefferson/Projects/GO/src/google.golang.org/api/option (from $GOPATH)
../../cloud.google.com/go/longrunning/autogen/operations_client.go:28:2: cannot find package "google.golang.org/api/transport" in any of:
        /usr/local/go/src/google.golang.org/api/transport (from $GOROOT)
        /home/jefferson/Projects/GO/src/google.golang.org/api/transport (from $GOPATH)

[daharon-macpro:captionasync daharon$ go run captionasync.go
captionasync.go:17:2: cannot find package "github.com/gogo/protobuf/proto" in any of:
/usr/local/go/src/github.com/gogo/protobuf/proto (from $GOROOT)
/Users/daharon/go/src/github.com/gogo/protobuf/proto (from $GOPATH)

The pubsub_worker module in the bookshelf sample does not seem to implement a health check handler like the default module. Is this an oversight or are worker modules not supposed to implement a health check handler?

Add a test target that doesn't have access to the credentials (and with GOLANG_SAMPLES_PROJECT unset) to make sure SystemTest is called appropriately and that contributors can run the tests.

It doesn't really matter which Go version it runs under.

/cc @rakyll

Related to googleapis/google-cloud-go@f4eafa8.

The example of "listresources.go" runs fine.
I try metric "logging.googleapis.com/log_entry_count" and it works fine.
Problem is that I change the metric to "pubsub.googleapi.com/subscription/***", and I got the permission error
Error 403: User does not have permission to see metric pubsub.googleapi.com/subscription/byte_cost, forbidden

Any idea? Thx.

Perplexed but anxious that this is a trivial or obvious solution. The working Docker container (#3) is 1GB and expensive to move around. If it worked, it would be more convenient, to use Docker container (#2) as this is only 12MB.

1. Statically built sample -- works
2. Containerize #1 -- doesn't work (but only 11.9MB) -- blocks (indefinitely)
3. Containerize using golang|go-wrapper -- works (but 1.02GB!)

Took this Golang sample:
https://github.com/GoogleCloudPlatform/golang-samples/blob/master/pubsub/pubsub_quickstart/main.go
https://cloud.google.com/pubsub/docs/reference/libraries

Extended it trivially to (a) reference environment variables; (b) publish a message too:
https://gist.github.com/DazWilkin/bd8300af9f3f9be0954573304775639b

1. Static build no container

CGO_ENABLED=0 \
GOOS=linux \
GOARCH=amd64 \
go build -ldflags '-extldflags "-static"' -o pubsub pubsub.go

Then:

PROJECT_ID=${PROJECT} \
PUBSUB_TOPIC=${PUB} \
GOOGLE_APPLICATION_CREDENTIALS=./key.json \
./pubsub

and:

2017/11/26 11:45:25 Topic '${PUB}' exists no need to recreate
2017/11/26 11:45:26 Message ID: 175704661496913

2. Containerize it

Dockerfile.scratch

FROM scratch
ADD pubsub /
ENTRYPOINT ["/pubsub"]

and:

docker build \
--tag=${IMAGE}:${TAG} \
--file=Dockerfile.scratch \
.

docker run \
--interactive \
--tty \
--rm \
--env=PROJECT_ID=$PROJECT \
--env=PUBSUB_TOPIC=$PUB \
--env=GOOGLE_APPLICATION_CREDENTIALS=/config/key.json \
--volume=$PWD:/config \
$IMAGE:$TAG

and appears to just block indefinitely on pubsub.NewClient(...)

3. Containerize using golang|go-wrapper

Dockerfile.golang

FROM golang:1.9

WORKDIR /go/src/app
COPY . .

RUN go-wrapper download   # "go get -d -v ./..."
RUN go-wrapper install    # "go install -v ./..."

CMD ["go-wrapper", "run"] # ["app"]

and build using the above and same run:

docker build \
--tag=${IMAGE}:${TAG} \
--file=Dockerfile.golang \
.

docker run \
--interactive \
--tty \
--rm \
--env=PROJECT_ID=$PROJECT \
--env=PUBSUB_TOPIC=$PUB \
--env=GOOGLE_APPLICATION_CREDENTIALS=/config/key.json \
--volume=$PWD:/config \
$IMAGE:$TAG

Generates:

+ exec app
2017/11/26 19:53:19 Topic $PUB' exists no need to recreate
2017/11/26 19:53:19 Message ID: 175706135054686

Breaking changes broke the samples:
https://code-review.googlesource.com/#/c/12852/
https://code-review.googlesource.com/#/c/13230/

/cc @vkedia @jba

1. Readme should contain instructions that explain how to get the sample to compile and how to run it.
2. Readme should include the "go get -u cloud.google.com/go/speech/apiv1" command so that users will know that they need to run it

The sample runs "use library" only once when the app starts. If the sql package at any point returns a new connection, the app won't work properly.

I think the fix is to call "sql.Open" again after verifying that the DB exists, specifying the DB name in the DSN.

The whole divide by zero thing is weird. Just use panic or remove the panic/defer code completely.

Hello

Add a sample that does bidirectional streaming that reads from stdin and outputs the caption as API responds. We can suggest GStreamer to access to the mic input (e.g. gst-launch pulsesrc | livecaption).

A nicer Speech API client is available at cloud.google.com/go/speech/apiv1 that helps the users with initialization of the gRPC connection. We should consider switching to it once it is mature.

Switch from bootstrap to the material library:
http://www.getmdl.io/

This tutorial says:

To containerize the Go application, this tutorial uses the aedeploy tool, which assembles your app's dependencies.

However, it looks like the aedeploy tool is deprecated: golang/appengine#65