Auto-completion and syntax highlighting doesn't work in IDEA. <a href="https://you

Right now the closest workaround, with <a class="issue-link js-issue-link" data-error-

Documented in <a href="https://github.com/spotify/scio/wiki/BigQueryType-and-IntelliJ-

Macro generated BigQuery classes not working IntelliJ IDEA about scio HOT 4 CLOSED

nevillelyh commented on August 17, 2024

Macro generated BigQuery classes not working IntelliJ IDEA

from scio.

Comments (4)

yonromai commented on August 17, 2024

👍

from scio.

nevillelyh commented on August 17, 2024

http://blog.jetbrains.com/scala/2015/10/14/intellij-api-to-build-scala-macros-support/

It's not as straightforward as I thought since one will have to implement a custom injector like this:
https://github.com/JetBrains/intellij-scala/blob/idea16.x/src/org/jetbrains/plugins/scala/lang/psi/impl/toplevel/typedef/simulacrum/SimulacrumInjection.scala

from scio.

nevillelyh commented on August 17, 2024

Right now the closest workaround, with #111, would be:

Make a query in the REPL, fetch result schema and get case class definitions with SchemaUtil.toPrettyString().

scio> val query = "SELECT repository.* FROM [bigquery-public-data:samples.github_nested] LIMIT 1000"
query: String = SELECT repository.* FROM [bigquery-public-data:samples.github_nested] LIMIT 1000

scio> val schema = bq.getTableSchema(bq.query(query))
...

scio> com.spotify.scio.bigquery.types.SchemaUtil.toPrettyString(schema, "Row", 0)
res1: String =
@BigQueryType.toTable
case class Row(repository: Option[Repository$])
case class Repository$(url: Option[String], has_downloads: Option[Boolean], created_at: Option[String], has_issues: Option[Boolean], description: Option[String], forks: Option[Int], fork: Option[Boolean], has_wiki: Option[Boolean], homepage: Option[String], integrate_branch: Option[String], master_branch: Option[String], size: Option[Int], private: Option[Boolean], name: Option[String], organization: Option[String], owner: Option[String], open_issues: Option[Int], watchers: Option[Int], pushed_at: Option[String], language: Option[String])

And then copy these case class definitions to the job code and use sc.typedBigQuery[Row](query).

from scio.

nevillelyh commented on August 17, 2024

Documented in https://github.com/spotify/scio/wiki/BigQueryType-and-IntelliJ-IDEA
Doesn't look like it'll be fixed in IntelliJ any time soon so closing this for now.

from scio.

Recommend Projects