Catch up on all the news, sessions, and announcements from Google I/O 2021. Watch now.

Interactive Canvas update preview

With Interactive Canvas, you can create full-screen gaming, storytelling, or educational experiences with Conversational Actions. As announced at Google I/O 2021, we are updating the Interactive Canvas API with new features.

In the traditional model of Interactive Canvas development, you need both a server-side webhook to handle the conversational logic and client-side JavaScript to update the web app and manage communication between the two. With the new APIs, you can build your Action’s logic exclusively in the web app, which simplifies the development experience, reduces latency between conversational turns, and enables you to use on-device capabilities.

The following feature updates are planned for the Interactive Canvas API:

  • Handle intent fulfillment client-side. Instead of using a webhook for intent fulfillment, these APIs allow you to handle intent fulfillment in your web app, eliminating the intermediary step of calling a webhook.
  • outputTts(): An API that allows you to output text-to-speech (TTS) from the client-side to reduce latency and server round-trip time.
  • Store information for the home structure. Instead of using a webhook to get and set home storage, you can call these APIs to handle home storage in your web app. If a user is playing a game in a household, the score of the game can be stored in home storage, and another member of the household can continue the game with the stored score.
  • Store information for the user. Instead of using a webhook to get and set user storage, you can call these APIs to handle user storage in your web app. If a user is playing a game, the score of the game can be stored for this user, and the user can continue the game with the stored score.
  • Switch from client-side to server-side fulfillment when needed. These APIs allow you to use both client-side and server-side fulfillment to build a robust Action that can incorporate Transactions, Account linking, and more.

Sign up for the Google Assistant Developer newsletter for updates on these upcoming features!