Funciones de superficie (Dialogflow)

Explorar en Dialogflow

Haz clic en Continuar para importar nuestra muestra de funciones de Surface en Dialogflow. Luego, sigue la para implementar y probar la muestra:

  1. Ingresa un nombre de agente y crea un agente de Dialogflow nuevo para la muestra.
  2. Después de que el agente termine de importar, haz clic en Ir al agente.
  3. En el menú de navegación principal, ve a Entrega.
  4. Habilita el Editor intercalado y, luego, haz clic en Implementar. El editor contiene la muestra código.
  5. En el menú de navegación principal, ve a Integrations (Integraciones) y, luego, haz clic en Google Asistente
  6. En la ventana modal que aparece, habilita Cambios en la vista previa automática y haz clic en Probar. para abrir el simulador de Actions.
  7. En el simulador, ingresa Talk to my test app para probar la muestra.
Continuar

Tus acciones pueden aparecer en varias plataformas, incluidas las de solo audio (bocinas inteligentes) y funciones de audio plataformas de visualización (como pantallas inteligentes y dispositivos móviles).

Para diseñar y desarrollar conversaciones que funcionen bien en todas las plataformas, usa Surface para controlar y determinar el alcance de las conversaciones de forma adecuada.

Capacidades de visualización para Actions

Actions on Google te permite controlar si los usuarios pueden invocar o no tu acción, en función en la superficie que están utilizando. Si los usuarios intentan invocar tu acción en una plataforma no compatible, recibirá un mensaje de error que le indicará que su dispositivo está no compatible.

Debes definir la compatibilidad de superficie de tu acción en tu proyecto de acciones.

Tu Acción puede aparecer en varias plataformas que compatibles con el Asistente, como smartphones (iOS y Android) y Dispositivos Google Home

Capacidades de la superficie del entorno de ejecución

Puedes adaptar la experiencia del usuario con las capacidades de la superficie de entorno de ejecución de dos maneras principales:

  • Ramas de respuestas: Presentan diferentes respuestas a los usuarios, pero tienen la la misma estructura y el mismo flujo en las conversaciones en diferentes plataformas. Para ejemplo, una acción meteorológica puede mostrar una tarjeta con una imagen en un teléfono y reproducir un archivo de audio en Google Home, pero el flujo conversacional es el mismo en todas las plataformas.

  • Ramas de conversaciones: Ofrece a los usuarios diferentes conversación en cada superficie. Por ejemplo, si estás creando una sucursal de tal vez quieras ofrecer un flujo de reordenamiento en Google Home, pero una de armado de carritos en teléfonos celulares. Para hacer la ramificación de conversaciones, permiso Activación de intents en Dialogflow a ciertas capacidades de superficie con Dialogflow diferentes. Los intents de Dialogflow reales no se activan, a menos que se especifique la capacidad de la superficie de trabajo.

  • Conversaciones en varias plataformas: Presenta a los usuarios una conversación en una. que pasa a otra plataforma en medio de la conversación. Por ejemplo, un usuario invoca tu acción con imágenes en una plataforma de solo audio, como Google Página principal, puedes crear tu Acción para buscar otra superficie con elementos visuales y llevar la conversación allí si es posible.

Ramificación de respuesta

Cada vez que tu entrega recibe una solicitud de Asistente de Google, puedes pueden consultar las siguientes plataformas (por ejemplo, Google Home o un teléfono Android) capacidades:

Node.js

const hasScreen =
  conv.surface.capabilities.has('actions.capability.SCREEN_OUTPUT');
  // OR conv.screen;
const hasAudio =
  conv.surface.capabilities.has('actions.capability.AUDIO_OUTPUT');
const hasMediaPlayback =
  conv.surface.capabilities.has('actions.capability.MEDIA_RESPONSE_AUDIO');
const hasWebBrowser =
  conv.surface.capabilities.has('actions.capability.WEB_BROWSER');
// Interactive Canvas must be enabled in your project to see this
const hasInteractiveCanvas =
  conv.surface.capabilities.has('actions.capability.INTERACTIVE_CANVAS');
index.js

Java

boolean hasScreen = request.hasCapability(Capability.SCREEN_OUTPUT.getValue());
boolean hasAudio = request.hasCapability(Capability.AUDIO_OUTPUT.getValue());
boolean hasMediaPlayback = request.hasCapability(Capability.MEDIA_RESPONSE_AUDIO.getValue());
boolean hasWebBrowser = request.hasCapability(Capability.WEB_BROWSER.getValue());
// Interactive Canvas must be enabled in your project to see this
boolean hasInteractiveCanvas = request.hasCapability("INTERACTIVE_CANVAS");
MyActionsApp.java

Node.js

const hasScreen =
  conv.surface.capabilities.has('actions.capability.SCREEN_OUTPUT');
  // OR conv.screen;
const hasAudio =
  conv.surface.capabilities.has('actions.capability.AUDIO_OUTPUT');
const hasMediaPlayback =
  conv.surface.capabilities.has('actions.capability.MEDIA_RESPONSE_AUDIO');
const hasWebBrowser =
  conv.surface.capabilities.has('actions.capability.WEB_BROWSER');
// Interactive Canvas must be enabled in your project to see this
const hasInteractiveCanvas =
  conv.surface.capabilities.has('actions.capability.INTERACTIVE_CANVAS');
index.js

Java

boolean hasScreen = request.hasCapability(Capability.SCREEN_OUTPUT.getValue());
boolean hasAudio = request.hasCapability(Capability.AUDIO_OUTPUT.getValue());
boolean hasMediaPlayback = request.hasCapability(Capability.MEDIA_RESPONSE_AUDIO.getValue());
boolean hasWebBrowser = request.hasCapability(Capability.WEB_BROWSER.getValue());
// Interactive Canvas must be enabled in your project to see this
boolean hasInteractiveCanvas = request.hasCapability("INTERACTIVE_CANVAS");
MyActionsApp.java

JSON

Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

{
  "responseId": "206a66fb-a572-4cfc-9e41-8e2eb62fdf18-712767ed",
  "queryResult": {
    "queryText": "Current capabilities",
    "parameters": {},
    "allRequiredParamsPresent": true,
    "fulfillmentText": "Webhook failed for intent: Current Capabilities",
    "fulfillmentMessages": [
      {
        "text": {
          "text": [
            "Webhook failed for intent: Current Capabilities"
          ]
        }
      }
    ],
    "outputContexts": [
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_media_response_audio"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_audio_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_account_linking"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_web_browser"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_screen_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/google_assistant_input_type_touch"
      }
    ],
    "intent": {
      "name": "projects/df-surface-caps-kohler/agent/intents/4e191eef-ba17-4f68-8a97-85a43cbc9ed1",
      "displayName": "Current Capabilities"
    },
    "intentDetectionConfidence": 1,
    "languageCode": "en"
  },
  "originalDetectIntentRequest": {
    "source": "google",
    "version": "2",
    "payload": {
      "user": {
        "locale": "en-US",
        "userVerificationStatus": "VERIFIED"
      },
      "conversation": {
        "conversationId": "ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ",
        "type": "ACTIVE",
        "conversationToken": "[]"
      },
      "inputs": [
        {
          "intent": "actions.intent.TEXT",
          "rawInputs": [
            {
              "inputType": "TOUCH",
              "query": "Current capabilities"
            }
          ],
          "arguments": [
            {
              "name": "text",
              "rawText": "Current capabilities",
              "textValue": "Current capabilities"
            }
          ]
        }
      ],
      "surface": {
        "capabilities": [
          {
            "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
          },
          {
            "name": "actions.capability.AUDIO_OUTPUT"
          },
          {
            "name": "actions.capability.ACCOUNT_LINKING"
          },
          {
            "name": "actions.capability.WEB_BROWSER"
          },
          {
            "name": "actions.capability.SCREEN_OUTPUT"
          }
        ]
      },
      "availableSurfaces": [
        {
          "capabilities": [
            {
              "name": "actions.capability.AUDIO_OUTPUT"
            },
            {
              "name": "actions.capability.SCREEN_OUTPUT"
            },
            {
              "name": "actions.capability.WEB_BROWSER"
            }
          ]
        }
      ]
    }
  },
  "session": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ"
}

JSON

Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

{
  "user": {
    "locale": "en-US",
    "userVerificationStatus": "VERIFIED"
  },
  "conversation": {
    "conversationId": "ABwppHENuB8dw7LgVquXnW5Bmy9hwu1Qz4bsaL7uIb9vDSBYPAFhFgsMWnMV6m4JEDgaUWz9FUVuIhQqWh1KZ_jjTwKEIlza",
    "type": "NEW"
  },
  "inputs": [
    {
      "intent": "actions.intent.TEXT",
      "rawInputs": [
        {
          "inputType": "TOUCH",
          "query": "Current capabilities"
        }
      ],
      "arguments": [
        {
          "name": "text",
          "rawText": "Current capabilities",
          "textValue": "Current capabilities"
        }
      ]
    }
  ],
  "surface": {
    "capabilities": [
      {
        "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
      },
      {
        "name": "actions.capability.SCREEN_OUTPUT"
      },
      {
        "name": "actions.capability.WEB_BROWSER"
      },
      {
        "name": "actions.capability.ACCOUNT_LINKING"
      },
      {
        "name": "actions.capability.AUDIO_OUTPUT"
      }
    ]
  },
  "availableSurfaces": [
    {
      "capabilities": [
        {
          "name": "actions.capability.WEB_BROWSER"
        },
        {
          "name": "actions.capability.AUDIO_OUTPUT"
        },
        {
          "name": "actions.capability.SCREEN_OUTPUT"
        }
      ]
    }
  ]
}

Ramificación de conversación

Puedes configurar intents de Dialogflow para que solo se activen en ciertas capacidades con contextos predefinidos de Dialogflow. Cada vez que se detecta una coincidencia con un intent, Dialogflow genera automáticamente contextos a partir del conjunto de capacidades de superficie del dispositivo tiene disponible. Puedes especificar uno o más de estos contextos como “contextos de entrada” para tus intents. Esto te permite controlar la activación de intents según la modalidad.

Por ejemplo, si solo quieres que un intent se active en dispositivos con salida de pantalla puedes establecer un contexto de entrada en el intent para que sea actions_capability_screen_output.

Los siguientes contextos están disponibles:

  • actions_capability_audio_output: El dispositivo tiene una bocina.
  • actions_capability_screen_output: El dispositivo tiene una pantalla de salida.
  • actions_capability_media_response_audio: El dispositivo admite la reproducción de contenido multimedia.
  • actions_capability_web_browser: El dispositivo es compatible con un navegador web. (Este no está disponible actualmente para pantallas inteligentes).

Este es un ejemplo de un intent que solo se activará en plataformas con pantallas:

Conversaciones de múltiples plataformas

En cualquier momento del flujo de tu acción, puedes comprobar si el usuario tiene algún otro plataformas con una capacidad específica. Si se trata de otra plataforma con está disponible, puedes transferir la infraestructura conversación a esa nueva superficie.

El flujo de una transferencia de superficie funcionará de la siguiente manera:

  1. Verifica si el usuario tiene una plataforma disponible

    En el controlador de webhook, puedes consultar si el usuario tiene una plataforma. disponibles con una capacidad específica. Ten en cuenta que esta superficie debe estar vinculada la misma Cuenta de Google que la plataforma de origen.

    Node.js

    const screenAvailable =
  conv.available.surfaces.capabilities.has(
    'actions.capability.SCREEN_OUTPUT');
    index.js

    Java

    String screen = Capability.SCREEN_OUTPUT.getValue();
boolean screenAvailable = false;
for (Surface surface : request.getAvailableSurfaces()) {
  for (com.google.api.services.actions_fulfillment.v2.model.Capability capability :
      surface.getCapabilities()) {
    if (capability.getName().equals(screen)) {
      screenAvailable = true;
      break;
    }
  }
}
    MyActionsApp.java

    Node.js

    const screenAvailable =
  conv.available.surfaces.capabilities.has(
    'actions.capability.SCREEN_OUTPUT');
    index.js

    Java

    String screen = Capability.SCREEN_OUTPUT.getValue();
boolean screenAvailable = false;
for (Surface surface : request.getAvailableSurfaces()) {
  for (com.google.api.services.actions_fulfillment.v2.model.Capability capability :
      surface.getCapabilities()) {
    if (capability.getName().equals(screen)) {
      screenAvailable = true;
      break;
    }
  }
}
    MyActionsApp.java

    JSON

    Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

    {
  "responseId": "206a66fb-a572-4cfc-9e41-8e2eb62fdf18-712767ed",
  "queryResult": {
    "queryText": "Current capabilities",
    "parameters": {},
    "allRequiredParamsPresent": true,
    "fulfillmentText": "Webhook failed for intent: Current Capabilities",
    "fulfillmentMessages": [
      {
        "text": {
          "text": [
            "Webhook failed for intent: Current Capabilities"
          ]
        }
      }
    ],
    "outputContexts": [
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_media_response_audio"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_audio_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_account_linking"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_web_browser"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/actions_capability_screen_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ/contexts/google_assistant_input_type_touch"
      }
    ],
    "intent": {
      "name": "projects/df-surface-caps-kohler/agent/intents/4e191eef-ba17-4f68-8a97-85a43cbc9ed1",
      "displayName": "Current Capabilities"
    },
    "intentDetectionConfidence": 1,
    "languageCode": "en"
  },
  "originalDetectIntentRequest": {
    "source": "google",
    "version": "2",
    "payload": {
      "user": {
        "locale": "en-US",
        "userVerificationStatus": "VERIFIED"
      },
      "conversation": {
        "conversationId": "ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ",
        "type": "ACTIVE",
        "conversationToken": "[]"
      },
      "inputs": [
        {
          "intent": "actions.intent.TEXT",
          "rawInputs": [
            {
              "inputType": "TOUCH",
              "query": "Current capabilities"
            }
          ],
          "arguments": [
            {
              "name": "text",
              "rawText": "Current capabilities",
              "textValue": "Current capabilities"
            }
          ]
        }
      ],
      "surface": {
        "capabilities": [
          {
            "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
          },
          {
            "name": "actions.capability.AUDIO_OUTPUT"
          },
          {
            "name": "actions.capability.ACCOUNT_LINKING"
          },
          {
            "name": "actions.capability.WEB_BROWSER"
          },
          {
            "name": "actions.capability.SCREEN_OUTPUT"
          }
        ]
      },
      "availableSurfaces": [
        {
          "capabilities": [
            {
              "name": "actions.capability.AUDIO_OUTPUT"
            },
            {
              "name": "actions.capability.SCREEN_OUTPUT"
            },
            {
              "name": "actions.capability.WEB_BROWSER"
            }
          ]
        }
      ]
    }
  },
  "session": "projects/df-surface-caps-kohler/agent/sessions/ABwppHG7pYytu-kJGJApvrFTk2iNkshy-NLsjlzJg2ntVbxZkoz-rdFch3Fd8Vmlgf0VxmNSK1woelx1otayGwCnE8gzAQ"
}

    JSON

    Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

    {
  "user": {
    "locale": "en-US",
    "userVerificationStatus": "VERIFIED"
  },
  "conversation": {
    "conversationId": "ABwppHENuB8dw7LgVquXnW5Bmy9hwu1Qz4bsaL7uIb9vDSBYPAFhFgsMWnMV6m4JEDgaUWz9FUVuIhQqWh1KZ_jjTwKEIlza",
    "type": "NEW"
  },
  "inputs": [
    {
      "intent": "actions.intent.TEXT",
      "rawInputs": [
        {
          "inputType": "TOUCH",
          "query": "Current capabilities"
        }
      ],
      "arguments": [
        {
          "name": "text",
          "rawText": "Current capabilities",
          "textValue": "Current capabilities"
        }
      ]
    }
  ],
  "surface": {
    "capabilities": [
      {
        "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
      },
      {
        "name": "actions.capability.SCREEN_OUTPUT"
      },
      {
        "name": "actions.capability.WEB_BROWSER"
      },
      {
        "name": "actions.capability.ACCOUNT_LINKING"
      },
      {
        "name": "actions.capability.AUDIO_OUTPUT"
      }
    ]
  },
  "availableSurfaces": [
    {
      "capabilities": [
        {
          "name": "actions.capability.WEB_BROWSER"
        },
        {
          "name": "actions.capability.AUDIO_OUTPUT"
        },
        {
          "name": "actions.capability.SCREEN_OUTPUT"
        }
      ]
    }
  ]
}
  2. Solicita transferir al usuario a la plataforma nueva

    Si hay una plataforma disponible con las capacidades necesarias, tu Acción deberás preguntarle al usuario si quiere transferir la conversación.

    Node.js

    if (conv.screen) {
  conv.ask(`You're already on a screen device.`);
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Current Capabilities',
    'Check Audio Capability',
    'Check Screen Capability',
    'Check Media Capability',
    'Check Web Capability',
  ]));
  return;
} else if (screenAvailable) {
  const context =
    `Let's move you to a screen device for cards and other visual responses`;
  const notification = 'Try your Action here!';
  const capabilities = ['actions.capability.SCREEN_OUTPUT'];
  return conv.ask(new NewSurface({context, notification, capabilities}));
} else {
  conv.ask('It looks like there is no screen device ' +
    'associated with this user.');
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Current Capabilities',
    'Check Audio Capability',
    'Check Screen Capability',
    'Check Media Capability',
    'Check Web Capability',
  ]));
};
    index.js

    Java

    ResponseBuilder responseBuilder = getResponseBuilder(request);
if (request.hasCapability(Capability.SCREEN_OUTPUT.getValue())) {
  responseBuilder.add("You're already on a screen device");
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Transfer surface",
        "Check Audio Capability",
        "Check Screen Capability",
        "Check Media Capability",
        "Check Web Capability",
      });
  return responseBuilder.build();
} else if (screenAvailable) {
  responseBuilder.add(
      new NewSurface()
          .setContext("Let's move you to a screen device for cards and other visual responses")
          .setNotificationTitle("Try your Action here!")
          .setCapabilities(Collections.singletonList(screen)));
  return responseBuilder.build();
} else {
  responseBuilder.add("It looks like there is no screen device associated with this user.");
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Transfer surface",
        "Check Audio Capability",
        "Check Screen Capability",
        "Check Media Capability",
        "Check Web Capability",
      });
  return responseBuilder.build();
}
    MyActionsApp.java

    Node.js

    if (conv.screen) {
  conv.ask(`You're already on a screen device.`);
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Transfer surface',
    'Current capabilities',
  ]));
  return;
} else if (screenAvailable) {
  const context =
    `Let's move you to a screen device for cards and other visual responses`;
  const notification = 'Try your Action here!';
  const capabilities = ['actions.capability.SCREEN_OUTPUT'];
  return conv.ask(new NewSurface({context, notification, capabilities}));
} else {
  conv.ask('It looks like there is no screen device ' +
    'associated with this user.');
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Transfer surface',
    'Current capabilities',
  ]));
};
    index.js

    Java

    ResponseBuilder responseBuilder = getResponseBuilder(request);
if (request.hasCapability(Capability.SCREEN_OUTPUT.getValue())) {
  responseBuilder.add("You're already on a screen device");
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Current capabilities", "Transfer surface",
      });
  return responseBuilder.build();
} else if (screenAvailable) {
  responseBuilder.add(
      new NewSurface()
          .setContext("Let's move you to a screen device for cards and other visual responses")
          .setNotificationTitle("Try your Action here!")
          .setCapabilities(Collections.singletonList(screen)));
  return responseBuilder.build();
} else {
  responseBuilder.add("It looks like there is no screen device associated with this user.");
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Current capabilities", "Transfer surface",
      });
  return responseBuilder.build();
}
    MyActionsApp.java

    JSON

    Ten en cuenta que el siguiente JSON describe una respuesta de webhook.

    {
  "payload": {
    "google": {
      "expectUserResponse": true,
      "systemIntent": {
        "intent": "actions.intent.NEW_SURFACE",
        "data": {
          "@type": "type.googleapis.com/google.actions.v2.NewSurfaceValueSpec",
          "capabilities": [
            "actions.capability.SCREEN_OUTPUT"
          ],
          "context": "Let's move you to a screen device for cards and other visual responses",
          "notificationTitle": "Try your Action here!"
        }
      }
    }
  }
}

    JSON

    Ten en cuenta que el siguiente JSON describe una respuesta de webhook.

    {
  "expectUserResponse": true,
  "expectedInputs": [
    {
      "possibleIntents": [
        {
          "intent": "actions.intent.NEW_SURFACE",
          "inputValueData": {
            "@type": "type.googleapis.com/google.actions.v2.NewSurfaceValueSpec",
            "capabilities": [
              "actions.capability.SCREEN_OUTPUT"
            ],
            "context": "Let's move you to a screen device for cards and other visual responses",
            "notificationTitle": "Try your Action here!"
          }
        }
      ]
    }
  ]
}
  3. Controla la respuesta del usuario

    Según la respuesta del usuario a tu solicitud, tu Acción facilitará la transferencia o devolución del control de la conversación a la plataforma original. De cualquier manera, la siguiente solicitud a tu extremo contendrá el actions.intent.NEW_SURFACE. por lo que debes crear un intent que se active en el evento con una el controlador correspondiente en tu webhook. En el código del controlador, debes verificar si la transferencia se realizó correctamente o no.

    Node.js

    app.intent('Transfer Surface - NEW_SURFACE', (conv, input, newSurface) => {
  if (newSurface.status === 'OK') {
    conv.ask('Welcome to a screen device!');
    conv.ask(new BasicCard({
      title: `You're on a screen device!`,
      text: `Screen devices support basic cards and other visual responses!`,
    }));
  } else {
    conv.ask(`Ok, no problem.`);
  }
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Current Capabilities',
    'Check Audio Capability',
    'Check Screen Capability',
    'Check Media Capability',
    'Check Web Capability',
  ]));
});
    index.js

    Java

    @ForIntent("Transfer Surface - NEW_SURFACE")
public ActionResponse newSurface(ActionRequest request) {
  ResponseBuilder responseBuilder = getResponseBuilder(request);
  Map<String, Object> newSurfaceStatus = request.getArgument("NEW_SURFACE").getExtension();
  if (newSurfaceStatus.get("status").equals("OK")) {
    responseBuilder.add("Welcome to a screen device!");
    responseBuilder.add(
        new BasicCard()
            .setTitle("You're on a screened device!")
            .setFormattedText("Screen devices support basic cards and other visual responses!"));
  } else {
    responseBuilder.add("Ok, no problem.");
  }
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Transfer surface",
        "Check Audio Capability",
        "Check Screen Capability",
        "Check Media Capability",
        "Check Web Capability",
      });
  return responseBuilder.build();
}
    MyActionsApp.java

    Node.js

    app.intent('actions.intent.NEW_SURFACE', (conv) => {
  if (conv.arguments.get('NEW_SURFACE').status === 'OK') {
    conv.ask('Welcome to a screen device!');
    conv.ask(new BasicCard({
      title: `You're on a screen device!`,
      text: `Screen devices support basic cards and other visual responses!`,
    }));
  } else {
    conv.ask(`Ok, no problem.`);
  }
  conv.ask('What else would you like to try?');
  conv.ask(new Suggestions([
    'Transfer surface',
    'Current capabilities',
  ]));
});
    index.js

    Java

    @ForIntent("actions.intent.NEW_SURFACE")
public ActionResponse newSurface(ActionRequest request) {
  ResponseBuilder responseBuilder = getResponseBuilder(request);
  Map<String, Object> newSurfaceStatus = request.getArgument("NEW_SURFACE").getExtension();
  if (newSurfaceStatus.get("status").equals("OK")) {
    responseBuilder.add("Welcome to a screen device!");
    responseBuilder.add(
        new BasicCard()
            .setTitle("You're on a screened device!")
            .setFormattedText("Screen devices support basic cards and other visual responses!"));
  } else {
    responseBuilder.add("Ok, no problem.");
  }
  responseBuilder.add("What else would you like to try?");
  responseBuilder.addSuggestions(
      new String[] {
        "Current capabilities", "Transfer surface",
      });
  return responseBuilder.build();
}
    MyActionsApp.java

    JSON

    Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

    {
  "responseId": "94b74485-cd7a-4b3b-b96a-fec15f3a496c-712767ed",
  "queryResult": {
    "queryText": "actions_intent_NEW_SURFACE",
    "parameters": {},
    "allRequiredParamsPresent": true,
    "fulfillmentText": "Webhook failed for intent: Transfer Surface - NEW_SURFACE",
    "fulfillmentMessages": [
      {
        "text": {
          "text": [
            "Webhook failed for intent: Transfer Surface - NEW_SURFACE"
          ]
        }
      }
    ],
    "outputContexts": [
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_capability_screen_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_capability_web_browser"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_capability_audio_output"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_capability_media_response_audio"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_capability_account_linking"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/google_assistant_input_type_voice"
      },
      {
        "name": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q/contexts/actions_intent_new_surface",
        "parameters": {
          "NEW_SURFACE": {
            "@type": "type.googleapis.com/google.actions.v2.NewSurfaceValue",
            "status": "OK"
          },
          "text": ""
        }
      }
    ],
    "intent": {
      "name": "projects/df-surface-caps-kohler/agent/intents/9db3798d-bdac-4dc8-a8e7-52349a3af0e8",
      "displayName": "Transfer Surface - NEW_SURFACE"
    },
    "intentDetectionConfidence": 1,
    "languageCode": "en"
  },
  "originalDetectIntentRequest": {
    "source": "google",
    "version": "2",
    "payload": {
      "user": {
        "locale": "en-US",
        "userVerificationStatus": "VERIFIED"
      },
      "conversation": {
        "conversationId": "ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q",
        "type": "ACTIVE",
        "conversationToken": "[]"
      },
      "inputs": [
        {
          "intent": "actions.intent.NEW_SURFACE",
          "rawInputs": [
            {
              "inputType": "VOICE"
            }
          ],
          "arguments": [
            {
              "name": "NEW_SURFACE",
              "extension": {
                "@type": "type.googleapis.com/google.actions.v2.NewSurfaceValue",
                "status": "OK"
              }
            },
            {
              "name": "text"
            }
          ]
        }
      ],
      "surface": {
        "capabilities": [
          {
            "name": "actions.capability.SCREEN_OUTPUT"
          },
          {
            "name": "actions.capability.WEB_BROWSER"
          },
          {
            "name": "actions.capability.AUDIO_OUTPUT"
          },
          {
            "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
          },
          {
            "name": "actions.capability.ACCOUNT_LINKING"
          }
        ]
      },
      "availableSurfaces": [
        {
          "capabilities": [
            {
              "name": "actions.capability.SCREEN_OUTPUT"
            },
            {
              "name": "actions.capability.WEB_BROWSER"
            },
            {
              "name": "actions.capability.AUDIO_OUTPUT"
            }
          ]
        }
      ]
    }
  },
  "session": "projects/df-surface-caps-kohler/agent/sessions/ABwppHEfQy-JgH7nmiW5gHWiDEyvqNRSPv9zkd3qTVF7F8G8YXJFI2_yal335Co0Z-_N5oUBTmVO_DJUlQONqd5lUgZz-Q"
}

    JSON

    Ten en cuenta que el siguiente JSON describe una solicitud de webhook.

    {
  "user": {
    "locale": "en-US",
    "userVerificationStatus": "VERIFIED"
  },
  "conversation": {
    "conversationId": "ABwppHENAOzBH5swn9iKb5QgUliTw4JLu5f86gS373tGtNvYcz1C3qHdorjcIb77o_PUleXGzIEFdPsl3-kmIAARvx67A7Ym",
    "type": "NEW"
  },
  "inputs": [
    {
      "intent": "actions.intent.NEW_SURFACE",
      "rawInputs": [
        {
          "inputType": "VOICE"
        }
      ],
      "arguments": [
        {
          "name": "NEW_SURFACE",
          "extension": {
            "@type": "type.googleapis.com/google.actions.v2.NewSurfaceValue",
            "status": "OK"
          }
        },
        {
          "name": "text"
        }
      ]
    }
  ],
  "surface": {
    "capabilities": [
      {
        "name": "actions.capability.SCREEN_OUTPUT"
      },
      {
        "name": "actions.capability.ACCOUNT_LINKING"
      },
      {
        "name": "actions.capability.MEDIA_RESPONSE_AUDIO"
      },
      {
        "name": "actions.capability.AUDIO_OUTPUT"
      },
      {
        "name": "actions.capability.WEB_BROWSER"
      }
    ]
  },
  "availableSurfaces": [
    {
      "capabilities": [
        {
          "name": "actions.capability.WEB_BROWSER"
        },
        {
          "name": "actions.capability.AUDIO_OUTPUT"
        },
        {
          "name": "actions.capability.SCREEN_OUTPUT"
        }
      ]
    }
  ]
}