Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Perf] Large transcripts take a long time to load in the log panel #2254

Open
kzuenkler-avanade opened this issue Apr 12, 2021 · 10 comments
Open

[Perf] Large transcripts take a long time to load in the log panel #2254

kzuenkler-avanade opened this issue Apr 12, 2021 · 10 comments
Assignees
@tonyanziano
Labels
Backlog An approved issue or bug added into the work queue for evaluation into a future iteration Bot Services equired for internal Azure reporting. Do not delete. Do not change color. Bug Your classic code defect customer-replied-to Required for internal reporting. Do not delete. customer-reported Required for internal Azure reporting. Do not delete. ExemptFromDailyDRIReport

Comments

@kzuenkler-avanade
Copy link

Github issues should be used for bugs and feature requests. Use Stack Overflow for general "how-to" questions.

Version

4.12

Describe the bug

The top right window which contained the LUIS trace in previous versions stays empty, when you click on a trace LUIS Trace message from the flow. It worked with a previous version.
I made the update from 4.11 to 4.12 because of stability issues with large transcript files, which is now much better.

To Reproduce

Steps to reproduce the behavior:

  1. Load a transcript file which includes Luis Trace messages of type "trace"
  2. Click on a Luis trace message
  3. See empty message window on top right. It contains just "Train" and "Publish" headers.

Expected behavior

See details of LUIS result

Screenshots

If applicable, add screenshots to help explain your problem.
image

Additional context

I did not test with live bot, but would expect same behaviour.

[bug]
@kzuenkler-avanade kzuenkler-avanade added the Bug Your classic code defect label Apr 12, 2021
@lauren-mills lauren-mills added Bot Services equired for internal Azure reporting. Do not delete. Do not change color. customer-reported Required for internal Azure reporting. Do not delete. labels Apr 13, 2021
@tonyanziano
Copy link
Contributor

Investigating

@tonyanziano
Copy link
Contributor

@kzuenkler-avanade can you retry this scenario using the latest nightly release of the Emulator?

I am able to see the complete LUIS inspector when displaying a transcript containing LUIS traces:

image

===

If you still see the problem on the new version, could you please share your transcript. Thanks.

@tonyanziano tonyanziano added the customer-replied-to Required for internal reporting. Do not delete. label Apr 13, 2021
@kzuenkler-avanade
Copy link
Author

kzuenkler-avanade commented Apr 14, 2021 via email

@tonyanziano
Copy link
Contributor

tonyanziano commented Apr 14, 2021 •
edited
Loading

@kzuenkler-avanade The shape is a little bit different, but the fact that you say the same transcript works in 4.11 is intriguing to me. We have made no significant changes to the LUIS extension code in over 2 years.

Are you sure the sample trace you sent me is from one of your transcripts? I don't see a timestamp or an ID on the trace, so it won't and shouldn't load in the Emulator.

You can redact sensitive information like your model ID, but a complete trace activity / transcript would really help me debug this.

===

Additionally, when you see this happen, can you press Ctrl + Shift + I while the Emulator is open to toggle the Developer Tools window? Then please click the "Console" tab and see if there are any error messages in there. If so, please paste a screenshot of those errors here.

Thanks

@kzuenkler-avanade
Copy link
Author

kzuenkler-avanade commented Apr 14, 2021 via email

@tonyanziano
Copy link
Contributor

tonyanziano commented Apr 14, 2021 •
edited
Loading

@kzuenkler-avanade I cannot see any of the images you posted -- I'm guessing because you replied via email.

Since you can't post one of your transcripts, here is what one of my working transcripts looks like:

[
  {
    "type": "conversationUpdate",
    "membersAdded": [
      {
        "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
        "name": "Bot"
      },
      {
        "id": "tony-new",
        "name": "User"
      }
    ],
    "membersRemoved": [],
    "channelId": "emulator",
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "id": "bddd4760-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:13-07:00",
    "recipient": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "timestamp": "2021-04-13T17:36:13.013Z",
    "from": {
      "id": "tony-new",
      "name": "User",
      "role": "user"
    },
    "locale": "en-US",
    "serviceUrl": "http://localhost:58884"
  },
  {
    "type": "message",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "text": "🖐️ Hey, there! How can I help you today?",
    "speak": "<speak version='1.0' xmlns='http://www.w3.org/2001/10/synthesis' xml:lang='en-US'><voice name='en-US-AriaNeural'>🖐️ Hey, there! How can I help you today?</voice></speak>",
    "replyToId": "bddd4760-9c7e-11eb-9ca8-f767a0cd41c6",
    "id": "bde64810-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:13-07:00",
    "timestamp": "2021-04-13T17:36:13.073Z"
  },
  {
    "type": "trace",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "replyToId": "bddd4760-9c7e-11eb-9ca8-f767a0cd41c6",
    "label": "Bot State",
    "valueType": "https://www.botframework.com/schemas/botState",
    "value": {
      "conversation": {
        "DialogState": {
          "dialogStack": []
        }
      },
      "user": {
        "greeted": "true"
      }
    },
    "name": "BotState",
    "id": "bde75980-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:13-07:00",
    "timestamp": "2021-04-13T17:36:13.080Z"
  },
  {
    "channelData": {
      "clientActivityID": "1618335377934b9ddtlr7n8s",
      "clientTimestamp": "2021-04-13T17:36:17.934Z"
    },
    "text": "i'm doing well",
    "textFormat": "plain",
    "type": "message",
    "channelId": "emulator",
    "from": {
      "id": "tony-new",
      "name": "User",
      "role": "user"
    },
    "locale": "en-US",
    "timestamp": "2021-04-13T17:36:17.975Z",
    "entities": [
      {
        "requiresBotState": true,
        "supportsListening": true,
        "supportsTts": true,
        "type": "ClientCapabilities"
      }
    ],
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "id": "c0d24470-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:17-07:00",
    "recipient": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "serviceUrl": "http://localhost:58884"
  },
  {
    "type": "trace",
    "timestamp": "2021-04-13T17:36:18.372Z",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "replyToId": "c0d24470-9c7e-11eb-9ca8-f767a0cd41c6",
    "label": "LuisV3 Trace",
    "valueType": "https://www.luis.ai/schemas/trace",
    "value": {
      "recognizerResult": {
        "text": "i'm doing well",
        "alteredText": null,
        "intents": {
          "None": {
            "score": 0.35752553
          }
        },
        "entities": {}
      },
      "luisModel": {
        "ModelID": "ff0066b5-a390-4cde-8xxxxxxxxxxxxxxxx"
      },
      "luisOptions": {
        "IncludeAllIntents": false,
        "IncludeInstanceData": false,
        "IncludeAPIResults": false,
        "Log": true,
        "DynamicLists": null,
        "ExternalEntities": null,
        "PreferExternalEntities": true,
        "DateTimeReference": null,
        "Slot": "production",
        "Version": null
      },
      "luisResult": {
        "query": "i'm doing well",
        "prediction": {
          "topIntent": "None",
          "intents": {
            "None": {
              "score": 0.35752553
            }
          },
          "entities": {}
        }
      }
    },
    "name": "LuisRecognizer",
    "id": "c10ed840-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:18-07:00"
  },
  {
    "type": "message",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "text": "Sorry, I didn't get that",
    "speak": "<speak version='1.0' xmlns='http://www.w3.org/2001/10/synthesis' xml:lang='en-US'><voice name='en-US-AriaNeural'>Sorry, I didn't get that</voice></speak>",
    "replyToId": "c0d24470-9c7e-11eb-9ca8-f767a0cd41c6",
    "id": "c114a4a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:18-07:00",
    "timestamp": "2021-04-13T17:36:18.410Z"
  },
  {
    "type": "trace",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "replyToId": "c0d24470-9c7e-11eb-9ca8-f767a0cd41c6",
    "label": "Bot State",
    "valueType": "https://www.botframework.com/schemas/botState",
    "value": {
      "conversation": {
        "DialogState": {
          "dialogStack": []
        }
      },
      "user": {
        "greeted": "true"
      }
    },
    "name": "BotState",
    "id": "c114f2c0-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:18-07:00",
    "timestamp": "2021-04-13T17:36:18.412Z"
  },
  {
    "channelData": {
      "clientActivityID": "1618335381278jcy71ey8z6a",
      "clientTimestamp": "2021-04-13T17:36:21.278Z"
    },
    "text": "what can you do?",
    "textFormat": "plain",
    "type": "message",
    "channelId": "emulator",
    "from": {
      "id": "tony-new",
      "name": "User",
      "role": "user"
    },
    "locale": "en-US",
    "timestamp": "2021-04-13T17:36:21.306Z",
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "id": "c2ce89a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:21-07:00",
    "recipient": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "serviceUrl": "http://localhost:58884"
  },
  {
    "type": "trace",
    "timestamp": "2021-04-13T17:36:21.472Z",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "replyToId": "c2ce89a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "label": "LuisV3 Trace",
    "valueType": "https://www.luis.ai/schemas/trace",
    "value": {
      "recognizerResult": {
        "text": "what can you do?",
        "alteredText": null,
        "intents": {
          "Help": {
            "score": 0.8136292
          }
        },
        "entities": {}
      },
      "luisModel": {
        "ModelID": "ff0066b5-a390-4cde-xxxxxxxxxxxxxxxxxx"
      },
      "luisOptions": {
        "IncludeAllIntents": false,
        "IncludeInstanceData": false,
        "IncludeAPIResults": false,
        "Log": true,
        "DynamicLists": null,
        "ExternalEntities": null,
        "PreferExternalEntities": true,
        "DateTimeReference": null,
        "Slot": "production",
        "Version": null
      },
      "luisResult": {
        "query": "what can you do?",
        "prediction": {
          "topIntent": "Help",
          "intents": {
            "Help": {
              "score": 0.8136292
            }
          },
          "entities": {}
        }
      }
    },
    "name": "LuisRecognizer",
    "id": "c2e7de00-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:21-07:00"
  },
  {
    "type": "message",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "text": "I'm here to help with simple asks. I'm just a basic bot for now. ",
    "speak": "<speak version='1.0' xmlns='http://www.w3.org/2001/10/synthesis' xml:lang='en-US'><voice name='en-US-AriaNeural'>I'm here to help with simple asks. I'm just a basic bot for now. </voice></speak>",
    "replyToId": "c2ce89a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "id": "c2e964a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:21-07:00",
    "timestamp": "2021-04-13T17:36:21.482Z"
  },
  {
    "type": "trace",
    "serviceUrl": "http://localhost:58884",
    "channelId": "emulator",
    "from": {
      "id": "bd9b8370-9c7e-11eb-b1eb-e1e723ed413d",
      "name": "Bot",
      "role": "bot"
    },
    "conversation": {
      "id": "bdad5dc0-9c7e-11eb-9ca8-f767a0cd41c6|livechat"
    },
    "recipient": {
      "id": "tony-new",
      "role": "user"
    },
    "locale": "en-US",
    "replyToId": "c2ce89a0-9c7e-11eb-9ca8-f767a0cd41c6",
    "label": "Bot State",
    "valueType": "https://www.botframework.com/schemas/botState",
    "value": {
      "conversation": {
        "DialogState": {
          "dialogStack": []
        }
      },
      "user": {
        "greeted": "true"
      }
    },
    "name": "BotState",
    "id": "c2e9d9d0-9c7e-11eb-9ca8-f767a0cd41c6",
    "localTimestamp": "2021-04-13T10:36:21-07:00",
    "timestamp": "2021-04-13T17:36:21.485Z"
  }
]

===

This transcript was created within the Emulator after I created a new LUIS bot inside of Bot Framework Composer and started conversing with the bot.

@kzuenkler-avanade
Copy link
Author

kzuenkler-avanade commented Apr 15, 2021 •
edited by tonyanziano
Loading

I did not know, that attachments are not processed via email. Also transcript files are not accepted here.
I tried your file and get the same errors in debug window, although there is no problem to view the LUIS trace. One difference is that your transcript uses LUIS v3, mine has V2 in it. I paste a short anonymized snippet here below and added a screenshot of the errors I see with your transcript above with version 4.12.0-226638.

[
  {
    "type": "trace",
    "valueType": "https://www.luis.ai/schemas/trace",
    "name": "LuisRecognizer",
    "label": "Luis Trace",
    "value": {
      "recognizerResult": {
        "text": "Yes",
        "intents": {
          "l_general": {
            "score": 0.995618641
          },
          "q_chitchat": {
            "score": 0.8966435
          },
          "waCmtSkill": {
            "score": 0.03811494
          },
          "l_abbreviations_proxy": {
            "score": 0.013105141
          },
          "waSearchSkill": {
            "score": 0.008793767
          },
          "None": {
            "score": 0.00264004269
          },
          "q_procurement": {
            "score": 0.00167392544
          },
          "waMeetingSkill": {
            "score": 7.86648961e-05
          }
        },
        "entities": {
          "$instance": {}
        },
        "luisResult": null
      },
      "luisResult": {
        "query": "Yes",
        "topScoringIntent": {
          "intent": "l_general",
          "score": 0.995618641
        },
        "intents": [
          {
            "intent": "l_general",
            "score": 0.995618641
          },
          {
            "intent": "q_chitchat",
            "score": 0.8966435
          },
          {
            "intent": "waCmtSkill",
            "score": 0.03811494
          },
          {
            "intent": "l_abbreviations_proxy",
            "score": 0.013105141
          },
          {
            "intent": "waSearchSkill",
            "score": 0.008793767
          },
          {
            "intent": "None",
            "score": 0.00264004269
          },
          {
            "intent": "q_procurement",
            "score": 0.00167392544
          },
          {
            "intent": "waMeetingSkill",
            "score": 7.86648961e-05
          }
        ],
        "entities": [],
        "connectedServiceResult": {
          "query": "Yes",
          "topScoringIntent": {
            "intent": "Confirm",
            "score": 0.984246254
          },
          "intents": [
            {
              "intent": "Confirm",
              "score": 0.984246254
            },
            {
              "intent": "Logout",
              "score": 0.08278519
            },
            {
              "intent": "Stop",
              "score": 0.0245302711
            },
            {
              "intent": "Repeat",
              "score": 0.0142606022
            },
            {
              "intent": "Reject",
              "score": 0.008286955
            },
            {
              "intent": "SelectAny",
              "score": 0.005726782
            },
            {
              "intent": "GoBack",
              "score": 0.00493515655
            },
            {
              "intent": "Cancel",
              "score": 0.00378013961
            },
            {
              "intent": "Help",
              "score": 0.00353466813
            },
            {
              "intent": "StartOver",
              "score": 0.00345251756
            },
            {
              "intent": "ProcurementProcessHelp",
              "score": 0.00343835237
            },
            {
              "intent": "SelectItem",
              "score": 0.003357883
            },
            {
              "intent": "ProvideFeedback",
              "score": 0.00308377459
            },
            {
              "intent": "ShowNext",
              "score": 0.0023912678
            },
            {
              "intent": "Escalate",
              "score": 0.00196889881
            },
            {
              "intent": "None",
              "score": 0.0016828787
            },
            {
              "intent": "ShowPrevious",
              "score": 0.00092393544
            },
            {
              "intent": "MeetingHelp",
              "score": 0.000485961966
            },
            {
              "intent": "SelectNone",
              "score": 0.000327353046
            },
            {
              "intent": "ProcurementHelp",
              "score": 0.0002929559
            },
            {
              "intent": "PeopleSearchHelp",
              "score": 0.000179420182
            }
          ],
          "entities": []
        }
      },
      "luisOptions": {
        "Staging": false
      },
      "luisModel": {
        "ModelID": "641b59c9-f646-453e-a36b-71946f73510f"
      }
    },
    "channelId": "msteams",
    "locale": "en-gb",
    "serviceUrl": "https://smba.trafficmanager.net/de/",
    "conversation": {
      "conversationType": "personal",
      "tenantId": "d641b184-xxxxxxxxxxxxxxxxxxxx",
      "id": "a:19QbrIyMP9wh5xjXOZFgQCKSM7PBeS_xxxxxxxxxxxxxxxxxxxxxxxxx"
    },
    "from": {
      "id": "28:bf33d5d1-591d-4ffd-9f0d-37eb7f710924",
      "name": ""
    },
    "recipient": {
      "id": "29:1x5ocHwb-1Bx2IL6ysWRy20MWVvu7cMgVBGBxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
      "name": "",
      "aadObjectId": "6801bd22-9b31-xxxxxxxxxxxxxxxxxxxxx2",
      "role": "user"
    },
    "replyToId": "1597145820380",
    "id": "g_yk7o4h1597145656351",
    "timestamp": "2020-08-11T11:34:16.351Z"
  },
  {
    "type": "trace",
    "valueType": "https://www.luis.ai/schemas/trace",
    "name": "LuisRecognizer",
    "label": "Luis Trace",
    "value": {
      "recognizerResult": {
        "text": "bye",
        "intents": {
          "q_chitchat": {
            "score": 0.9596694
          },
          "l_general": {
            "score": 0.0827361345
          },
          "waSearchSkill": {
            "score": 0.0129560018
          },
          "None": {
            "score": 0.009633648
          },
          "l_abbreviations_proxy": {
            "score": 0.00774722034
          },
          "q_procurement": {
            "score": 0.00266856048
          },
          "waMeetingSkill": {
            "score": 0.000731901
          }
        },
        "entities": {
          "$instance": {}
        },
        "luisResult": null
      },
      "luisResult": {
        "query": "bye",
        "topScoringIntent": {
          "intent": "q_chitchat",
          "score": 0.9596694
        },
        "intents": [
          {
            "intent": "q_chitchat",
            "score": 0.9596694
          },
          {
            "intent": "l_general",
            "score": 0.0827361345
          },
          {
            "intent": "waSearchSkill",
            "score": 0.0129560018
          },
          {
            "intent": "None",
            "score": 0.009633648
          },
          {
            "intent": "l_abbreviations_proxy",
            "score": 0.00774722034
          },
          {
            "intent": "q_procurement",
            "score": 0.00266856048
          },
          {
            "intent": "waMeetingSkill",
            "score": 0.000731901
          }
        ],
        "entities": []
      },
      "luisOptions": {
        "Staging": false
      },
      "luisModel": {
        "ModelID": "641b59c9-f646-453e-a36b-71946f73510f"
      }
    },
    "channelId": "msteams",
    "serviceUrl": "https://smba.trafficmanager.net/de/",
    "conversation": {
      "conversationType": "personal",
      "tenantId": "d641b184-348b-xxxxxxxxxxxxxxxxxxxx",
      "id": "a:19QbrIyMP9wh5xjXOZFgQCKSM7PBeS_2ekwwgctoUv9xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
    },
    "from": {
      "id": "28:bf33d5d1-591d-4ffd-9f0d-37eb7f710924",
      "name": "WAKA"
    },
    "recipient": {
      "id": "29:1x5ocHwb--_2FZ-",
      "name": "",
      "aadObjectId": "6801bd22----",
      "role": "user"
    },
    "replyToId": "1594902591558",
    "id": "g_yleg0r1594902587765",
    "timestamp": "2020-07-16T12:29:47.765Z"
  },
  {
    "type": "trace",
    "valueType": "https://www.luis.ai/schemas/trace",
    "name": "LuisRecognizer",
    "label": "Luis Trace",
    "value": {
      "recognizerResult": {
        "text": "null",
        "intents": {
          "l_general": {
            "score": 0.7347343
          },
          "q_chitchat": {
            "score": 0.7289304
          },
          "waCmtSkill": {
            "score": 0.03811494
          },
          "waSearchSkill": {
            "score": 0.0258549936
          },
          "l_abbreviations_proxy": {
            "score": 0.013105141
          },
          "None": {
            "score": 0.00264004269
          },
          "q_procurement": {
            "score": 0.00202326267
          },
          "waMeetingSkill": {
            "score": 0.0007103898
          }
        },
        "entities": {
          "$instance": {}
        },
        "luisResult": null
      },
      "luisResult": {
        "query": "null",
        "topScoringIntent": {
          "intent": "l_general",
          "score": 0.7347343
        },
        "intents": [
          {
            "intent": "l_general",
            "score": 0.7347343
          },
          {
            "intent": "q_chitchat",
            "score": 0.7289304
          },
          {
            "intent": "waCmtSkill",
            "score": 0.03811494
          },
          {
            "intent": "waSearchSkill",
            "score": 0.0258549936
          },
          {
            "intent": "l_abbreviations_proxy",
            "score": 0.013105141
          },
          {
            "intent": "None",
            "score": 0.00264004269
          },
          {
            "intent": "q_procurement",
            "score": 0.00202326267
          },
          {
            "intent": "waMeetingSkill",
            "score": 0.0007103898
          }
        ],
        "entities": [],
        "connectedServiceResult": {
          "query": "null",
          "topScoringIntent": {
            "intent": "Confirm",
            "score": 0.436762035
          },
          "intents": [
            {
              "intent": "Confirm",
              "score": 0.436762035
            },
            {
              "intent": "Logout",
              "score": 0.08278519
            },
            {
              "intent": "Stop",
              "score": 0.07504285
            },
            {
              "intent": "Reject",
              "score": 0.032651905
            },
            {
              "intent": "Repeat",
              "score": 0.0171860419
            },
            {
              "intent": "Cancel",
              "score": 0.0087057
            },
            {
              "intent": "SelectAny",
              "score": 0.008084114
            },
            {
              "intent": "GoBack",
              "score": 0.007060325
            },
            {
              "intent": "SelectItem",
              "score": 0.005597027
            },
            {
              "intent": "ProcurementProcessHelp",
              "score": 0.00529520074
            },
            {
              "intent": "ProvideFeedback",
              "score": 0.00485473732
            },
            {
              "intent": "StartOver",
              "score": 0.00466135
            },
            {
              "intent": "Help",
              "score": 0.004047241
            },
            {
              "intent": "ShowNext",
              "score": 0.003630921
            },
            {
              "intent": "Escalate",
              "score": 0.002539069
            },
            {
              "intent": "None",
              "score": 0.001928066
            },
            {
              "intent": "ShowPrevious",
              "score": 0.001129333
            },
            {
              "intent": "MeetingHelp",
              "score": 0.000589767355
            },
            {
              "intent": "SelectNone",
              "score": 0.000403899146
            },
            {
              "intent": "ProcurementHelp",
              "score": 0.000312449469
            },
            {
              "intent": "PeopleSearchHelp",
              "score": 0.000179420182
            }
          ],
          "entities": []
        }
      },
      "luisOptions": {
        "Staging": false
      },
      "luisModel": {
        "ModelID": "641b59c9-f646-453e-a36b-71946f73510f"
      }
    },
    "channelId": "msteams",
    "locale": "en-gb",
    "serviceUrl": "https://smba.trafficmanager.net/de/",
    "conversation": {
      "conversationType": "personal",
      "tenantId": "d641b184----",
      "id": "a:-kluDbylhMKK3Q-XM-"
    },
    "from": {
      "id": "28:bf33d5d1-591d-4ffd--",
      "name": "WAKA"
    },
    "recipient": {
      "id": "29:1x5ocHwb--_2FZ-",
      "name": "",
      "aadObjectId": "6801bd22----",
      "role": "user"
    },
    "replyToId": "f:6675341856490864770",
    "id": "g_z1t0kw1597145826571",
    "timestamp": "2020-08-11T11:37:06.571Z"
  }
]

TraceErrors

@tonyanziano
Copy link
Contributor

Those errors actually don't have anything to do with rendering the LUIS traces, they are a minor bug that are a side effect of us updating to the latest Web Chat in our 4.12.0 release. This happens when chatting with any bot aside from looking at transcripts.

I took your transcript, with v2 LUIS traces and was able to render the traces in the inspector just fine:

image

That being said, sometimes the LUIS inspector does take a small bit of time to load. So after clicking on a trace, my inspector screen looked like your original screenshot, it was blank. However, after a second or two I saw it populate with the trace info.

I was using v4.13.0, but I don't think this should make a difference because there were no changes made to the LUIS code in the 4.13.0 release.

@kzuenkler-avanade
Copy link
Author

Sorry for responding so late.
I could now triage the problem to a performance issue. It may take 10 mins for longer files until the LUIS trace is shown. It is working with LUIS v2 as well, but needs a lot of patience. It is not a matter of structure, which is find and compatible.
I have one 8 MB file, which is really hard to work with. Bot emulator would need a preprocessing to provide small excerpts only. My hope was, that I can use this tool to quickly find issues in chat logs by scrolling through the conversations. In the current status of Emulator we need to build a separate process to identify parts of conversations we want to analyse, extract them and then import the snippets to BotFramework emulator to understand the details of what was going wrong in the bot dialog. Maybe it would be a major change to improve the performance of the emulator to work with larger files.

@tonyanziano
Copy link
Contributor

tonyanziano commented May 3, 2021 •
edited
Loading

Thanks for confirming that the traces in the inspector do eventually show up. It's unfortunate that the performance is so bad when loading large transcripts and not something we intended.

My initial hunch echoes your last sentence: I think that this might take a heavy time investment to assess and fix. Currently, we do not have any dev resources allocated to improving the emulator's transcript load speed in the upcoming release, but we can add this to the backlog for now.

As always, we are happy to consider reviewing and merging any community pull requests that fix outstanding issues.

@tonyanziano tonyanziano added the Backlog An approved issue or bug added into the work queue for evaluation into a future iteration label May 3, 2021
@tonyanziano tonyanziano changed the title Luis Trace cannot be viewed in message analyzer box [Perf] Large transcripts take a long time to load in the log panel May 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tonyanziano tonyanziano

Labels
Backlog An approved issue or bug added into the work queue for evaluation into a future iteration Bot Services equired for internal Azure reporting. Do not delete. Do not change color. Bug Your classic code defect customer-replied-to Required for internal reporting. Do not delete. customer-reported Required for internal Azure reporting. Do not delete. ExemptFromDailyDRIReport
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tonyanziano @tdurnford @kzuenkler-avanade @lauren-mills