Microsoft’s AI Copilot, integrated into the Edge browser, recently introduced a new feature that allows users to generate text summaries of videos. However, it is important to note that this time-saving feature has its limitations. According to Mikhail Parakhin, Microsoft’s CEO of advertising and web services, Edge Copilot can only generate text summaries for pre-processed videos or those with subtitles. The ability to work with videos that have subtitles enables Copilot to fallback on the available text. Parakhin explained, “If the video has subtitles – we can always fallback on that, if it does not and we didn’t preprocess it yet – then it won’t work.”
In reality, Edge Copilot does not directly summarize videos but rather summarizes the text transcripts of the videos. The AI Copilot feature is not limited to the Edge browser alone; it can also generate text summaries within the Microsoft 365 suite. For instance, Copilot can summarize Teams video meetings and calls for customer service agents, but once again, it requires the audio to be transcribed by Microsoft. Microsoft Stream also benefits from Copilot’s summarization capabilities, but users must generate a written transcript for the video.
To illustrate the functionality of Copilot, designer Pietro Schirano shared a screen recording of Edge Copilot successfully summarizing a YouTube video about the GTA VI trailer. The recording shows the user clicking the “Generate video summary” button in the Copilot sidebar, and within a few seconds, Copilot produces a summarization complete with highlights and timestamps. Of course, this demonstration relies on the availability of transcripts or subtitles. Many video platforms, including YouTube and Vimeo, have built-in features to automatically generate transcripts and subtitles if users enable them.
Copilot is just one example of Microsoft’s ongoing competition in the generative AI space, where the company is pitted against Google and other players. Google recently enhanced the YouTube extension for its Bard chatbot, enabling it to summarize the content of videos and extract specific information from them. However, it is important to acknowledge that Microsoft and Google’s AI solutions have their limitations and may not always provide accurate results.
Mikhail Parakhin has been transparent about Copilot’s development stages on social media. While the AI Copilot feature continues to evolve, Microsoft is actively working to address its limitations and enhance its capabilities. As with any AI technology, ongoing improvements and refinements are necessary to provide users with accurate and reliable results. It is essential for users to remain informed about the evolving features and limitations of AI Copilot to fully utilize its functionalities.
Microsoft’s AI Copilot offers the ability to generate text summaries of videos but has certain limitations. Edge Copilot can only summarize pre-processed videos or those with subtitles. Additionally, Copilot’s summarization feature extends beyond the Edge browser to other Microsoft 365 applications, requiring audio transcriptions for accurate results. While Copilot showcases its capabilities in certain scenarios, it is crucial to remember that accurate summarization relies on the availability of written transcripts or subtitles. Microsoft remains committed to improving Copilot’s functionality, acknowledging the ongoing competition in the generative AI space with industry giants like Google.
Leave a Reply