#45: Copilot updates flying in

clip_image002

Microsoft unveiled “Wave 2” of Copilot for Microsoft 365 earlier this week; if you haven’t seen the video, you can catch it here, or check out Teams guru and MVP Tom Arburthnot’s tl;dr summary of the key announcements and the demos.

BTW, if you are a Microsoft partner, you might have heard during MCAPS Start in July, that (woo-hoo!) Microsoft was going to give you some free Copilot licenses as part of the benefit of being in the partner program.

The latest Benefits Guide shows that Copilot goodness is indeed coming in January 2025, but it might be a bit less generous than expected… Basically, don’t bank on getting more than a handful of seats as part of the package, and if you don’t think Copilot gives you enough benefit to bother paying for it, then, well…

Talking of “what’s new” with Copilot, Microsoft veteran Malcolm Bullock has a thought-provoking explanation of what he means by “Nothing has changed but everything is new”.

Some of the stuff that was announced in the Wave 2 jamboree will be coming later this year, such as Copilot automatically prioritizing your emails in Outlook. Other pieces – the Narrative Builder in PowerPoint, for example, are here already.

The PowerPoint Copilot functionality is amazing. Give it a couple of lines of content and it will generate a whole load of slides by finding out information to flesh out your idea. If you’re an expert in an area then it might seem to give a glib, high-level overview with not-quite-correct images, but all of that can be tweaked and updated later.

Here’s an example:

clip_image004

… and literally a few moments later, it presented…

clip_image006

Not bad at all. At least it has a framework which could be used to flesh out stuff in more human detail.

While Copilot might have its most immediate use in helping to create content like images or writing documents/emails for you, there are other collaborative benefits too, some of which were covered in the announcement. As Malcolm says above, maybe we will need to tweak how we collaborate (using channels instead of chat for group discussions, for example) to properly harness the capabilities to good effect.

On asking Copilot in Edge to summarize the announcement page to less than 200 words, it offered:

· Copilot Pages: Introducing a dynamic, persistent canvas for AI collaboration, allowing teams to work together in real-time with AI-generated content.

· Enhanced Microsoft 365 Apps: Significant improvements in Teams, Excel, PowerPoint, Outlook, and Word, including new features like Copilot in Excel with Python for advanced data analysis.

· Copilot Agents: New AI assistants to automate and execute business processes, with an easy-to-use agent builder for creating custom agents.

· User Feedback and Updates: Over 700 product updates and 150 new features based on feedback from nearly 1,000 customers, improving performance and user satisfaction.

So there are lots and lots of new features coming, if not here already. Yay.

Meetings, transcripts and notes

One of the nicer new widgets that Copilot has brought recently is for putting meeting notes into OneNote. Previously, to record what happened in a meeting, you’d ask either Teams Premium or Copilot to generate some kind of notes, then copy/paste the text into OneNote alongside other stuff you might have jotted down yourself during the meeting.

Now, it’s made the process a whole lot easier – first, you need to be sure the meeting has been recorded or transcribed. If you go back to the Meeting inside Teams (look in the Chat node), you might see a Recap option which will give you the summary of what happened, along with actions that were discussed:

clip_image008

Now, go into OneNote, navigate to your existing notes page for a meeting (or create a new one) and go to Insert Meeting details. It will offer you a pane on the right side showing a selection of meetings from your calendar.

clip_image010

Previously, this would have copied just the bumph from Outlook like the date/time, subject and who the attendees were – useful as that is – but now has added a bunch more…

clip_image012

It’s a brilliantly useful way of adding some extra content to notes you might already be taking, or just to more easily organize notes and follow up actions from within OneNote rather than grubbing about in Teams to find them.

#34: Bringing AI to the Whiteboard

clip_image002

 

One of the joys of in-person group meetings is when someone grabs a whiteboard marker and starts laying out their still-forming thoughts to the enthralled audience, almost as popular as the person who always asks a question 2 minutes before the meeting is due to end. Thankfully, there is a digital whiteboard for use in virtual and hybrid Teams meetings, too. And like seemingly everything else, it’s getting a sprinkle of Copilot-y Goodness.

The Whiteboard app has appeared in previous ToW’s (before the Great Reset) here. As a quick summary: if you’re a Microsoft 365 subscriber, you’ll find the Whiteboard tucked under More apps in the grid on the top left on numerous sites…

clip_image004

… or available directly on https://www.microsoft365.com/apps/ or just launch it directly from https://whiteboard.office.com/. A Windows app is available in the Store, though it’s really just a wrapper for the web experience.

Whiteboard is intended as a multi-user collaboration tool, available in the browser as above, or in Teams, by using the Share button (NB: if you look under the Apps button to the left of Share, you won’t easily find this Whiteboard, but there are other “Whiteboard…” 3rd party apps which will show up: YMMV).

clip_image006

One very cool new feature is the ubiquitous Copilot option; it can help get you started on a brainstorming exercise, for example. Start by giving it an idea of what you’re trying to work on

clip_image008

… and it will come back with headings which can be quickly added as Post-it style notes clip_image010

Selecting one of them and choosing Categoris|ze …

clip_image012

… will arrange them into subject blocks.

clip_image014

And selecting any one and selecting Suggest will go a level deeper and bring up some additional points.

clip_image016

As a discussion starter, it’s brilliant. Give it a try and see what kind of inspiration you might find.

The main Whiteboard info page is here. There are some cool templates available for getting started with some pretty detailed layouts for workshops, Kanban boards etc; more info here.

RIght, now there’s only 5 mins to go, the meeting is starting to wrap up – for goodness’ sake, keep your hands down.

#32: Microsoft Designer gets everywhere

clip_image002

Assuming you haven’t woken from cryonic stasis (leaving aside all the practical difficulties of doing that) then you’ll already know of the hallucinatory ChatGPT and its image-creating sidekick, DALL-E, which will spit out a computer generated image from a text-based description of what you want.

Predictably, there are many memes on whether AI is a good thing or not, along with worries that it’s coming for your jobs/freedom/happiness etc. In many ways, it’s just another wave of technology which is certainly impactful, but its benefit will be seen by how we creatively embrace it.

clip_image003

Also doing the rounds is the trope of “I want AI to do my laundry” which is poignant if not really a new thing (see Keynes c1930, or Bertrand Russell’s “In praise of Idleness”, c1932). Technology is invented to supposedly give us more time but often displaces one form of work for another. Now, AI prompt engineering will be a creative skill, to a degree replacing the need for designing, drawing or painting skills.

Meanwhile, Microsoft has been busy embedding DALL-E technology into other apps and services, broadly packaged under its “Designer” branding. You can generate images for embedding into LinkedIn articles, for example …

clip_image005

… though with some mixed level of success, depending on what you want…

clip_image007

Alternatively, just go straight to the Copilot prompt…

clip_image009

Even the venerable Paint has gotten a new Image Creator function which does much the same thing, though annoyingly defaults to a 1:1 aspect ratio, regardless of the orientation of the canvas. In the main Copilot/Designer UI there is a little icon to change the ratio of your image from square to landscape, however it ends up generating a new image entirely.

clip_image011

Restyle it out

Remember all those early 2000s makeover TV shows which gave frumpy looking people another view on what to wear? Well, there’s a Restyle capability in Designer that’s so much fun to play with, you could easily spend the rest of the day mucking about with pictures to see what selfies look like in art style, how the dog would be if made of Plasticine, and so on…

clip_image013

Take your source image…

clip_image015

…then choose one of a variety of styles, and be prepared for outright weirdness or outright flattery…

clip_image017

Right, that’s enough of the day wasted. Get on with your work!

681 – AI Push Me Pull You

clip_image002As more AI hoo-hah continues to pour from the hype machine of big tech, some of the puffed-up services are starting to become more accessible. Even if it’s still badged as “preview”, Bing’s AI chat is now more widely available and further functionality will be along soon.

Stepping onto the bandwagon before it fully departs, AI technology behind Google’s Bard chatbot is being embedded into Search, as announced at Google’s I/O conference, whose theme was all about how everything is being re-engineered to embrace generative AI. El Reg has neatly summarized the keynote here if you’re interested to learn more (“We sat through the Chocolate Factory’s PR blitz so you don’t have to”).

Google announced copilot-like functionality for its cloud productivity suite while Microsoft unveiled the M365 Copilot preview that’s been running for a few months, is being extended further.

Not all is rosy in the garden of AI, however. Distinguished scientist Geoffrey Hinton, a Turing Award winner and widely-described as “Godfather of AI”, has walked out of his Googly role amid concerns that AI will become sentient and enslave or kill us all. Interestingly, Hinton did not sign the Elon Musk-backed petition to halt AI development, effectively saying that if those currently working on it were to stop, others would pick up the baton. Microsoft’s chief scientist agrees.

clip_image004Making AI pay for itself is one challenge that will need to be addressed, as the intensive computation required can be very expensive – costs of running ChatGPT are eye-watering, according to OpenAI’s boss, and reckoned by some to be in the region of $700K per day. Still, investors can’t get enough of it and OpenAI is piloting a $20/month ChatGPT Plus subscription.

The expanded M365 Copilot preview is a “paid-for” thing, and Microsoft’s Q3 earnings call did mention that Copilot will be additionally priced over and above whatever Office licenses a customer already has (though some AI related features will show up in E3/E5 licensed environments, such as the new Semantic Index which can be harnessed by Copilot but will be useful for giving more accurate search results even if Copilot is not in use).

Back in the present, there are some relatively new practical capabilities in both Bing AI and in the Edge browser’s discover feature, as discused in last week’s ToW. The Compose feature in the Sidebar lets you play with generating different types of written content, the kind of thing which will be integral to Copilot in all kinds of Office applications before long.

The Insights tab on the same Sidebar gives you more info on the page you’re currently looking at, from a summary of the key points of the page, to some background on where that site is accessed from, how likely it is to be reliable and more.

clip_image005

The core Bing AI search in a browser – in case you’re itchy about using Edge or its Bing Sidebar – has some new clip_image007capabilities, especially the integration of Bing Image Creator, which is available clip_image009separately from the AI chat function.

Another one of OpenAI’s groovy tools – Dall-E – generates images based on a text description, and Bing AI chat can feed directly into that.

The image generation capability is now multi-lingual (with over 100 languages supported). It will also soon be possible to upload images to Chat, so you could ask it questions about what’s in the image.

All free for now, but someday soon, we will need to pay the ferryman or the robot overlords will wreak their revenge.

680 – Edgy emails

clip_image001

The Edge browser has seen a lot of change in its life. Originally conceived as a successor to Internet Explorer, with its own modern web rendering engine and lots of additional features which are designed to complement the usage experience, like taking handwritten notes on top of a webpage or building a Reading List of pages or publications to come back to.

Later, the decision was taken to replace the browser with one based on a new core using Chromium, largely for reasons of compatibility and performance, but to carry on building new capability that would differentiate the new Edge browser from others that also use the Chromium rendering engine, including Google Chrome itself.

clip_image003Recent builds of Edge have a Sidebar which includes a load of apps and integrations – the goal being that it can help multitask on the web by sharing complementary information or functionality alongside the page the user is looking at; think a shopping widget that would compare prices of the product on the page you’re viewing, showing where else you could buy that same thing.

A recent update to the Sidebar has been the inclusion of the new Bing search, which adds some very cool relevance capabilities that would allow you to fire the current page content straight at the Bing’s AI engine to summarize, rewrite or explain the contents – selected text, or the entire page you’re visiting.

Here’s an example of a reasonably detailed blog article (from early 2021) summarized into a few key paragraphs:

clip_image004

One of the more useful integrations in the Sidebar is the Outlook app (individual icons on the Sidebar can be enabled and disabled through the settings option; you can also dock other sites which will appear in the sidebar, though not necessarily with the context of the page you’re currently looking at). A recent – and somewhat controversial – change means that when you click a link from an email in desktop Outlook on a PC, it will open in Edge and the Outlook sidebar will be shown alongside, displaying the email that you clicked it from.

Once you’ve got the hang of this feature, it’s actually pretty cool – especially if the email is offering some context about what you’re supposed to be doing on that page, or if it’s a densely-packed missive full of clickbait and other nonsense:

clip_image005

Why is it controversial? Well, the point is that the extra functionality is happening due to the Sidebar in Edge, so clicking a link in Outlook if you’re using a different default browser wouldn’t have the same effect. Outlook, therefore, has decided to send links to Edge even if that’s not your usual browser, to the chagrin of some netizens. Be careful with doing things that annoy some people.

If you’d prefer that Outlook and Windows respected your choice to send all your links to a specific, non-Edge, browser, then it’s fairly easy (if not exactly easily discoverable) to set that. Go to File | Options | Advanced within Outlook, and look for the Link Handling option, and change it to Default Browser. clip_image007This will mean opening the hyperlink in Chrome / Brave / Firefox / whatever, without the Sidebar doing its thing.

More change is on its way to Edge and Bing AI.

If you like Edge but would rather dispense with the Sidebar altogether, go to the “…” menu on the top right, select Settings | Sidebar and disable the Always show sidebar toggle.

You can use the same clip_image009settings UI to play with other behaviours in the various apps that are pinned to the sidebar, too.

To add or hide apps on the sidebar, just show it, right-click on something and choose Customize sidebar, or use the “Add or remove apps…” feature from the Settings | Sidebar screen.

clip_image011If you’d rather not to have the somewhat prominent Bing icon on the very top right of your Edge screen, look under the Discover section of this Settings UI, and if you flick the switch, the big blue b goes away.

674 – Here’s the (co)pilot

imageUK telly viewers in the early noughties may recall the surreal comedy show, Trigger Happy TV, with recurring characters like the aggressive squirrels or the  guy with the massive phone (and that Nokia ring tone).

It was also known for some great soundtracks, like the fantastically titled Grandaddy song “He’s Simple, He’s Dumb, He’s the Pilot(also used elsewhere). Tech news over recent weeks tells us that the pilot – or Copilot – is anything but dumb, even if it can be simple.

clip_image002For Microsoft watchers, “Copilot” is a growing set of capabilities which are being built to add OpenAI functionality to other applications. With all the hoo-hah about ChatGPT and the generative AI that is now integrated into Bing (and available for everyone who wants it, not just early adopters), it’s easy to get different strands mixed up.

GPT-3 and now GPT-4 are the core language models which could underpin any number of applications’ use of what looks like artificial intelligence. ChatGPT is one web app built to hone some of the parameters of GPT-3 and put a chatbot front end to it. The new Bing and all the other stuff announced over the last few weeks is not using ChatGPT, but they do share some of the same technology underneath. Capisce?

There have been AI features aimed at making developers’ lives easier, such as Github Copilot (available since 2021), which uses another OpenAI tool called Codex, itself built to harness GPT-3. For developers on Power Platform, there have been AI functions for years too, though some capability has been recently added.

Everyday users of Dynamics 365 and Office applications will soon get Copilot capabilities to help automate boring tasks, like “work”. Do bear in mind that announcing something and making something available – in limited preview form or generally – are different activities. Copilot for Office apps like Outlook might be a few weeks or months away for most of us, but who can’t wait for AI to automatically read and reply to all their emails?

clip_image004

The future with our robot overlords never looked so appealing.

For a growing summary of Copilot announcements, see the hugely popular LinkedIn post from Jack Rowbotham.

668 – Ay Eye Ay Eye, Oh

clip_image002

Not Aye-Aye, Ally-Ally, nor Why-Eye, but Ay-Eye, as in A.I. And not the cheesy Spielberg flick. The tech news has been all about artificial intelligence recently, whether it’s ChatGPT writing essays or giving witty responses, to Microsoft committing another chunk of change to its developer, OpenAI.

Original backers of OpenAI include Tony Stark (who has since resigned from the board in order to discombobulate the world in other ways) and AWS, though Amazon has warned employees not to accidentally leak company secrets to ChatGPT and its CTO has been less than enthused.

clip_image004ChatGPT is just one application – a conversational chatbot – using the underlying language technology that is GPT-3, developed by the OpenAI organization and first released over 2 years ago. It parses language and using previously analyzed data sets, gives plausible-sounding responses.

Further evolutions could be tuned for particular clip_image006tasks, like generating code – as already available in PowerApps (using GPT-3 to help build formulae) or GitHub CodePilot (which uses other OpenAI technology that extends GPT-3). Maybe other variants could be used for interviews or auto-generating clickbait news articles and blog posts.

Another use for GPT-n has been unveiled in the New Bingan old dog has maybe learned some new tricks?

clip_image008You’ll need to join the waitlist initially but this could ultimately be a transformational search technology. Google responded quickly by announcing Bard, though Googling “Google Bard” will tell you how one simple mistake hit the share price. No technology leader lasts forever, unless things coalesce to there being only one.

Other AI models are available, such as OpenAI alternative, Cohere, and there are plenty of sites out there touting AI based services (even if they’re repainting an existing thing to have .ai at the end of it). For some mind-blowing inspiration including AI-generated, royalty-free music or stock photos, see this list.

613 – Ready for your close-up?

clip_image002
Firstly, a call out to regular reader @Nick Lines, who pointed out a typo in an infographic in last week’s ToW; said image was pinched from another online source without taking the opporunity to correct it.

Outlook made some helpful suggestions in response – just one example of new AI functionality showing up by dint of subscription services.

clip_image004

clip_image006Another case in point where software gets better on a regular basis, is a slew of new features that have appeared for some Teams users – namely, the ability to tweak your own camera image. If you don’t see them yet, try checking for updates from the … menu to the left of your own profile image in the main Teams window.

Mirroring your video makes it easier to interact with your own environment while you’re looking at the screen, though it doesn’t affect what others in the meeting see.

Lighting Correction is a one-setting tweak for fixing the contrast and brightness, which can be handy when it’s dark outside and your room lighting isn’t ideal.

clip_image008Most entertaining though, is the facial retouching feature – YMMV depending on how much your fizzog need retouching in the first place, possibly. You can apply a dab of filler all the way up to full-blown Insta-influencer soft focus, by enabling the feature then moving the slider. Look under Device Settings from the ellipsis (…) menu when you’re in a call.

clip_image010The results speak for themselves… clip_image012

Check out the Teams blog, and look forward to lots more new features arriving later in the year.

Another tweak in managing your own video comes from users’ feedback, where they don’t want to see their own video window, thinking that it’s distracting when looking at a gallery of other attendees in a meeting.

clip_image014You’ll be able to hide your own video by clicking on the … in the corner of your own preview, and can then selectively show or hide, or if you’re especially vain, you can pin your own tile to the meeting view so you show up as the same size as everyone else.

Perfect for checking out how the facial buffing has worked out.

502 – Presenting PowerPoint Subtitles

clip_image002If you’ve ever used PowerPoint to present to a group of people, you’ll be familiar with the Slide Show menu to some degree; unless you’re the annoying would-be presenter merely mirroring your primary screen and flicking through their slides without going into the full-screen slide show mode.

When they do it properly, you’ll often see presenters kick off by fishing clip_image004about with their mouse to click on the little slide-show icon in the toolbar on the bottom.clip_image006 It’s usually quicker to just hit F5 to start, or Shift+F5 to start from the currently-selected slide.

clip_image008Unfortunately, it’s still pretty common to then see the speaker be surprised because the config of their displays isn’t what they expect – especially the case if they’re sharing their screen on a online meeting, but their laptop is also connected to more than one monitor.

PowerPoint will typically be set up to use Presenter View by default, and the screen that’s being shared will be showing the speaker notes / next slides etc, while the full-screen content is being displayed on the 2nd monitor that isn’t being shared.

clip_image010To the right of the Monitor setup for presenter view, you may also see an intriguing option that has been added to PowerPoint – automatic subtitling, and translation too. It’s part of the ongoing Office 365 servicing that brings updates on a regular basis.

Choose the language you’d like to display, the location of the subtitles and when you start presenting, the machine will listen to every word you say and will either display what it thinks you’ve said in your own language, or it can use an online service to translate to subtitles in over 60 languages.

It’s fantastic. See more here. Go and try it now.

clip_image012There’s an older add-in which achieves much the same thing, if you’re not using O365 – see here for more info. The Presentation Translator addin also allows the audience to follow along and even interact with the presenter using the Microsoft Translator app on their phone.

Windows has a closed captioning setting page that applies to other apps that support it, too, if you’d like to show subtitles on video that has the content already defined.

Closed Captioning is legislated by several countries, for traditionally-broadcast media as well as online video.

You may also want to add captions to videos that you plan to embed – more, here.

Tip o’ the Week 491 – PowerPoint layout tips

clip_image002Microsoft people love PowerPoint. Even when using it for completely unsuitable purposes (writing reports using PPT instead of Word, OneNote etc – filling slides with very dense and small text) or simply putting too much stuff on a slide, so a presenter has to say “this is an eyechart but…”

There are many resources out there to try to help you make better slides – from how-to videos to sites puffing a mix of obvious things and a few obscure and never-used tricks (eg here or here), and PowerPoint itself is adding technology to try to guide you within the app.

clip_image004The PowerPoint Designer functionality uses AI technology to suggest better layouts for the content you’ve already put on your slide – drab text, even a few clip_image006Icons (a library of useful-looking, commonly-used symbols) or graphics from your favourite source of moody pics.

If you don’t see the Design Ideas pane on the right, look for the icon on the Design tab, under, er Designer.

clip_image008

The PowerPoint Designer team has recently announced that one billion slides have been created or massaged using this technology, and they have previewed some other exciting stuff to come – read more here.

A cool Presenter Coach function will soon let you practice your presentation to the machine – presumably there isn’t some poor soul listening in for real – and you’ll get feedback on pace, use of words and so on. Watch the preview. No need to imagine Presenter Coach is sitting in his or her undies either.

When it comes to laying out simple objects on a slide, though, you might not need advanced AI to guide you, rather a gentle helping hand. As well as using the Align functionality that will ensure shapes, boxes, charts etc, are lined up with each other, spread evenly and so on, when you’re dragging or resizing items you might see dotted lines indicating how the object is placed in relation to other shapes or to the slide itself…

clip_image009

In the diagram above, the blue box is now in the middle of the slide, and is as far from the orange box as the gap between the top of the orange box and the top of the grey one. There are lots of subtle clues like this when sizing and placing objects, and it’s even possible to set your own guides up if you’re customising a slide master.