#34: Bringing AI to the Whiteboard

Posted on July 5, 2024 (Updated July 4, 2024) by ewand

One of the joys of in-person group meetings is when someone grabs a whiteboard marker and starts laying out their still-forming thoughts to the enthralled audience, almost as popular as the person who always asks a question 2 minutes before the meeting is due to end. Thankfully, there is a digital whiteboard for use in virtual and hybrid Teams meetings, too. And like seemingly everything else, it’s getting a sprinkle of Copilot-y Goodness.

The Whiteboard app has appeared in previous ToW’s (before the Great Reset) – here. As a quick summary: if you’re a Microsoft 365 subscriber, you’ll find the Whiteboard tucked under More apps in the grid on the top left on numerous sites…

… or available directly on https://www.microsoft365.com/apps/ or just launch it directly from https://whiteboard.office.com/. A Windows app is available in the Store, though it’s really just a wrapper for the web experience.

Whiteboard is intended as a multi-user collaboration tool, available in the browser as above, or in Teams, by using the Share button (NB: if you look under the Apps button to the left of Share, you won’t easily find this Whiteboard, but there are other “Whiteboard…” 3^rd party apps which will show up: YMMV).

One very cool new feature is the ubiquitous Copilot option; it can help get you started on a brainstorming exercise, for example. Start by giving it an idea of what you’re trying to work on

… and it will come back with headings which can be quickly added as Post-it style notes

Selecting one of them and choosing Categoris|ze …

… will arrange them into subject blocks.

And selecting any one and selecting Suggest will go a level deeper and bring up some additional points.

As a discussion starter, it’s brilliant. Give it a try and see what kind of inspiration you might find.

The main Whiteboard info page is here. There are some cool templates available for getting started with some pretty detailed layouts for workshops, Kanban boards etc; more info here.

RIght, now there’s only 5 mins to go, the meeting is starting to wrap up – for goodness’ sake, keep your hands down.

#28: Recalling history

Posted on May 24, 2024 by ewand

tl;dr – press WindowsKey+V on your Windows 10 or 11 PC. If you don’t have Clipboard history turned on, enable it. You’re welcome.

Microsoft unveiled a new range of Surface laptops recently; the foghorn headline is they’re not just PCs, they’re Copilot+ PCs with lots of AI goodness. There was also a lot of news from the Microsoft Build conference this week – Copilot might have mentioned once or twice, but I think they got away with it.

The really big news for PC watchers is concerning the most recent attempt by Microsoft to move away from Intel to ARM processors; tried before with the Windows RT and Surface RT cul-de-sac, then later the Windows 10X project and the Surface Pro X which was ultimately superseded by an Intel-powered replacement.

Apple showed that it was not only possible but desirable to move from power-hungry Intel to lightning fast ARM chips, delivering huge improvements in battery life at minimal expense of application compatibility. The new Surface Laptop 7 purports to deliver power and performance that will finally take the fight to Apple in-house ARM silicon.

As well as flashing the new hardware, Microsoft also announced a bunch of new capabilities coming to Windows, delivered by snazzy new hardware and the Copilot Runtime which will allow advanced AI computation to take place locally on the device, without having to round-trip to the cloud.

One such AI-powered feature is “Recall”, which captures what the user is doing on the PC over time and will use a local AI model to analyse the data, so you can ask it to bring back whichever document, web page or app you might have been using when you were doing or thinking about something.

So far, the use cases being discussed are a little basic (like “I saw a recipe for a goat’s cheese pizza but can’t remember where it was”) but it could prove really useful when in the wild.

Remembering history

There are plenty of other places where history is recorded as you do your thang on a PC. Office apps remember documents you’ve been using in the past either by presenting the Most-Recently Used (MRU) list or letting you search across common document areas.

Outlook will cache the email addresses you’ve sent to before, browsers like Edge have an extensive and searchable history of pages you’ve been to, and even Windows Explorer’s Home tab shows you all the documents you’ve opened recently alongside ones you might have pinned as favourites.

One history feature which is presumably switched off by default due to some sort of privacy worry, is one where when you start using it, you wonder how you’ve lived your life to date without it: Clipboard history. In a nutshell, CTRL+C and CTRL+V have been widely-used shortcut keys for copy & paste since before Windows was an apple in its creators’ eyes. Using WindowsKey+V to initiate a Paste, will present you a list of the last few things you put on the clipboard.

It was covered in Old Testament ToW #670.

Remember Windows Timeline? It was a feature which recorded what the user was doing across many apps, browser sessions and different devices (even on mobile), synched to the cloud and presented in a logical, searchable timeline view. While it still exists in Windows 10, it wasn’t part of Windows 11 and since it relied on Cortana (RIP), the feature which remains has very much had its wings clipped.

“Recall” Chicken Licken

The old fairy tale of the chicken thinking the sky is falling (originally an Indian story about a hare, not a hen, and known by a variety of names around the world) was revisited in relation to Microsoft’s “Recall” feature which is part of this new range of Copilot+ PCs, enabled by the additional NPU chips (and not to be confused the Outlook’s “Recall” feature which purports to un-send a message but rarely works as expected, especially if sending to a lot of people).

The story behind the new Recall is that the PC will keep a history of everything the user does by screen-grabbing every few seconds, so that the user can later ask Copilot for help in remembering what they’ve done previously.

Cue, heavy breathing from all sorts of commentators who’ve never even laid eyes on this thing being used. The UK’s Information Commissioner’s Office – the Gov data watchdog – issued a short statement and was widely reported as “looking into” the potential privacy concerns, however Microsoft was clear to point out that:

Recall will (initially) only work on these new (ARM) Copilot+ PCs and is in preview. Other PCs with Intel CPUs and Neural Processing Units (NPU) hardware will get the feature in time.
Recall will be enabled on initial PC or user setup, but can be switched off using the Settings menu and sys admins can centrally disable through policy; ditto, the length of time Recall will store data for can be tuned (and the amount of storage it uses).
Specific apps (and InPrivate browser windows) can be excluded from the screen-grabbery
It holds all the data in an encrypted store on the local PC and is only accessible by the user (i.e. not synced to the cloud, not readable by Microsoft or by any company administrator).

#23: Licensing the overlords

Posted on April 19, 2024 by ewand

People might be using AI to create new art and for writing^† but most would prefer it to take the drudgery out of their life; and that doesn’t just mean summarizing your emails. One day, technology might fulfil that Keynesian idyll of having more leisure time than we know what to do with, but for now we’re reduced to automating a few tedious tasks while replacing them with new ones.

Robotics pioneers dreamt of having autonomous domestic servants. Aside from pervasive advancement made in manufacturing, most have been somewhat underwhelming, despite some amazing looking machines. Boston Dynamics recently unveiled the frankly terrifying new Atlas humanoid robot…

… as a replacement to the previous variant which had been the star of many videos (including the “Do You Love Me” viral hit)…

… even if its cost and complexity meant it was good for little more than making fancy videos. Why make a machine that looks and acts vaguely like a human if all it needs to do is move things around, where a machine dedicated to that specific task could be built more simply and with less money?

If the rise of AI and robots is giving you cause for concern, allay some of those fears with the Reddit group, /r/sh**tyrobots, which showcases epic fails of people with perhaps too much time on their hands. (The same could be said of much of Reddit but that’s another topic altogether).

One aspect of AI and robots that is conveniently overlooked is the huge cost of doing them well; don’t expect future technologies to do everything and answer all your questions without something in return, whether that’s sharing all your information with them or handing over all your money and other stuff.

Software robotics

In current times, using software to take care of tedious tasks imposed by other software can bring immediate benefits without costing the earth. Collectively known as RPA or Robotic Process Automation, the field varies from simple If-This-Then-That type logic which can knit different systems together, to altogether more engineered solutions that are part of a much bigger development.

Microsoft’s own Power Automate – formerly known as “Microsoft Flow” – starts off with an easy-to-use editor not unlike IFTTT but can encompass web-based logic or can be run on a PC to help automate repetitive tasks within installed applications. There’s a Copilot for Power Automate (of course) and AI can help to figure out what you’re trying to automate locally too.

Keep up to speed with what’s new in Power Automate on the Release Wave documentation or on the fairly frequently updated blog.

Licensing for dummies

Power Automate is free for some things, but costs money for others. Some external systems are free to connect to, while others need you to pay directly or have an existing license. If you were designing a licensing scheme, you certainly wouldn’t start from here, in fact you could make a profession out of understanding Microsoft licensing.

Dynamics 365 pricing is going to rise pretty significantly in October 2024, though it’s the first such hike in 5 years. Still, the recent Business Applications Launch Event showed where some of the money is going; the tl;dr summary is, “Ooooh, isn’t Copilot GREAT!”.

Sometimes, Microsoft’s licensing complexity is due to external factors, though. Various competitors have also been complaining about how unfair it is that Redmond has bundled Teams in with Office 365 rather than making customers pay for it separately, and the EU pressured Microsoft to remove it from Office suites sold in Europe.

Remember the EU forcing Microsoft to ship separate versions of Windows that didn’t include a media player, because Real Networks complained? Consumers all over the world must have rejoiced.

Rather than offer a specific version to EU customers alone, Microsoft has decided to revamp the M365 suite worldwide into “with Teams” and “without Teams” versions. What this means in practice is that if you do use Teams already, you can carry on running for the same money – for now at least – depending on how you license your M365. Details are set out here.

Some customers might welcome that they can now buy their M365 subscriptions for a few $/user less than before, if they don’t currently use Teams and especially if they do subscribe to Slack, Zoom, Webex (yes, it’s still there) etc. For anyone currently using Teams it either makes no difference, or it raises the prospect of one day having to pay a $/user fee on top of the core M365 suite, and at least on the plans for M365 Enterprise for new subscribers, that will cost them more than they’d pay today.

Currently, personal/family plans are unaffected, and “business” subscriptions for M365 are available as previously or newly-discounted without Teams. Enterprise users will need to get to grips with the idea of paying for Teams separately unless they’re existing subscribers, in which case for a while, at least they don’t need to. Easy as that.

Someone has to pay the ferryman.

^† No automated wirting here. If you enjoy the process of writing and the creativity it can unleash, the last thing you’d want is to have it machine-generated. AI drafting is for boring documents which will probably only get summarized by AI at the point of consumption, so who cares if they are dry and dull? Tip of the Week remains a 100% hand-crafted endeavour. Well, apart from some of the banner images because, you know, DALL-E et al can draw some groovy stuff.

674 – Here’s the (co)pilot

Posted on March 24, 2023 by ewand

UK telly viewers in the early noughties may recall the surreal comedy show, Trigger Happy TV, with recurring characters like the aggressive squirrels or the guy with the massive phone (and that Nokia ring tone).

It was also known for some great soundtracks, like the fantastically titled Grandaddy song “He’s Simple, He’s Dumb, He’s the Pilot” (also used elsewhere). Tech news over recent weeks tells us that the pilot – or Copilot – is anything but dumb, even if it can be simple.

For Microsoft watchers, “Copilot” is a growing set of capabilities which are being built to add OpenAI functionality to other applications. With all the hoo-hah about ChatGPT and the generative AI that is now integrated into Bing (and available for everyone who wants it, not just early adopters), it’s easy to get different strands mixed up.

GPT-3 and now GPT-4 are the core language models which could underpin any number of applications’ use of what looks like artificial intelligence. ChatGPT is one web app built to hone some of the parameters of GPT-3 and put a chatbot front end to it. The new Bing and all the other stuff announced over the last few weeks is not using ChatGPT, but they do share some of the same technology underneath. Capisce?

There have been AI features aimed at making developers’ lives easier, such as Github Copilot (available since 2021), which uses another OpenAI tool called Codex, itself built to harness GPT-3. For developers on Power Platform, there have been AI functions for years too, though some capability has been recently added.

Everyday users of Dynamics 365 and Office applications will soon get Copilot capabilities to help automate boring tasks, like “work”. Do bear in mind that announcing something and making something available – in limited preview form or generally – are different activities. Copilot for Office apps like Outlook might be a few weeks or months away for most of us, but who can’t wait for AI to automatically read and reply to all their emails?

The future with our robot overlords never looked so appealing.

For a growing summary of Copilot announcements, see the hugely popular LinkedIn post from Jack Rowbotham.

#12: Which Copilot do you need?

Posted on February 8, 2013 (Updated February 2, 2024) by ewand

Microsoft has a habit of over-pivoting to use the same terminology for lots of different things, sometimes even giving the same name to related but quite specifically different things. Think OneDrive / OneDrive for Business, OneNote / OneNote for Windows 10, Skype / Skype for Business, Teams and Teams (work account) etcetera. At times in the past, everything was seemingly appended with “.NET”, or given a name starting “Windows…” “Live…” or “One…” (or all three).

Here’s the Copilot

With all the hoo-hah in recent months about “Copilot”, it can be confusing to pin down exactly what it is – a search engine, chatbot, a tool to write code, or something that will draw pictures while summarizing your email?

There are whole standalone experiences like the Bing search which was originally Chat but has now been renamed Copilot …

… and the Edge browser integrated Copilot panel, activated by the icon in the top right. Preview versions of Windows have a Copilot button on the taskbar with the ability to tweak things inside the operating system. New PCs will soon have a Copilot button on their keyboard.

There are other “Copilot” things coming out all the time. Want some help in writing a Power Automate cloud flow to integrate stuff between systems? If you’re a salesperson, Copilot in Dynamics Sales lessens the drudgery of keeping CRM up to date. Or if you’re a developer, Github can help you write better code, more quickly. Some are free and some need you to subscribe to.

It’s very likely that these things come from different sets of technologies under the hood, though Microsoft is increasingly talking about there being a “Copilot platform” behind each of these experiences. Things are certainly moving quickly – as BizApps MVP Steve Mordue commented in his chat with Charles Lamanna. Expect the effect of AI on regular applications to move from being an addon or a side panel, to fundamentally changing the apps we use – why build a BI dashboard if you can just ask the questions you need or even have the information suggested to you?

Copilot Pro and Copilot in M365

The recently-launched Copilot for Microsoft 365 integrates priority access to some of the public web services (akin to ChatGPT Plus), and adds in-app integration with Microsoft 365 and Office applications, promising also to be able to put the back end magic to work across your own organization’s data too. It’s been in preview for a while, for certain customers – initially it was invite-only for some of the biggest (who still had to pay for it) but recently has been extended to anyone with a Microsoft 365 Business subscription.

Somewhat confusingly, Microsoft at the same time announced “Copilot Pro”, which is really for individuals and integrates with Microsoft 365 personal or family subscriptions, for a monthly fee of $20 (or £19 – forex, huh… though the USD amount doesn’t include tax whereas the GBP one does).

If you’re not a Microsoft 365 Personal or Family subscriber you won’t see a lot of the value which Copilot Pro adds, on top of the GPT-4 Turbo and DALL-E 3 usage. If you are already using a M365 home subscription, then for your £19/month you’ll see Copilot functionality showing up in the desktop and web versions of the Office apps. (NB – that’s £19 per user; note that the £8/month you might pay for M365 family gets you up to 6 people… they’d each need to be enrolled into Copilot Pro if you wanted all to get the benefit, so it could work out quite expensive).

Select a block of text or a page in OneNote and you can summarize it or build a To-Do list on what actions it might contain. Word shows a little Copilot icon on the left of the text editing block, and will offer to draft some text or rewrite what’s already there.

Excel’s analytical Copilot is still in preview (and works on files already saved in OneDrive/Sharepoint only), while PowerPoint offers some frankly amazing abilities to generate fluff from thin air, or jazz up the dreary text-laden slides you might already have.

Buying and deploying Copilot for Microsoft 365 business users – available to small business users on Business Standard or Premium, or Enterprise users who have E3 or E5 licenses – is something an organizational admin would need to control, so if you’re an end user then you’ll need to wait until they decide you’re worth it.

The business version (priced at £30 per month, inc VAT) gives you everything that Copilot Pro does, and also access to your own organization’s date, and, integration with Teams, where Copilot can prepare summaries of meetings you have, or offer a chatbot that can find other information in different sources.

Should I buy it?

Of course, the free Copilot experience can be very useful, but it’s not integrated into the Office apps at all.

If you’re an Office apps user and have a M365 family or personal subscription, then it’s worth taking a look at Copilot Pro – the first monthly subscription of £19/$20 will give you a chance to have a proper play with Copilot functionality, and then decide to keep it going or cancel the subscription and it’ll expire at the end of the month. It might even give you an idea – as an end user – what Copilot for M365 could give you, and thus petition the powers that be to enable it for your M365 org.

One downside of the M365 business Copilot licensing model is that, although it works out at $30/£30 per month (give or take), it’s an annual commitment which must be paid up front. So if you’re looking to kick the tyres, try the $20/£19 a month Pro first.