Menu

Colin Devroe

Reverse Engineer. Blogger.

Microsoft Windows Mixed Reality

In this video Tom Warren of The Verge uses some mixed reality headsets for Windows. Watching them I’m reminded just how far this industry has to go. I’d call much of what I see in this video very much beta-level hardware and software.

It has only been 5 months since I wrote the aforelinked piece and we’ve seen some major, major movement in this space during that time. Facebook, Apple, Google, and Microsoft have all thrown massive amounts of resources into mixed reality. I feel the pace of updates will only quicken over the next 24 months. By 2020 everything we see in this video will look ancient.

/via Dan Kimbrough on Twitter.

Mirage

Mirage:

A world living on top of reality.

I played around with the app this afternoon. It is very rough. Super frustrating to try and use. But I sincerely hope they continue to pull this thread. I hope to see a lot more of this type of thing over the next 36 months.

/via Andy Baio.

Tim Cook on ARKit

Tim Cook, in a recent quarterly earnings call for Apple, on ARKit:

One of the most exciting and most promising announcements from WWDC was ARKit, a new set of tools for developers to create augmented reality apps. It’s still early in the beta period, but it’s clear that ARKit has captured the imagination of our developer community. We think ARKit will help the most creative minds in the industry tap into the latest computer vision technologies to build engaging content. We believe AR has broad mainstream applicability, across education, entertainment, interactive gaming, enterprise, and categories we probably haven’t even thought of. With hundreds of millions of people actively using iPhone and iPad today, iOS will become the world’s biggest augmented reality platform as soon as iOS 11 ships.

And, later:

I could not be more excited about AR, and what we’re seeing with ARKit in the early goings. To answer your question about what category it starts in, just take a look at what’s already on the web in terms of what people are doing — and it’s all over the place. From entertainment to gaming, I’ve seen what I would call more small business solutions, I’ve seen consumer solutions, I’ve seen enterprise solutions. I think AR is big and profound. This is one of those huge things that we’ll look back at and marvel on the start of it. I think that customers are going to see it in a variety of ways. Enterprise takes a little longer sometimes to get going, but I can tell you there’s a lot of excitement already in there. I think we’ll start to see some applications there as well. It feels great to get this thing going at a level that can sort of get all the developers behind it. I couldn’t be more excited about it.

I feel the same way. ARKit is a foundational technology and the applications of it are going to be far reaching. And, no, my app isn’t based on ARKit.

See also.

Glass Enterprise

Jay Kothari, Project Lead for Glass:

Now the Glass product team is back at X, and we’ll be collaborating with the Google Cloud team and our partners to help customers across a variety of business sectors make the most of Glass. Together, we’re looking forward to seeing more businesses give their workers a way to work faster and in a more focused way, hands-free.

Glass Enterprise is a smart pivot by the Glass team. MR belongs at work and will have the greatest impact in these settings. More of this please!

WWDC 2017 recap

I wanted to take a few moments to jot down a comparison between my wish list for this year’s WWDC and what was announced. Also, towards the end, some quick thoughts on the surprises that were announced.

Here are my wishes, in order from the previous post, and whether or not we got them.

  • Shared iCloud Photo Libraries. Nope. It doesn’t appear so. I think if they had finished this they would have announced it.
  • iCloud data Family sharing. Yes! And, they gave us 2TB for the price of 1TB. So, a very good update here.
  • An all-new Mac App Store. Kinda? While they didn’t show this off, Phil Schiller did hint at it during John Gruber’s live interview with him and Hair Force One.
  • App Store demos. Nope. While the new iOS App Store looks very nice (and it getting great reviews all over the web) it didn’t include this.
  • App slimming. Not sure. I’ll wait for the public betas of iOS and macOS to determine if they’ve done any work in this area.
  • More Camera app filters. Yes! While the camera app may not have more filters built-in, the Photos app has tons of updates in this area. I’ll take it.
  • Apple Prime. Nope.
  • Rename iCloud Photo Library? Nope. But, not a big deal.
  • Apple Watch Series 3. Nope. Not yet. And the watchOS updates that were featured were lackluster. But, I think they were holding back for the event they’ll have in the fall.
  • Apple Photos improvements. Yes. Tons. I’ll wait until I get my hands on it to do a direct comparison with my wishes.
  • More iOS Extensions. Nope. I didn’t see much in this area mentioned, but I think they made up for it with the drag/drop features.
  • Siri. Nope. Read Manton’s post on this. He wrote what I was thinking.
  • Apple Maps accuracy updates. Nope. Not a single mention about Apple Maps that I saw. So, again, I’ll have to wait and see with the betas.

My last minute wish that I threw in was for driving mode. And that is a huge yes!

If we’re keeping score that’s like 8 nopes, 1 kinda, and 4 yeses. Which doesn’t seem like a good score but somehow I was very impressed with WWDC overall. I think we’re in for a great year of software updates coming from Apple.

Now, onto some of the surprises.

  • HomePod. While not a total surprise HomePod looks interesting. As a piece of hardware I really like it. As a device that allows you to access Siri I’m less excited because of how poor Siri is still. For example: Ask Siri “how far is New York City” compared to “Driving directions to New York City”. How can’t Siri answer the first question if it can answer the second? I refuse to believe that Apple isn’t staying up late nights to bolster Siri’s offering so hopefully we’ll see a massive improvement in Siri within calendar 2017 or 2018.
  • iMac Pro. What an incredible computer! My first Mac was an iMac and I bought Eliza an iMac somewhat recently. I really love all-in-one computers I just prefer to have a notebook myself due to working remotely, at work, in coffee shops, at a client’s, etc. If I were to buy a desktop computer for myself the iMac Pro would be it.
  • Macbook updates. I got my new Macbook Pro with Touchbar somewhat recently. But, these updates aren’t enough to make me regret my upgrade. They look solid though.
  • ARKit. As I’ve already noted, this will be huge.
  • New iPads Pro. The updates to the iPad (both software and hardware) are very, very good. Makes me wish I needed to upgrade.
  • iPad iOS features. Though it appears some of these could come to iPhone (or, perhaps the 10-year anniversary iPhone) – these features are amazing like drag and drop and the dock, etc. Pretty cool.

There are of course many things I haven’t mentioned but ll-in-all a solid week of Apple updates.

One last thing; recently Tim Cook has been quoted as saying that Apple is focused on autonomous driving (which we knew) but that they are focused on it as a category rather than a feature. Apple finds autonomy as an interesting area moreso than simply self-driving. I’m very interested to see how this idea manifests itself in future products.

Is VR overrated?

Kristopher B. Jones, an entrepreneur from near my neck of the woods, weighs in on VR in a recent Forbes piece debating the applicability of the technology:

I’m a strong believer that virtual reality is overrated, as it has limited applications outside of very specific industries. Industries like gaming and medical training are likely to see a boom from VR, while other industries such as food service, retail and finance with have limited to no applicability of VR. Much like Google Glass and 3-D television, the buzz will eventually die down.

In November of 2016 I said VR wasn’t ready. But that I thought it wasn’t far away. I was wrong because I was lumping VR in with a much larger mixed reality landscape. It wasn’t until I dug deep into mixed reality that I understood the subtle nuances between VR, AR, and the various other degrees of mixed reality experiences.

Kris likely understands this landscape even better than I do. He’s is right. VR will never be as big as the hype. In fact, I’d bank on it. However, “mixed reality experiences” (such as augmented reality) are popping up in every single app we currently have and will continue to do so. You already see it in Facebook, Instagram, Apple’s Clips app, even within the Uber app and Google Maps app. Facebook, Microsoft, and Google are already shipping platforms, frameworks, and APIs to help developers bring MR into their apps and services. And Google recently demonstrated an amazing technology called Lens that will be inside of Google Assistant and Google Photos soon. I also think the automobile dashboard and windshield is a huge future play for AR.

I don’t think Forbes or Kris lumps VR together with AR. But I do think that many consumers do. They think mixed reality is all about wearing huge goggles. It isn’t until you dig a little deeper that you see that mixed reality is all around us already. It’s already a hit. And it is just going to keep growing.

VR as a subset of MR is overrated. But, MR is far from overrated.

Build day 1 was great. I’m looking forward to day 2 as there are promises of Windows 10 and MR/AR news. Which, as you know, I’m interested in.

Dan Kimbrough on several trends for 2017

Dan Kimbrough touches on several trends he thinks will continue in 2017 such as this bit on AR/VR:

2017 will see AR & VR make great strides to becoming how we experience and interact with the world around us.

I agree we’ll see great strides in this area. I’m especially bullish on AR. But I still believe we’re a long way from it being “great”.

On live streaming video he says:

2017 will be the year we see live streaming go from a novelty for the masses to a tool for the business savvy.

I’m 100% on board with Dan here. Live streaming video has seen steady growth in terms of viewership and capability for nearly a decade but we are just now seeing this as a ubiquitous feature in nearly every communication service. Facebook, Twitter, Snapchat, Slack, Messenger, iMessage, Instagram, etc. all have a live streaming video feature now. With just a phone you can reach your audience. It is an extraordinary time for that medium.

Back to Dan on personal branding:

2017 will be the year that brands willing to showcase themselves, their voice and their personality, will dominate.

He references my friend Gary’s daily vlog. Gary isn’t the first to do this, not by a long shot, but he may be the first to do it with a camera man (the excellent DRock) and several editors – giving his vlog a very specific feel and an “ease” for him personally that makes it sustainable. One of the most popular vloggers on YouTube, Casey Neistat, recently hung up his hat. It wears you out.

I’m uncertain if we’ll see this segment of the market grow too much, however, I do think we’ll see entire company brands built on top of personalities more in 2017 than we did in 2016. Think Kim Kardashian, Jay Z, Jessica Alba, Kate Hudson – each of these individuals have built companies worth hundreds of millions and billions of dollars on top of personal brands. We’ll see a lot more of this as social media gives people, as well as companies, enormous capability to tell their story.

And finally, Dan on video:

2017 will be one of the last years to adopt video as part of your marketing strategy if you want to survive.

His urgency isn’t unwarranted. Now is better than ever to jump into using video as a marketing tool. Both live and well-edited pieces. However, I think we’re going to see video grow, and not shrink, come the next decade. Video formats and Internet connectivity will both improve to a point where video will be as “expensive” to view as images are now. As it stands, some people are limited by their mobile carrier plan and their device’s capability to display rich video content on-the-go. These limitations will disappear over the next 5 years for most of the developed world which will only expand the video viewing market.

Great list of predictions from Dan. I’m glad he shared them on his blog.

 

VR is not ready in 2016

Danny Nicolas:

I hope someone is hard at work making an ubiquitous snow-crash-esq VR experience that compels everyone to rush to the stores to buy VR rigs, but 2016 was not the year where VR became the big thing. It might be the next big thing, but not this year.

I’ve tested a bunch of VR kits this year and I’m with Danny. There is a lot of people working really hard to bring some great VR experiences but there has not been a breakout title that is compelling enough for the masses to start purchasing them.

After playing with Oculus at the Microsoft Store I can see how this holiday season may give a boost in sales but we’re still a little progress away from people feeling like they need one. I don’t know what the breakout title will be. But for me it won’t be a game. And the industry shouldn’t be focusing on that. That is too narrow. For me it will be something akin to what Zuckerberg showed in this demo from early October. A way for me to have a “virtual office” anywhere in the world.

2016 isn’t the year of VR or AR. But it won’t be long.