Amazon’s Anticipatory Package Shipping in its Fulfillment Centres has packed and ready to go items you haven’t yet thought to buy on their online store. Amazon Alexa continually records and collates your voice as you talk to it and ask it to find information. Internet of Things (IOT) devices hooked up to Alexa provide a blueprint into how you use, move around and live in your home. Amazon Prime Video and Amazon Prime Music expose what you like to watch and listen to. If you’ve bought into the Amazon ecosystem, that is the blunt truth of the data Amazon has of your cognitive-emotional patterns. Amazon knows what you like, when you’re home, what you sound like, how you talk, where you get your source of news and can predict when and what you might buy in the future.

亚马逊在其配送中心的“预期包裹运输”已打包好并准备好运送您尚未考虑在其在线商店购买的物品。 当您与之对话并要求其查找信息时，Amazon Alexa会持续记录并整理您的声音。 连接到Alexa的物联网(IOT)设备为您如何使用，四处移动和在家里生活提供了一个蓝图。 Amazon Prime Video和Amazon Prime Music展示了您喜欢观看和收听的内容。 如果您已经购买了亚马逊生态系统，那么这就是亚马逊关于您的认知情绪模式的数据的直率事实。 亚马逊知道您喜欢什么，在家时，您的声音，说话方式，新闻来源，并可以预测将来何时何地可以购买。

Seems Amazon’s data strategy might not stop there: actually filed back in March 2015, on 2nd January 2018 the United States Patent and Trademarks Office granted a patent to Amazon Technologies Inc for the invention of a rather intriguing idea — enter the ‘Blended Reality Mirror’.

似乎亚马逊的数据策略可能还不止于此：实际上是在2015年3月提起诉讼，即美国专利商标局于2018年1月2日授予了Amazon Technologies Inc.一项专利，以发明一个颇具吸引力的想法-进入“混合现实镜像” 。

Since 2015, Amazon have been wanting to capture your entire body and track your eyes — all in the name of seeing if that red dress suits you or what tie goes with what shirt.

自2015年以来，亚马逊一直希望捕获您的整个身体并跟踪您的眼睛-所有这些都是以查看红色连衣裙是否适合您或什么领带搭配什么衬衫为名。

In October 2017 Amazon acquired Body Labs for at least $50 million — a software provider of human-aware artificial intelligence that understands the 3D body shape and motion of people from RGB photos or videos*. This is the perfect explanation from the Body Labs guys themselves.

2017年10月，亚马逊以至少5,000万美元的价格收购了Body Labs，这是一家人类感知人工智能的软件提供商，该软件可以从RGB照片或视频中了解人的3D身体形状和运动*。 这是来自Body Labs员工本身的完美解释。

这是什么意思呢？ (What does this all mean?)

In simple terms, the Blended Reality Mirror is a data-hungry Artificial Intelligent (AI) driven device. In the ‘reflection’, you see in real-time how clothes look on you from the Amazon Fashion store.

简而言之，混合现实镜像是一种数据密集型人工智能(AI)驱动的设备。 在“反射”中，您可以实时查看亚马逊时尚商店中衣服的外观。

镜子的智慧 (The Intelligence of the Mirror)

The images above are taken from the patent document and demonstrate how Amazon think they could build a functioning product and how it might be possible to generate a 3D virtual reflection captured via cameras. The images also expose the kinds of data required and stored for the concept to work. It will scan objects, their positioning and the surrounding environment. It will scan a user’s entire body in order to generate a 3D representation ready for manipulation for the placement of clothing — the 3D body model might be left as transparent. Eye-tracking is stated to be used for modification and updating in real-time the generated articles depending on head and eye position — a potential way to overcome the undesired effects from the superposition (one image above another).

上面的图片摘自专利文件，展示了亚马逊如何认为他们可以构建功能正常的产品，以及如何可能生成通过相机捕获的3D虚拟反射。 这些图像还显示了该概念起作用所需的和存储的各种数据。 它将扫描对象，它们的位置和周围环境。 它将扫描用户的整个身体，以生成3D表示，准备好用于放置衣服的操作-3D人体模型可能保持透明。 据称，眼动仪可用于根据头部和眼睛的位置实时修改和更新生成的商品，这是一种克服重叠带来的不良影响的潜在方法(一个图像在另一个图像之上)。

The inclusion of 3rd party patents is quite interesting. One of which is owned by Microsoft Technology Licensing LLC for the “3D Gaze Tracking” — potentially a component to be used for eye-tracking. Another is held by Disney Enterprises Inc for the “Transparent display with dynamic mask” for the “transparent display with a dynamic mask for generating three dimensional (3D) imagery”**. This dynamic mask lends the capability to change the scene-setting of which you might see yourself — imagine being able to see yourself wearing the wedding dress in the venue you fell madly in love with, when you haven’t yet booked it.

包含第三方专利非常有趣。 其中之一由Microsoft Technology Licensing LLC拥有，用于“ 3D凝视追踪”-可能是用于眼动追踪的组件。 迪斯尼企业有限公司持有的另一款产品是“带动态蒙版的透明显示器”，而“带动态蒙版的透明显示器可以生成三维(3D)图像” **。 这种动态面具借给能力来改变场景设置，其中你可能会看到自己-想象一下，能够看到自己穿着婚纱在你爱上了疯狂下跌会场 ，当你还没有预订它。

The physical tech and components listed are very impressive, however, functioning together or even on their own, isn’t going to cut the mustard for the desired end result of a flawless generated ‘reflection’. Leading us nicely to look at the heart of the mirror and its use of Artificial Intelligence (AI), to seamlessly bring it all together and produce something truly compelling and advanced. It’s no secret that AI needs to be trained before it can offer trustworthy and reliable information. Apart from browsing habits and wish-lists — how can Amazon train an Algorithm ready for an applied use such as a Blended Reality Mirror? The Echo Look perhaps?

列出的物理技术和组件给人留下了深刻的印象，但是，它们可以协同工作，甚至可以单独发挥作用，不会因获得完美无瑕的“反射”而最终达到预期的效果。 带领我们很好地了解镜子的核心及其对人工智能(AI)的使用，以将其无缝地组合在一起，并产生真正引人注目的和先进的东西。 在提供可信赖和可靠的信息之前，需要对AI进行培训已不是什么秘密。 除了浏览习惯和愿望清单之外，Amazon如何训练适合于混合现实镜子等应用的算法？ 回声看？

回声外观的作用 (The role of the Echo Look)

The Echo Look is (or was) an Alexa assistant device which recommended what outfit looks best on you. You take two photos of yourself from the cameras on the device, wearing a different outfit in each. It then runs these two photos through an algorithm collective of colour, fit, trend and ‘fashion advice’. The result is a percentage score. The device sits (or did sit) within the Amazon Echo family and does everything that Alexa on the Echo Dot can do. There was a separate and stand-alone app called ‘Echo Look’ which you needed to install to use it altogether. It first hit the market on 26th April 2017 and is now set to be discontinued on 24th July 2020. Rendering them a technically useless dildo-esque shaped scar of innovation after this date. Here’s the official statement sent to users:

Echo Look是(或曾经是)Alexa辅助设备，可为您推荐最适合的服装。 您从设备上的相机拍摄了两张自己的照片，每人穿着不同的服装。 然后，它通过颜色，适合度，趋势和“时尚建议”的算法集合来运行这两张照片。 结果是百分比分数。 该设备位于(或确实位于)Amazon Echo系列中，并且可以执行Echo Dot上Alexa可以做的所有事情。 有一个单独的独立应用程序称为“ Echo Look”，您需要安装才能完全使用它。 它于2017年4月26日首次投放市场，现在定于2020年7月24日停产。在此日期之后，将使它们成为技术上无用的假阳具式疤痕。 这是发送给用户的正式声明：

When we introduced Echo Look three years ago, our goal was to train Alexa to become a style assistant as a novel way to apply AI and machine learning to fashion. With the help of our customers we evolved the service, enabling Alexa to give outfit advice and offer style recommendations. We’ve since moved Style by Alexa features into the Amazon Shopping app and to Alexa-enabled devices making them even more convenient and available to more Amazon customers. For that reason, we have decided it’s time to wind down Echo Look. Beginning July 24, 2020, both Echo Look and its app will no longer function. Customers will still be able to enjoy style advice from Alexa through the Amazon Shopping app and other Alexa-enabled devices. We look forward to continuing to support our customers and their style needs with Alexa.

三年前，当我们推出Echo Look时，我们的目标是训练Alexa成为样式助手，这是将AI和机器学习应用于时尚的一种新颖方法。 在客户的帮助下，我们改进了服务，使Alexa能够提供服装建议和风格建议。 此后，我们已将Style by Alexa功能移至Amazon Shopping应用程序和支持Alexa的设备中，从而使这些功能更加方便，并可供更多Amazon客户使用。 因此，我们决定该结束Echo Look了。 从2020年7月24日开始，Echo Look及其应用将不再运行。 客户仍然可以通过Amazon Shopping应用程序和其他支持Alexa的设备享受Alexa的风格建议。 我们期待通过Alexa继续支持我们的客户及其风格需求。

The device itself never got the product design iterations that the rest of the Echo family regularly receives. Physically the device felt like a prototype from the grade plastic it was made from. The accompanying app looked more like a high fidelity wireframe than a carefully crafted design. The whole concept and device had a minimal viable product look, feel and function to it.

该设备本身从未获得过Echo系列其他产品定期收到的产品设计迭代。 从物理上讲，该设备就像是由其制造的塑料制成的原型。 随附的应用看起来更像是高保真线框，而不是精心设计的外观。 整个概念和设备对产品的外观，感觉和功能的影响最小。

Unit sales were low, however, despite this, a few thousand users across a timespan of 3 years feels likely to result in the confidence of a reliable and trust-worthy algorithm, no?

单位销售量很低，但是，尽管如此，在3年的时间段内有数千名用户感到有可能建立起可靠且值得信赖的算法的信心，不是吗？

亚马逊会实际生产这种混合现实镜子吗？ (Will Amazon actually produce this Blended Reality Mirror?)

It’s easy to imagine the Echo Look’s existence could have been part of a larger strategy and perhaps purely existed to train an algorithm ready for use with something like a Blended Reality Mirror. As stated to their users regarding the discontinuation of the Echo Look; this algorithm (which they interestingly call ‘Style by Alexa’) is being or has been integrated into the core Alexa codebase. Also the Echo Look’s development came after the date of the patent submission for the Blended Reality Mirror.

不难想象，Echo Look的存在可能是更大策略的一部分，并且可能纯粹是为了训练可用于混合现实镜像之类的算法而存在的。 就其用户对停止Echo Look的陈述而言； 该算法(他们有趣地称为“ Alexa风格”)已经或已经集成到核心Alexa代码库中。 同样，Echo Look的发展是在“融合现实镜子”专利提交之后。

We need to remember that Amazon has more than demonstrated its appetite for its share of the fashion industry over the years. In 2016 Amazon launched multiple clothing brands, and in 2017 we saw the launch of Amazon Prime Wardrobe. This shows confidence in Amazon’s potential direction.

我们需要记住，多年来，亚马逊不仅展示了其在时尚界的份额。 2016年，亚马逊推出了多个服装品牌 ，而在2017年，我们看到了亚马逊Prime Wardrobe的推出。 这表明对亚马逊的潜在发展方向充满信心。

In trying to answer this question, it would be wise to consider the competition from developments of Augmented Reality (AR). Either software used in conjunction with front cameras of mobile phones, or other more specific AR centric hardware such as glasses. Facebook’s AR adverts created with their own tool called SparkAR, create interactions which let users virtually ‘try-on’ those sunglasses or shoes you’re selling. Snapchat have some interesting ongoing developments with their glasses with the arrival of version 3. Accelerating the company to the forefront of AR technology in the consumer market space, perhaps overtaking Facebook. And of course, Apple is in the race with its development of AR glasses. The unprecedented number of people in the world who have a mobile phone capable of running AR content — excluding any unit sales of AR hardware — is an incredibly challenging number for Amazon to compete against for unit sales for its Blended Reality Mirror. From a user’s point of view, if you can virtually ‘try-on’ items of clothing by using your existing phone — why would you need to buy a mirror that can do essentially the same thing, even if the experience of it is more realistic and life-like?

在试图回答这个问题时，考虑来自增强现实(AR)发展的竞争是明智的。 可以将其与手机的前置摄像头结合使用的软件，也可以将其与其他以AR为中心的特定硬件(例如眼镜)结合使用。 Facebook的AR广告是使用自己的名为SparkAR的工具创建的，它可以创建互动，使用户可以虚拟地“试穿”您要出售的太阳镜或鞋子。 随着版本3的到来，Snapchat的眼镜开发正在进行一些有趣的发展 。这使该公司在消费者市场领域加速了AR技术的发展，甚至超过了Facebook。 当然，苹果公司也在与AR眼镜的发展竞争。 拥有能够运行AR内容的手机的世界上空前的人数-不包括AR硬件的任何单位销售-对于亚马逊来说，要与它的Blended Reality Mirror竞争单位销售，这是一个极具挑战性的数字。 从用户的角度来看，如果您可以使用现有的电话虚拟地“试穿”衣物，那为什么您需要购买一个镜子，该镜子可以做基本上相同的事情，即使它的体验更真实。和栩栩如生？

Despite this; Amazon has the trained algorithm, the IP, the evidence for wanting its share of the fashion industry and a humungous global captive user-base with a loyalty to the Amazon / Alexa ecosystem to sell into. If we look to find a trend or pattern for guidance in the time it’s taken from filing a patent, to be approved, to the time it’s taken to officially launch a product — there could be some tell from that.

尽管如此; 亚马逊拥有训练有素的算法，IP，想要在时尚界占有一席之地的证据，以及忠于亚马逊/ Alexa生态系统的忠实全球拥护用户群。 如果我们希望在从申请专利到获得批准到正式发布产品所需的时间之间找到趋势或模式的指导，那么这可能会有所启发。

The ability to shop based around personal preference of both my actual body shape and choice of clothing fit is quite the unique hook — it certainly feels like that experience has the potential to be a disruptor to the clothes retail industry. Let’s not forget, once logged into my Amazon account, this mirror will have heaps of previous data to start displaying recommendations that I actually want straight out of the box!

能够根据我的实际身体形状和服装合身性的个人喜好进行购物，这是很独特的一环-当然，这种体验很可能会破坏服装零售业。 别忘了，登录到我的Amazon帐户后，此镜像将具有大量以前的数据，以开始显示我实际想要的建议！

However, it feels like consumer demand for wanting to own a Blended Reality Mirror in the home and its price point might end up being the biggest challenges. There’s some expensive-sounding components listed in the patent. The size of the mirror is likely to be an immovable compromise — I can’t imagine this having the same impact if it’s anything less than a full-length mirror. Even the “new-normal” as a result of the COVID-19 pandemic means touchless shopping accelerates demand. Amazon may very well still have to craft a demand.

但是，感觉像是消费者希望在家中拥有混合现实镜的需求，其价格点可能最终成为最大的挑战。 专利中列出了一些听起来昂贵的组件。 镜子的尺寸很可能是一个不可动摇的折衷-如果它比全长镜子小，我无法想象这会产生相同的影响。 甚至由于COVID-19大流行而导致的“新常态”也意味着非接触式购物会加速需求。 亚马逊可能仍然非常需要提出需求。

Any takers for the prediction of 2022?

有人预测2022年吗？

超越反思 (Beyond the reflection)

Should Amazon produce this Blended Reality Mirror that logs-in to user accounts, it will be adding to the dataset of any one individual a 3D replica of them. Let’s take a moment to visualise: they have your cognitive-emotional state, a profile of your voice, a blueprint of your home, now a 3D you. That’s the most wholly digitally compiled version of you than any other data-centric company has!

如果亚马逊生产出此混合现实镜像并登录到用户帐户，它将向他们的3D复制副本添加到任何个人的数据集中。 让我们花点时间进行可视化：它们具有您的认知情感状态，您的声音轮廓，您的房屋蓝图， 现在是3D 。 这是您最全面的数字编译版本，比任何其他以数据为中心的公司都拥有！

A sobering thought. I mean, Google has access to your blood data — but that’s a whole other story! Here’s a breadcrumb for that.

一个发人深省的想法。 我的意思是，Google可以访问您的血液数据-但这又是另一回事了！ 这是一个面包屑 。

学分 (Credits)

* information taken from Body Labs Wikipedia page: https://en.wikipedia.org/wiki/Body_Labs

*信息来自Body Labs维基百科页面： https ： //en.wikipedia.org/wiki/Body_Labs

** information taken from Google patent search: https://patents.google.com/patent/US8857994B2/en?oq=US8857994

**来自Google专利搜索的信息： https : //patents.google.com/patent/US8857994B2/en?oq=US8857994

I’m available for Technologist / Advisor / Consultant / Speaker work. You can view and download my full CV. I’m always open to hearing from anyone regarding interesting opportunities, email me: info@melissawood.co.uk

我可以担任技术专家/顾问/顾问/演讲者的工作。 您可以查看和下载我的完整简历 。 我总是 乐于 听取任何人关于有趣机会的信息，请给我发电子邮件： info@melissawood.co.uk