Amidst Galaxy Note 7 Recall, USPTO Publishes Samsung Patent Application for HMD with a Heat Radiator

Samsung_Logo.svg

As reported by various news outlets today, Samsung announced an unprecedented recall of the Galaxy Note 7 just weeks after launching the smartphone due to the phone’s battery, with some scattered reports that “the cell can explode while charging.”

In a bit of irony, yesterday, the USPTO published Samsung’s patent application for a HMD having “a heat radiator” for removing heat from the space between the display and the optical assembly while a smartphone is actively engaged.  The device in the application appears to be a version of the Gear VR, with which the Galaxy Note 7 was designed to operate.

As seen in FIG. 6 (below) of Samsung’s application, the HMD includes a heat radiator 400 on a side surface of the frame 202.  The heat radiator 400 includes a fan 410 with a blade, or a piezo cooler, and also includes a fan duct 420 and a fan cover member 430.  The fan 410 and the fan duct 420 is installed in the frame 202 in a mounting opening unit 260.

 

Samsung 748 FIG 6

As shown in FIG. 7 (below), the heat radiator 400  dissipates the heat from the smartphone 300 by bringing external air into the frame 202.  Heat is transferred to the air introduced into the frame 202 through the heat radiator 400, and then the air is discharged through an outlet on the bottom surface of the frame 202, thus making it more comfortable for the user of the device 200.

 

Samsung 748 FIG 7

Samsung’s application also discusses using a heat diffusion member that can be installed to more efficiently transfer heat from the smartphone to the air in the frame 202. The heat diffusion member may be a graphite sheet, a heat transfer member containing carbon such as graphene, a metal member such as a copper sheet, or a heat transfer member such as a heat pipe or heat sink.  The application makes no mention of fire suppression technology.

According to public records, Samsung’s patent application claims priority to a Korean patent application that was originally filed in February 2015.

Apple Receives Patent for Head-Mounted Display for Use with Smartphones

apple

Apple has been in the news a lot lately  — from the $14.5 billion EU tax fine to the anticipated announcement of the iPhone 7 just a few days away.

However, Apple has been conspicuously silent about its plans with regard to virtual and augmented reality. Although Apple has not made any formal announcements (apart from recent statements by Tim Cook, Apple’s CEO, regarding VR and AR), it’s patent filings may provide a hint about the direction they are going.

On Tuesday, the USPTO issued a new patent to Apple (USP No. 9,429,579), entitled “Head-Mounted Display Apparatus for Retaining a Portable Electronic Device with Display.” This marks the seventh U.S. patent that Apple has received relating to HMDs. (Samsung has fourteen U.S. patents relating to HMDs, with five of them being design patents.) Although recently issued, the ‘579 patent is a member in a family of patents, whose parent was filed in September 2008.  In other words, Apple has been toying with the idea of an HMD for at least the last eight years.

Claim 1 of the ‘579  patent recites:

A head-mounted device that is worn on a user’s head and configured to integrate with a cellular telephone that is removable, the head-mounted device comprising:

a frame that is configured to physically receive and carry the cellular telephone, wherein the frame places a display screen of the cellular telephone in front of the user’s eyes; and

an optical subassembly configured to receive at least one image frame from the display screen of the cellular telephone, wherein the optical subassembly is interposed between the display screen and the user’s eyes.

As described in the specification, the optical subassembly (shown below at 604) may include “lenses, light guides, light sources, mirrors, diffusers, and the like.” Specifically, optical sub assemblies may include “aspherical and diffractive optical arrangements.”  In addition, the optical subassembly may also include “one or more optical modules that may be operative to adjust or modify the displayed media based on any suitable criteria.” For example, the “optical modules” may offset left and right images so that the user is given the illusion of viewing media in three dimensions.

As we’ve said before, a company’s patent filings are certainly no guarantee that a commercial product will ever be released.  However, based on recent rumors surrounding Apple’s acquisitions, hirings and iPhone 7 technology, it is a good bet that Apple has something in the works.

NextVR: Building a Patent Portfolio

bg-dark-nextvr-all

In the past year, virtual reality broadcasting startup, NextVR, has been a frequent topic in the media for its impressive media deals and ability to raise funds.  Earlier this month, NextVR closed an $80
million
Series B round of funding, with an eye towards expanding into Asian markets where demand for virtual reality content is growing.  Continuing on with its global push, it was also recently announced that, in conjunction with FOX Sports, NextVR would present the opening football match of the 2016/2017 Bundesliga season in virtual reality.

Less reported, however, is the fact that NextVR is quietly building a patent portfolio for encoding, streaming and displaying 360 video.  Last week, six new patent applications were published having NextVR as the assignee.  According to our search of FPO, NextVR has 32 worldwide patents and patent applications.  (By comparison, Oculus has 42.)

NextVR patent fig 14The majority of NextVR’s patent applications, published on August 18, are directed to methods and apparatus for using “selective resolution reduction on images to be transmitted and/or used by a playback device.”  These applications appear to cover methods and devices for downsampling video content using texture maps and mesh models before presenting the video content on a HMD.  As the application explains, “reducing the resolution of images which are less likely to be viewed while maintaining the resolution of portions of images corresponding to an environment which are likely to be viewed, it is possible to make efficient use of limited bandwidth available for streaming image data to a playback device.”

While downsampling video is certainly not a new technology, the novelty of NextVR’s invention appears to relate to the use of texture (or “UV maps”), which are stored on the server and sent to the (HMD-connected) client ahead of the image data.  The application describes “different UV maps in combination with selective resolution reduction can be used to allocate different amounts of resolution to different portions of an image of an environment depending on which portion of the environment is considered important at a given point in time while the same environmental model is used despite the different allocations of resolution.”  Another interesting aspect of the technology, as described in the application, is that “the data rate used for transmitting images can be held relatively constant since the number of pixels in the images can remain the same with the UV map controlling the allocation of pixels to portions of the environment.”

NextVR’s recently published patent applications can be viewed here.

DirecTV Files Patent Application for Viewing “Set Top Box Content” on a Virtual Reality Device

The_DirecTV_logoLast week, the USPTO published DirecTV’s patent application for delivering “set top box content” to a virtual reality display device.  This appears to be one of the first published patent applications by a major MVPD (“multichannel video programming distributor”), and could signal that the industry is ready to push their VR chips onto the table.

DirecTV’s patent application describes transmitting a live linear television signal to a user receiving device (e.g., a set top box), which then renders the signal and transmits it to a client device (e.g., smart phone).  The client device includes a virtual reality application, which then scales the signal for display on a virtual reality device (e.g., Oculus Rift).

DirecTV patent app fig 1

Thus far, the big players in traditional (cable, satellite) video content distribution, or MVPDs (“multichannel video programming distributors”), have been relatively quiet with respect to virtual reality technology.  As seen below, most VR-related announcements by MVPDs have pertained to investments or acquisitions in studios, like NextVR.  Moreover, a recent survey of 628 entertainment and media companies showed that at least 30% of the industry considered virtual reality “a non-starter, like 3DTV.”

Non-traditional content distributors have been somewhat more forward thinking.  For example, in March, Hulu announced it would begin streaming content to Samsung Gear devices. Netflix also released a 360 promotional video last week in conjunction with its popular series, “Stranger Things.”

Top Ten MVPDs VR

Sony Files Shocking Patent Application for Monitoring and Counteracting Motion Sickness

Nausea.  Retching.  Headaches.  All-too-familiar symptoms for those unfortunate individuals who have experienced “virtual reality sickness” (and also, for those who have been to a Kenny G concert).  Often compared to motion sickness, or kinetosis, the condition can arise in a user when there is a disagreement between “visually perceived” movement and the vestibular system’s sense of movement.  In short, it is a major challenge for VR content developers, and also one of the reasons why several HMD companies have recommended that games run at a minimum of 90 FPS.

To deal with this problem, Sony has filed a patent application entitled132 “Motion Sickness Monitoring and Application of Supplemental Sound to Counteract Sickness.”  The patent application was originally filed on February 5, 2015 and published today.  To detect motion sickness, the application describes monitoring a user’s body motion, pupil motion, gaze, head motion, balance, or “by tracking facial expressions of the user that may indicate motion sickness (e.g., a gagging motion, sticking out the tongue, etc.).”

When motion sickneSony AMS FIG 2ss is detected, the system takes action by delivering “supplemental sound,” reducing the intensity of the game or vibrating the headset.  Sony’s application claims that supplemental sound has a therapeutic effect, and in particular, describes a system to deliver “bone conduction audio” by transmitting audible or ultrasonic sound waves through a portion of a user’s skull close to the ear.  These vibrations can be generated by a device incorporated into the strap of the HMD.

Sony’s application goes on to describe further embodiments for battling motion sickness including transmitting microwaves that are “safe for the inner ear,” infrared stimulation and “small electric shocks.”

The use of vestibular stimulation is a known technique to battle motion sickness in virtual reality environments (over fifteen years old), and some parties have already obtained patents for it. (See here and here.)  However, it will be interesting, to say the least, to see if Sony can eventually introduce this technology into its commercial PSVR headsets.  Until then, VR users will just have to keep a case of ginger ale handy.

 

BMW v. TurboSquid: Virtual Patent Infringement?

The blog, Protecting Designs, reported an interesting case filed last month that may have legal ramifications to the burgeoning VR industry:  BMW v. TurboSquid, Inc.

The issue:  Can selling a digital 3D model of a car, which exists only in virtual reality, infringe a design patent?

According to Wikipedia,

TurboSquidTurboSquid is a digital media company that sells stock 3D models used in 3D graphics to a variety of industries, including computer games, architecture, and interactive training. The company, headquartered in New Orleans, Louisiana in the United States, is most known for brokering the sale of 3D models in return for a percentage of the sales. As of 2014, TurboSquid had over 370,000 3D models in its library, making it the largest library of 3D models for sale in the world.

TurboSquid’s website lists Sony Pictures, Activision and Pixar as a few of their clients.

On May 3, 2016, BMW filed a complaint in a federal district court in New Jersey alleging, among other claims, that TurboSquid’s 3D models of certain vehicles infringe BMW’s design patents.  In particular, BMW alleges that TurboSquid is “marketing 3-D virtual models of vehicles that infringe the BMW trademarks, trade dress, and design patents.  [TurboSquid] markets and tags BMW-trademarked 3-D virtual models of BMW vehicles as suitable for games.”

mini
Image from U.S. Patent No. D664,896

BMW’s design patents (D473,165, D639,209, D664,896, D714,190, D714,687, and D724,495) are directed to BMW, Mini, and Rolls-Royce branded vehicles produced by BMW Group. The ’165 patent is titled “Surface configuration of a vehicle, toy and miscellaneous consumer products incorporating the design,” and the other patents are each titled “Vehicle, toy, and/or replicas thereof.” BMW have also asserted trademark infringement claims against TurboSquid and is seeking injunctive relief, disgorgement of all of TurboSquid’s profits under 35 U.S.C. Section 289, attorneys’ fees and other remedies.

 

It remains to be seen whether “virtual” objects can infringe a design patent (or perhaps in a future case, utility patents).

For more analysis on the trademark claims, Patently-O had an interesting write-up which can be accessed here.

Sony’s HMD Patent Application

Earlier this year, at the Game Developers Conference in San Francisco, Sony announced that its virtual reality headset for the PS4 would launch in October 2016.  At GDC, Sony also demonstrated the social aspect of its VR systems, in which multiple players interacted with each other in a virtual reality environment.

Sony 163 Appl FIG 11

Last week, on May 12, the USPTO published Sony’s patent application, Sony Computer Entertainment’s U.S. Patent Appl. No. 14/996,163 (the ‘163 application).  The ‘163 application is simply entitled “Head Mounted Display,” claims priority to a provision filed in June 9, 2013.  The “inventive concept” of the claims here appears to be rendering a player’s hands into the virtual reality scene, as shown below in claim 17 (emphasis added).

17.    A method for operating a head mounted display (HMD), comprising,

providing the HMD having a head attachment portion and a viewing module coupled to the head attachment portion, the viewing module including an inner side having a view port into a screen configuring for rendering a virtual reality scene, and an exterior housing;

providing a communications module for exchanging data with a computer system, the computer system is configured to generate the virtual reality scene for the screen;

providing a depth camera integrated into the viewing module and oriented to capture depth data of an envrionment in front of the exterior housing; and

processing, by the computer system, the depth data captured by the depth camera to identify hands of a user wearing the HMD in the environment, wherein the hands are rendered into the virtual reality scene, the hands being tracked such that movements of the hands appear as movements of virtual hands extending into the virtual reality scene.

As evident from the claims, the rendering of the virtual hands relies upon data captured by a depth camera located on the HMD.  This is interesting because the depth camera appears to be technology that Sony developed as early as 2011 in response to Microsoft’s Kinect technology.  More information about Sony’s depth camera can be found here and here.