Image light is generated with a display light source. The image light is visible. An infrared light source emits infrared light. A scan directs the image light and the infrared light to an input coupler of a display waveguide and the display waveguide presents the image light to an eyebox region as a virtual image.
The disclosed fiber optic cable may include (1) a plurality of optical fibers, (2) a core tube surrounding the plurality of optical fibers, (3) a thixotropic gel filling an interstitial space among the optical fibers within the core tube, (4) an intermediate layer surrounding the core tube, where the intermediate layer includes a plurality of linear elements contra-helically wrapped about the core tube, and (5) an outer layer surrounding the intermediate layer, where the outer layer includes a combination of a moisture-cure cross-linked material and an activation catalyst, where the outer layer is formed by masticating and extruding the combination onto the intermediate layer. Various other cables, assemblies, and methods are also disclosed.
G02B 6/44 - Mechanical structures for providing tensile strength and external protection for fibres, e.g. optical transmission cables
H02G 1/02 - Methods or apparatus specially adapted for installing, maintaining, repairing, or dismantling electric cables or lines for overhead lines or cables
3.
HIGH ACCURACY PEOPLE IDENTIFICATION OVER TIME BY LEVERAGING RE-IDENTIFICATION
In one embodiment, a method, by one or more computing systems, includes determining, based on frames captured by a camera, a plurality of participants are located in an environment, locating, within a first frame, a first body region of a first participant of the plurality of participants, detecting, at a first time, appearance information of the first body region of the first participant, calculating, using one or more machine-learning models, a confidence score corresponding to a match between the appearance information of the first participant at the first time and one or more profiles of pre-registered participants, updating, using the one or more machine-learning models, the confidence score based on one or more additional appearance information detected within additional frames, determining whether the updated confidence score is above a predetermined threshold, and in response to determining the updated confidence score is above the predetermined threshold, authenticating the first participant.
G06V 10/98 - Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
G06V 10/26 - Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
G06V 10/74 - Image or video pattern matching; Proximity measures in feature spaces
G06V 10/774 - Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
In one embodiment, a method includes accessing an image of one or more target buildings captured by a device; detecting target building planes of the one or more target buildings in the image using a machine learning program; for each of the target building planes: generating a target embedding and target feature points for the target building plane; querying a three-dimensional (3D) map using the target embedding to identify at least one matching building plane for the target building plane; using the target feature points to identify matching feature points of the at least one matching building plane; and determining three-dimensional (3D) locations of the matching feature points using the 3D map; and determining a pose of the device by comparing the target feature points of the target building planes and the 3D locations of the matching feature points associated with the target building planes.
A wearable device with a display screen has both an image presentation area and a camera portion. The wearable device includes a camera module configured to capture images through the camera portion and a camera frame that is molded onto the display screen, creating a pocket in which the camera module is securely held. This camera frame is made of a material that not only keeps the camera module in place but also forms an environmental seal, effectively protecting the space between the camera module and the display screen.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
According to examples, a wearable device may include an imaging component, at least one wireless communication component, and a controller. The controller may activate the at least one wireless communication component to perform a wireless scan of at least one radio available to respond to the wireless scan. The controller may also receive, through the at least one wireless communication component, wireless scan data from the at least one radio and may embed the wireless scan data as part of a media metadata. The wireless scan data may be used to determine a location estimate of the at least one radio and thus, the wearable device. The location estimate of the wearable device may also be used to geotag media captured by the wearable device without using a GPS receiver on the wearable device or when a GPS receiver is unable to track a current location.
G01S 5/02 - Position-fixing by co-ordinating two or more direction or position-line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
H04W 4/02 - Services making use of location information
Disclosed herein are light sources (e.g., micro-LEDs and μOLEDs), display electronics, and tiled display panels for high luminance, high resolution display panels used in near-eye display systems. Techniques for three-dimensional integration of multi-color LEDs, micro-LED surface loss reduction using band engineered sidewall passivation structures, micro-LED heat spreading materials and structures, and micro-LED light extraction efficiency improvement using etched outwardly tilted sidewall minors are described. Techniques for drive circuit supply voltage tracking and compensation, dynamic burn-in compensation using interpolation of compensation parameters, and digital misalignment calibration of tiled display panels are also described.
H01L 25/075 - Assemblies consisting of a plurality of individual semiconductor or other solid state devices all the devices being of a type provided for in the same subgroup of groups , or in a single subclass of , , e.g. assemblies of rectifier diodes the devices not having separate containers the devices being of a type provided for in group
H01L 27/12 - Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including integrated passive circuit elements with at least one potential-jump barrier or surface barrier the substrate being other than a semiconductor body, e.g. an insulating body
An optimized solvent-based liquid metal composition includes a solution and a liquid metal mixed with the solution. The solution includes at least one solvent and a polymeric binder dissolved in the at least one solvent. Additionally or optionally, the composition includes a metallic filler. The ingredients of the composition are tailored to extend decap time while maintaining other beneficial properties to permit the use of the composition in various printing techniques.
C09D 11/54 - Inks based on two liquids, one liquid being the ink, the other liquid being a reaction solution, a fixer or a treatment solution for the ink
C22C 28/00 - Alloys based on a metal not provided for in groups
A lanyard to hold a controller for a headset is provided. The lanyard includes a strap anchored on a top portion of a lid for a battery case of the controller, and a clip anchored to an opening pin in a bottom portion of the lid for the battery case of the controller. The strap includes a stretchable fabric and multiple sticky pads on an outer face that adhere to the stretchable fabric when the strap is looped around the clip. A headset using a controller that includes a lanyard as above, and the controller, are also provided.
A wearable device includes a front portion configured to engage a front portion of a head of a user, and a rear portion configured to engage a rear portion of the head of the user. The rear portion includes a telescoping arm guide, a telescoping arm slidably coupled to the telescoping arm guide such that the telescoping arm is moveable relative to the telescoping arm guide, a cable guide coupled to the telescoping arm guide, and a connector. The device includes an optical fiber coupled to the telescoping arm at a first point, coupled to the connector at a second point, and slidably coupled to the cable guide between the first point and the second point, such that the optical fiber includes a medial portion between the first point and the second point, the medial portion including a bend that is greater than or equal to a minimum bend radius.
Aspects of the present disclosure can trigger an action based on a motion detected by an artificial reality (XR) device, such as a head-mounted display (HMD). The XR device can display an XR experience to a user. While displaying the XR experience, the XR device can detect a physical interaction with the XR device using one of more sensors (e.g., sensors of an inertial measurement unit (IMU)). The physical interaction can generate a movement profile captured by the one or more sensors. The XR device can identify the physical interaction as a particular motion (e.g., one or more taps on the XR device) by applying a machine learning model to the movement profile. In response to identifying the particular motion, the XR device can trigger an action on the XR device (e.g., activating pass-through on the XR device).
G06F 1/16 - Constructional details or arrangements
G06F 3/0487 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
G06F 3/04883 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
12.
APPLICATION MULTITASKING IN A THREE-DIMENSIONAL ENVIRONMENT
Aspects of the present disclosure are directed to application multitasking in a shell with a three-dimensional environment. Implementations immerse a user in a three‑dimensional environment via an artificial reality system, such as a display environment for a system shell. The system shell can execute applications (e.g., system shell applications, remoted applications, etc.). An executing application can correspond to a displayed virtual object (e.g., panel). The system shell can concurrently execute two, three, or more applications and the three‑dimensional environment can concurrently display two, three, or more corresponding virtual objects that display contents for the executing applications. Implementations of a mode manager can manage a mode for the three‑dimensional environment/system shell. Example modes include cooperative mode and exclusive mode. Implementations of cooperative mode permit concurrent display of multiple virtual objects from different applications while the exclusive mode permits display of virtual objects only from the executing application entering exclusive mode.
The disclosed computer-implemented method may include accessing various antenna elements and identifying parameters for an antenna that is to be formed using the accessed antenna elements. The method may also include assembling the antenna elements, using an artificial intelligence (AI) instance, into an assembled antenna that at least partially complies with the identified parameters. Various other methods, systems, and computer-readable media are also disclosed.
Aspects of the present disclosure are directed to an adjustment mechanism for adjusting an eye-to-lens distance of a headset display device. The adjustment mechanism can include an adjustment wheel that is rotatable by a user, a pinion gear fixed to a screw, and a threaded member receiving the screw and mounted to a forehead pad frame supporting a forehead pad. The adjustment wheel can include an internal bevel gear ring. The pinion gear is rotated by rotation of the internal bevel gear ring, and the screw rotates with the pinion gear. The pinion gear and the screw can rotate about a second axis. The threaded member moves along the screw, as the screw rotates, to move the forehead pad to adjust the eye-to-lens distance. The internal bevel gear ring, the pinion gear, and the screw are configured to allow additional components to pass through an interior of the adjustment wheel.
G02B 7/04 - Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
15.
Presenting Meshed Representations of Physical Objects Within Defined Boundaries for Interacting With Artificial-Reality Content, and Systems and Methods of Use Thereof
A method of interacting with an artificial-reality (AR) content at an AR headset that includes cameras and displays is described. The method includes, while the AR headset has a first position within a physical environment that includes an object, if a distance of the object is within a threshold collision distance from the AR headset, presenting a meshed representation of the object. The meshed representation is displayed at first respective locations on the displays such that the meshed representation is viewable within the artificial reality. After the AR headset moves to a second position with a different distance, and if the different distance is within the threshold collision distance from the AR headset, moving the meshed representation of the object to second respective locations within the artificial reality. The second respective locations correspond to the position of the object in the physical environment.
An edge coupler for coupling a light beam (e.g., a laser beam) into a waveguide comprises a first waveguide section characterized by a first thickness and a first constant width, a second waveguide section physically coupled to the first waveguide section and characterized by the first thickness and a gradually decreasing width, and a third waveguide section partially overlapping with the second waveguide section at an overlap region, the third waveguide section characterized by a gradually increasing width and a second thickness different from (e.g., greater than) the first thickness. In some embodiments, a surface (e.g., the top or bottom surface) of the second waveguide section and a surface (e.g., the top or bottom surface) of the third waveguide section are on a same plane.
G02B 6/12 - Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings of the optical waveguide type of the integrated circuit kind
G02B 6/122 - Basic optical elements, e.g. light-guiding paths
The disclosed method may include driving a reference signal into a body and detecting, in response to the reference signal, a plurality of biosignal measurements using at least one electrode of a biosensing device. The method may further include determining, based on the plurality of biosignal measurements, a relative location of the at least one electrode with respect to the body, and providing feedback based on the relative location of the at least one electrode. Various other methods, systems, and computer-readable media are also disclosed.
Aspects of the present disclosure are directed to providing an overlay over a concurrently executing artificial reality (XR) environment. Implementations immerse a user in a three‑dimensional XR environment via a XR system. An overlay manager can dynamically display a two-dimensional overlay over the three-dimensional XR environment in response to input that triggers the overlay. The overlay can provide a runtime that executes application components (e.g., system shell applications and applications remote from the system shell). For example, an executing application can provide a two-dimensional virtual object (e.g., panel) displayed in the two‑dimensional overlay. The overlay can provide a user concurrent access to the 2D components of additional applications, without requiring termination of the three‑dimensional XR environment. In some implementations, the XR environment is transitioned to a paused state while the overlay is active and restored to an active state when the overlay is closed.
Some aspects of the present disclosure are directed to providing partial pass-through on an artificial reality (XR) device, such as a head-mounted display (HMD). Some implementations can allow a user to turn on selective areas of pass-through on the XR device, such that one or more portions of a real-world environment physically surrounding the user can be seen. In some implementations, a user can control the area of pass-through by specifying a percentage of the real-world environment he wishes to see, e.g., 50%. In some implementations, a user can control the area of pass-through by specifying an area of XR device she wishes to see, e.g., the top portion of the view. In some implementations, a user can control the area of pass-through by specifying a physical object in the real-world environment he wishes to see, e.g., a real-world desk.
A lanyard to hold a controller for a headset is provided. The lanyard includes a strap anchored on a top portion of a lid for a battery case of the controller, and a clip anchored to an opening pin in a bottom portion of the lid for the battery case of the controller. The strap includes a stretchable fabric and multiple sticky pads on an outer face that adhere to the stretchable fabric when the strap is looped around the clip. A headset using a controller that includes a lanyard as above, and the controller, are also provided.
Techniques for providing suggested content is described. For example, a social networking system may receive, from an account of a social networking system, an indication of a selection of a first content item. The social networking system may determine that the first content item is associated with a first topic and may receive a request from the account to access a second content item associated with the first topic. The social networking system may then cause presentation of the second content item and may determine that the request meets or exceeds a threshold number of requests for content items associated with the first topic. Based on determining that the request meets or exceeds the threshold, the social networking system may cause presentation of a suggested content item associated with a second topic.
A flexible electronic system comprises a flexible substrate comprising an interlayer elastomer dielectric and a plurality of rigid components disposed within the flexible substrate. The flexible electronic system may further comprise a high-density interconnect region comprising one or more routing layers. In examples, the flexible electronic system may further comprise a flexible barrier material encapsulating the flexible electronic system. In some examples the flexible electronic system and the high-density interconnect region may further comprise a plurality of routing layers and one or more through-vias. Each through-via may couple at least one of two rigid components, two routing layers, or a rigid component and a routing layer. In examples, at least some of the routing layers may comprise conductive traces.
An eye tracking system for a head-mounted devices includes an interference pattern emitter, an interference pattern detector, and processing logic. The interference pattern emitter provides at least two light beams that combine into a light pattern in an eyebox region of the head-mounted device. The light pattern includes an interference pattern based on constructive and destructive interference of the at least two light beams. The light detector is configured to detect a portion of the light pattern and provides detector data that is representative of one or more light intensities in the portion of the light pattern. The processing logic is coupled to the light detector to receive the detector data and is configured to identify displacement characteristics of the interference pattern. The processing logic is configured to determine orientation characteristics of an eye in the eyebox region based on the displacement characteristics.
In one embodiment, a method includes accessing a map of a building floor plan with locations of access points within the floor plan, the access points being capable of performing wireless communications with wireless devices. Determining a pose of a wireless device within the map using images captured by one or more cameras of the wireless device. Selecting a preferred access point based on the pose of the wireless device, the floor plan, and the locations of the plurality of access points within the floor plan. Configuring wireless communication settings of the wireless device to communicate with the preferred access point based on the pose of the wireless device and the location of the preferred access point within the floor plan.
The disclosed system may include at least one gradient-index liquid crystal lens. The system may include a selection module that selects a viewing angle. The system may also include an adjustment module that dynamically adjusts a phase reset property of the gradient-index liquid crystal lens in response to the selected viewing angle. Various other devices, systems, and methods are also disclosed.
G02F 1/29 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
26.
VIEW SYNTHESIS PIPELINE FOR RENDERING PASSTHROUGH IMAGES
A processor accesses a depth map and a first image of a scene generated using one or more sensors of an artificial reality device. The processor generates, based on the first image, segmentation masks respectively associated with a plurality of object types. The segmentation masks segment the depth map into a plurality of segmented depth maps respectively associated with the object types. The processor generates meshes using, respectively, the segmented depth maps. For each eye of the user, the processor captures a second image and generates, based on the second image, segmentation information. The processor warps the plurality of meshes to generate warped meshes for the eye, and then generates an eye-specific mesh for the eye by compositing the warped meshes according to the segmentation information. The processor renders an output image for the eye using the second image and the eye-specific mesh.
An actuator assembly includes a primary electrode, a secondary electrode overlapping at least a portion of the primary electrode, and an electroactive polymer layer disposed between the primary electrode and the secondary electrode, where the electroactive polymer layer includes a non-vertical (e.g., sloped) sidewall with respect to a major surface of at least one of the electrodes. The electroactive polymer layer may be characterized by a non-axisymmetric shape with respect to an axis that is oriented orthogonal to an electrode major surface.
H01L 41/317 - Applying piezo-electric or electrostrictive parts or bodies onto an electrical element or another base by depositing piezo-electric or electrostrictive layers, e.g. aerosol or screen printing by liquid phase deposition
H01L 41/09 - Piezo-electric or electrostrictive elements with electrical input and mechanical output
H01L 41/29 - Forming electrodes, leads or terminal arrangements
Techniques for generating customized graphical elements are described. For example, a social networking system may receive, from a device of an account of a social networking system, an image including at least a portion of a face of a user associated with the account. The social networking system may generate a face mesh including at least a portion of the face depicted in the image, and then may expand the face mesh to include at least a portion of the head of the user other than the face to generate a customized graphical element. The customized graphical element may be further modified, stored, and subsequently shared with one or more other accounts alone and/or in association with one or more content items.
An eye tracking system employing three-dimensional (3D) sensing using time of flight is provided. Instead of directly measuring the time of arrival of the emitted photons, the light intensity of the transmitted laser beam is modulated, and a phase change of the return beam computed by comparison with the transmit waveform. The modulation frequency is resolved with radio frequency (RF) mixing and digital signal processing techniques. A variety of phase detection systems and techniques including, but not limited to, quadrature analog front end detection and analog homodyne phase detection are applied. The modulation frequency may, depending on phase detection technique, be sinusoidal or pulsed.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G01S 7/481 - Constructional features, e.g. arrangements of optical elements
G01S 7/4915 - Time delay measurement, e.g. operational details for pixel components; Phase measurement
G01S 17/32 - Systems determining position data of a target for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
A computer-implemented method, comprising accessing an image comprising a handheld device, wherein the image is captured by one or more cameras associated with the computing device, generating a cropped image that comprises a hand of a user or the handheld device from the image by processing the image, generating a vision-based six degrees of freedom (6DoF) pose estimation for the handheld device by processing the cropped image, metadata associated with the image, and first sensor data from one or more sensors associated with the handheld device, generating a map-based 6DoF pose estimation using the handheld device, and generating a final 6DoF pose estimation for the handheld device based on the vision-based 6DoF pose estimation and the map-based 6DoF pose estimation generated using the handheld device.
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/03 - Arrangements for converting the position or the displacement of a member into a coded form
Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 16/9536 - Search customisation based on social or collaborative filtering
G06T 19/00 - Manipulating 3D models or images for computer graphics
G06T 19/20 - Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
32.
SYSTEMS, METHODS, AND MEDIA FOR GENERATING VISUALIZATION OF PHYSICAL ENVIRONMENT IN ARTIFICIAL REALITY
In one embodiment, a method by a computing system comprising a color camera and two monochrome cameras respectively associated with two eyes of a user includes computing a point cloud corresponding to a visible environment based at least on two stereoscopic grayscale images respectively captured by the two monochrome cameras, generating a mesh corresponding to the visible environment based on the computed point cloud, and generating two stereoscopic colorized images to be respectively displayed to the two eyes of the user, where each of the two stereoscopic colorized images is generated using (1) the mesh, (2) luminance information from one of the two stereoscopic grayscale images that is associated with the eye to which the stereoscopic colorized image is to be displayed, and (3) color information from a color input image captured by the color camera.
H04N 13/239 - Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
G06T 7/593 - Depth or shape recovery from multiple images from stereo images
H04N 13/243 - Image signal generators using stereoscopic image cameras using three or more 2D image sensors
H04N 13/25 - Image signal generators using stereoscopic image cameras using image signals from one sensor to control the characteristics of another sensor
H04N 13/254 - Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
H04N 13/344 - Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
A projector sequentially generates light pulses to form a sparse grid array. The light pulses reflect off objects in an environment and are reflected towards a sensor array. The sensor array sequentially senses the reflected light pulses across pixels of the sensor array. A depth sensing system calculates depth information of objects in the environment based on the sequential nature of the pulse generation and the pulse sensing. The depth sensing system calculates depth information based on both the positional and temporal information of generated light pulses, and the positional and temporal information of sensed light pulses. The depth sensing system may generate a representation of the environment based on the depth information.
G01B 11/25 - Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. moiré fringes, on the object
G01S 17/89 - Lidar systems, specially adapted for specific applications for mapping or imaging
H04N 25/40 - Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
H04N 25/60 - Noise processing, e.g. detecting, correcting, reducing or removing noise
34.
Channels of content for display in an online system
Ephemeral stories allow users of an online system, such as a social networking system, to share content for a pre-determined temporary length of time. Channels group and organize stories based on content. Topic-based channels allow contain stories that have related content. Hashtag- and sticker-associated channels contain stories that include particular hashtags or stickers, respectively. User-specific channels contain content tailored by the online system for display to a particular user based on preferences and history. Collaborative channels are channels that are private to a specific group of users. The use of channels improves the online experience by grouping stories by content, thereby facilitating users' interaction with similar content.
G06F 16/958 - Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
G06F 16/908 - Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
G06F 16/9536 - Search customisation based on social or collaborative filtering
G06Q 50/00 - Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
H04L 65/611 - Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
35.
Electromagnetic interference reduction in extended reality environments
Methods and systems for reducing electromagnetic interference in analog circuit of a control device for an augmented reality (AR) or virtual reality (VR) system are described. An analog circuit associated with the control device may include at least one amplifier and an analog-to-digital converter coupled to an amplifier by one or more electrical conductors. Electromagnetic interference induced in the one or more electrical conductors by an external AC magnetic field may be reduced using at least one component of the control device configured to reduce the electromagnetic interference.
G09G 5/36 - Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of individual graphic patterns using a bit-mapped memory
A61B 5/00 - Measuring for diagnostic purposes ; Identification of persons
A61B 5/296 - Bioelectric electrodes therefor specially adapted for particular uses for electromyography [EMG]
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
The disclosed computer-implemented method may include systems for generating personalized avatar reactions during live video broadcasts. For example, the systems and methods described herein can access a social networking system user's profile to identify an avatar associated with the social networking system user. The systems and methods can generate an avatar reaction by modifying one or more features of the avatar based on a corresponding emoticon reaction. Once generated, the social networking system user can select the avatar reaction for addition to an ephemeral reaction stream associated with a live video broadcast. Various other methods, systems, and computer-readable media are also disclosed.
In one embodiment, a method by an arbiter associated with hardware resources of a computing system includes associating with N indexed requesters requesting accesses to the hardware resources, where each of the N indexed requesters is associated with a credit counter and a weight, repeatedly granting a right to access the hardware resources to each requester that satisfies conditions in an indexing order among the N indexed requesters until none of the N indexed requesters satisfies the conditions and replenishing, upon a determination that none of the N indexed requesters satisfies the conditions, a credit counter associated with each of the N indexed requesters.
A thermoplastic interposer formed of ordered polymer sheets that may be configured to act as an interconnect and as a thermal energy spreader. In examples, the thermoplastic interposer may include one or more extensions or wings to further dissipate heat. In examples, laser direct structuring (LDS) may be used to form or more through silicon vias (TSVs) or through-chip vias. In examples, the ordered polymer sheets may be extruded via a roll-to-roll process, stacked, and processed to form a laminate interposer structure that makes up the interposer. In examples, the thermoplastic interposer may be used in multi-layer structures interconnecting two or more board assemblies such as printed circuit boards (PCB)s.
An electronic device includes a substrate and a circuit having a plurality of electrically-conductive components disposed on the substrate. The plurality of electrically-conductive components includes first, second and third electrically-conductive components. The third electrically-conductive component has a first end portion forming a first interface with the first electrically-conductive component and a second end portion forming a second interface with the second electrically conductive component. The first electrically-conductive component is made of a first material including a first metal. The second electrically-conductive component is made of a second material including the first metal. The third electrically-conductive component is made of a third material including a gallium-based alloy and a metallic filler. The metallic filler reduces a reactivity of the third electrically-conductive component with the first metal at the first and second interfaces, and thus minimizes deterioration of the first electrically-conductive component and the second electrically-conductive component over time.
H01L 23/29 - Encapsulation, e.g. encapsulating layers, coatings characterised by the material
H01B 1/22 - Conductive material dispersed in non-conductive organic material the conductive material comprising metals or alloys
H01L 21/48 - Manufacture or treatment of parts, e.g. containers, prior to assembly of the devices, using processes not provided for in a single one of the groups
A method and system for generating stylized representations in virtual/augmented reality applications. The method includes retrieving a two-dimensional (2D) image of a subject and a depth field associated with the 2D image. The method also includes generating a three-dimensional (3D) mesh based on the 2D image and the depth field. The method also includes generating a stylized texture field based on an analysis of the 2D image of the subject. The method also includes generating a 3D stylized model of the subject by enveloping the 3D mesh with the stylized texture field.
The disclosed method may include driving, using a biosensing device, a right-leg drive (RLD) signal, and measuring, using the biosensing device, a biosignal. The method also includes determining, from the measured biosignal, noise within the biosignal, and tuning, based on the noise, the RLD signal. Various other methods, systems, and computer-readable media are also disclosed.
G01D 3/036 - Measuring arrangements with provision for the special purposes referred to in the subgroups of this group mitigating undesired influences, e.g. temperature, pressure on measuring arrangements themselves
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
42.
View Synthesis Pipeline for Rendering Passthrough Images
A processor accesses a depth map and a first image of a scene generated using one or more sensors of an artificial reality device. The processor generates, based on the first image, segmentation masks respectively associated with a plurality of object types. The segmentation masks segment the depth map into a plurality of segmented depth maps respectively associated with the object types. The processor generates meshes using, respectively, the segmented depth maps. For each eye of the user, the processor captures a second image and generates, based on the second image, segmentation information. The processor warps the plurality of meshes to generate warped meshes for the eye, and then generates an eye-specific mesh for the eye by compositing the warped meshes according to the segmentation information. The processor renders an output image for the eye using the second image and the eye-specific mesh.
In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.
A tunable lens including a pair of reflectors is disclosed. At least one of the reflectors may be curved for contributing to the focusing or defocusing power of the lens. At least one of the reflectors is translatable for tuning the focusing/defocusing power. The reflectors may be configured in a pancake lens configuration where one of the reflectors is a 50/50 reflector and the other is a polarization selective reflector. Refractive elements may be disposed between the reflectors for providing more optical power to the lens, and/or for balancing optical aberrations.
G02B 26/08 - Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
A method of forming a uniaxially oriented crystalline polymer article includes heating a segment of a crystallizable polymer article to a first temperature, applying a stress to the crystallizable polymer article in an amount effective to induce a positive strain within the segment of the crystallizable polymer article, and heating the segment of the crystallizable polymer article to a second temperature greater than the first temperature while continuing to apply the stress.
B29C 55/08 - Shaping by stretching, e.g. drawing through a die; Apparatus therefor of plates or sheets uniaxial, e.g. oblique transverse to the direction of feed
46.
SYSTEMS FOR CALIBRATING NEUROMUSCULAR SIGNALS SENSED BY A PLURALITY OF NEUROMUSCULAR-SIGNAL SENSORS, AND METHODS OF USE THEREOF
Methods for calibrating neuromuscular signals sensed by a plurality of neuromuscular-signal sensors are provided. One example method includes, in response to a triggering event, receiving a pulse sensed by a neuromuscular-signal sensor of a plurality of neuromuscular-signal sensors of a wrist-wearable device. The method also includes, in accordance with a determination that the pulse indicates that at least one neuromuscular-signal sensor of the plurality of neuromuscular-signal sensors of the wrist-wearable device is offset from a respective predetermined default position, determining a worn position of the wrist-wearable device on the user's wrist, and adjusting analysis of neuromuscular signals of the plurality of neuromuscular-signal sensors based on an offset between the worn position of the wrist-wearable device and a predetermined default position of the wrist-wearable device.
In one embodiment, a method by a computing system comprising a color camera and two monochrome cameras respectively associated with two eyes of a user includes computing a point cloud corresponding to a visible environment based at least on two stereoscopic grayscale images respectively captured by the two monochrome cameras, generating a mesh corresponding to the visible environment based on the computed point cloud, and generating two stereoscopic colorized images to be respectively displayed to the two eyes of the user, where each of the two stereoscopic colorized images is generated using (1) the mesh, (2) luminance information from one of the two stereoscopic grayscale images that is associated with the eye to which the stereoscopic colorized image is to be displayed, and (3) color information from a color input image captured by the color camera.
A distributed imaging system for augmented reality devices is disclosed. The system includes a computing module in communication with a plurality of spatially distributed sensing devices. The computing module is configured to process input images from the sensing devices based on performing a local feature matching computation to generate corresponding first output images. The computing module is further configured to process the input images based on performing an optical flow correspondence computation to generate corresponding second output images. The computing module is further configured to computationally combine first and second output images to generate third output images.
A projector sequentially generates light pulses to form a sparse grid array. The light pulses reflect off objects in an environment and are reflected towards a sensor array. The sensor array sequentially senses the reflected light pulses across pixels of the sensor array. A depth sensing system calculates depth information of objects in the environment based on the sequential nature of the pulse generation and the pulse sensing. The depth sensing system calculates depth information based on both the positional and temporal information of generated light pulses, and the positional and temporal information of sensed light pulses. The depth sensing system may generate a representation of the environment based on the depth information.
A graded-index optical element may include a nanovoided material including a first surface and a second surface opposite the first surface. The nanovoided material may be transparent between the first surface and the second surface. Additionally, the nanovoided material may have a predefined change in effective refractive index in at least one axis due to a change in at least one of nanovoid size or nanovoid distribution along the at least one axis. Various other elements, devices, systems, materials, and methods are also disclosed.
B29D 11/00 - Producing optical elements, e.g. lenses or prisms
G02B 1/04 - Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of organic materials, e.g. plastics
A method for generating a content feed includes receiving, from a content provider, a target content item and a policy for the target content item, specifying a prohibited classification of the content that cannot be published adjacent to the target content item. The method also includes identifying a slot in a content feed including multiple content items. A machine learning model is then accessed and applied to two adjacent content items that are adjacent to the slot to determine whether each of the adjacent content items is the prohibited classification. Responsive to determining that the adjacent content items are not the prohibited classification, the target content item is placed in the slot, and the content feed including the target content item is sent for display to a viewing user.
Various embodiments set forth high-resolution liquid crystal displays and components thereof. In some embodiments, light emitted by a high-resolution green color liquid crystal display is combined, via a combiner, with light emitted by at least one lower-resolution red and blue color liquid crystal display. The red and blue color display(s) may include a single display or two displays positioned on opposing sides of the combiner. The combiner may be a dichroic or polarization-based combiner. Combined light from the green color display and the red and blue color display(s) is passed through collimating optics, such as a pancake lens or a Fresnel lens, toward a viewer's eye.
Methods and corresponding systems and apparatuses for saving power through selectively disabling clock signals in a systolic array are described. In some embodiments, a clock gate controller is operable to output a gated clock signal from which local clock signals of processing elements in the systolic array are derived. The gated clock signal corresponds to a root clock signal that is distributed through a clock distribution network or clock tree. The clock gate controller is located along one branch of the clock distribution network. The branch can be associated with processing elements that form a column within the systolic array. Disabling the gated clock signal disables the local clock signals along the entire branch, preventing any components that are clocked by those local clock signals from consuming power. Additional clock gate controllers can similarly be provided for other branches, including a branch associated with another column.
G06F 1/00 - ELECTRIC DIGITAL DATA PROCESSING - Details not covered by groups and
G06F 1/3237 - Power saving characterised by the action undertaken by disabling clock generation or distribution
G06F 15/80 - Architectures of general purpose stored program computers comprising an array of processing units with common control, e.g. single instruction multiple data processors
G06F 1/3203 - Power management, i.e. event-based initiation of a power-saving mode
57.
NETWORK ASSET TRACKING USING GRAPH SIZE ESTIMATION
Disclosed technology herein provides a computer-implemented method for asset tracking in a network having a plurality of connected devices, comprising generating a network graph based on network data captured at least in part via peer-to-peer polling, the network data including data relating to tracked assets in a network, where the peer-to-peer polling is used to validate a presence of at least a portion of the tracked assets in the network, generating an estimated size of the network graph using a graph estimation algorithm, determining an estimate of the tracked assets based on the estimated size of the network graph, and determining one or more remediation actions in response to the estimate of the tracked assets, where at least a portion of the network graph can be stored in a decentralized manner. The graph estimation algorithm can include a random walk algorithm, a random sampling algorithm, and/or an induced edges algorithm.
The disclosed system may include a conductive enclosure, a first printed circuit board (PCB) that includes multiple antenna feeds, and a second PCB that includes a grounding layer and one or more sensors. A first antenna feed may be electrically connected to the conductive enclosure, and a second antenna feed may be electrically connected to the grounding layer of the second PCB. As such, the grounding layer of the second PCB may act as a radiating element for a second antenna. Various other mobile electronic devices, apparatuses, and methods of manufacturing are also disclosed.
H01Q 5/328 - Individual or coupled radiating elements, each element being fed in an unspecified way using frequency dependent circuits or components, e.g. trap circuits or capacitors between a radiating element and ground
H01Q 1/52 - Means for reducing coupling between antennas; Means for reducing coupling between an antenna and another structure
A camera assembly with two distinct magnifications is described. The camera assembly includes a lens assembly with two modules to perceive light. The first module includes two halves of different lens assemblies disposed together to provide two different optical paths and fields of view to obtain the two different optical magnifications. The second module includes a lens assembly common to the two halves of the first module. A biprism provides light separation for the two halves of the first module. Thus, light received and subjected to two different magnifications in the first module at a distal end of the camera assembly is further processed through the second module before being provided to a sensor. The biprism at the camera's distal end keeps the two different lens assemblies of the first module at the same viewing direction.
H04N 23/55 - Optical parts specially adapted for electronic image sensors; Mounting thereof
G02B 13/18 - Optical objectives specially designed for the purposes specified below with lenses having one or more non-spherical faces, e.g. for reducing geometrical aberration
G02B 27/00 - Optical systems or apparatus not provided for by any of the groups ,
G06F 1/16 - Constructional details or arrangements
H04N 5/262 - Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects
60.
SYSTEMS, METHODS, AND DEVICES FOR PRODUCING INTERCONNECTS ON DEFORMABLE SUBSTRATES OF ELECTRONIC DEVICES
The present disclosure provides systems, methods, and devices for producing an interconnect. An electronic device of the present disclosure includes a deformable substrate including a circuit. The circuit includes a channel extending from a first portion of the deformable substrate to a second portion of the deformable substrate. A first circuit component is adjacent to the first portion of the deformable substrate. A second circuit component is adjacent to the second portion of the deformable substrate. A first metal material is formed overlaying a first portion of the deformable substrate including a first portion of the channel. A second metal material interfaces with the first metal material, thereby substantially occupying an interior volume of the channel.
H05K 3/32 - Assembling printed circuits with electric components, e.g. with resistor electrically connecting electric components or wires to printed circuits
H05K 3/18 - Apparatus or processes for manufacturing printed circuits in which conductive material is applied to the insulating support in such a manner as to form the desired conductive pattern using precipitation techniques to apply the conductive material
61.
ADAPTIVE IMPEDANCE TUNING FOR CAPACITIVE INTERCONNECTS
The disclosed system may include a detachable capsule that includes a capsule-side capacitive plate. The system may also include a receiving antenna electrically connected to an antenna-side capacitive plate, and a capacitive sensor electrically connected to the capsule-side capacitive plate. The two plates may be coupled to each other and may transmit RF signals between them. The capacitive sensor may be configured to detect an amount of capacitance between the two capacitive plates. The system may also include an antenna matching tuner electrically connected to the capacitive sensor and to an antenna feed. Then, upon receiving capacitance measurements from the capacitive sensor, the antenna matching tuner may alter various parameters of the antenna feed including impedance matching parameters. Various other apparatuses and mobile wearable devices are also disclosed.
H01Q 1/27 - Adaptation for use in or on movable bodies
G01R 27/26 - Measuring inductance or capacitance; Measuring quality factor, e.g. by using the resonance method; Measuring loss factor; Measuring dielectric constants
G04G 21/04 - Input or output devices integrated in time-pieces using radio waves
H01Q 7/00 - Loop antennas with a substantially uniform current distribution around the loop and having a directional radiation pattern in a plane perpendicular to the plane of the loop
Aspects of the present disclosure are directed to creating virtual doors within artificial reality (XR) universes for traversal within that XR universe and between other XR universes. Users can create virtual doors that control access to their privately owned property (e.g., world, parcel, house, etc.) in an XR universe. For example, an owner of a virtual door can manually lock the door to prevent any user from entering their property through the virtual door. As another example, an owner of a virtual door can configure door permissions and/or privacy settings that serve as heuristics by which a door access control manager determines whether to authorize a particular user, XR world, and/or XR universe to access. The XR universe traversal system can control an execution environment to smoothly transition between different applications, thereby enabling a user to traverse between different XR universes without having to leave the XR environment.
A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.
Aspects of the present disclosure are directed to creating virtual doors within artificial reality (XR) universes for traversal within that XR universe and between other XR universes. Users can create virtual doors that control access to their privately owned property (e.g., world, parcel, house, etc.) in an XR universe. For example, an owner of a virtual door can manually lock the door to prevent any user from entering their property through the virtual door. As another example, an owner of a virtual door can configure door permissions and/or privacy settings that serve as heuristics by which a door access control manager determines whether to authorize a particular user, XR world, and/or XR universe to access. The XR universe traversal system can control an execution environment to smoothly transition between different applications, thereby enabling a user to traverse between different XR universes without having to leave the XR environment.
A method and system for text-to-video generation. The method includes receiving a text input, generating a representation frame based on the text input using a model trained on text-image pairs, generating a set of frames based on the representation frame and a first frame rate, interpolating the set of frames to a higher frame rate, generating a first video based on the interpolated set of frames, increasing a resolution of the first video based on a first and second super-resolution model, and generating an output video based on a result of the super-resolution models.
Methods, systems, and storage media for generating audio data includes receiving a text input. The method also includes receiving a plurality of representative audio sources and encoding the plurality of representative audio sources into a plurality of audio tokens. The method includes encoding the text input into a plurality of text representations. The method comprises mapping each audio tokens of the plurality of audio tokens to a text representation of the plurality of text representations. The method also comprises determining a relationship score based on mapping each audio tokens to the text representation, wherein the relationship score identifies a distribution of audio tokens from the plurality of audio tokens. The method and systems can also comprise decoding the subgroup of audio tokens to yield a reconstmcted audio source.
G10L 13/08 - Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
67.
Presenting Attention States Associated with Voice Commands for Assistant Systems
In one embodiment, a method includes rendering a first output image of an XR assistant avatar for displays of an extended reality (XR) display device, wherein the XR assistant avatar is interactable by a user to access an assistant system and has a first form indicating a first attention state, which indicates whether the XR assistant avatar is interactable via first voice commands for first functions enabled by the assistant system, detecting voice inputs from the user, determining a second attention state associated with the XR assistant avatar based on the voice inputs, and rendering a second output image of the XR assistant avatar for the displays of the XR display device, wherein the XR assistant avatar is morphed to have a second form indicating the second attention state, which indicates whether the XR assistant avatar is interactable via second voice commands for second functions enabled by the assistant system.
In one example, an apparatus for integrating sensing and display system includes a first semiconductor layer that includes an image sensor; a second semiconductor layer that includes a display; a third semiconductor layer that includes compute circuits configured to support an image sensing operation by the image sensor and a display operation by the display; and a semiconductor package that encloses the first, second, and third semiconductor layers, the semiconductor package further including a first opening to expose the image sensor and a second opening to expose the display. The first, second, and third semiconductor layers form a first stack structure along a first axis. The third semiconductor layer is sandwiched between the first semiconductor layer and the second semiconductor layer in the first stack structure.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06V 10/25 - Determination of region of interest [ROI] or a volume of interest [VOI]
G09G 3/32 - Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
H01L 23/00 - SEMICONDUCTOR DEVICES NOT COVERED BY CLASS - Details of semiconductor or other solid state devices
H01L 27/15 - Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components with at least one potential-jump barrier or surface barrier, specially adapted for light emission
H04N 5/232 - Devices for controlling television cameras, e.g. remote control
Aspects of the present disclosure are directed to systems for capturing, recording, and playing back steps for building objects and structures in an artificial reality (XR) world. A teacher or creator can initiate a capture context within a build mode of an XR application, during which steps (and potentially other metadata) of a building process are recorded and stored. A XR world building engine can generate an interactive replay of the recorded building process that allows another user to view the building process within an XR environment at the user's preferred pace and/or from different perspectives. In some implementations, the XR world building engine can generate a replay of the teacher's or creator's avatar performing the building process, such that the user can view the building process from a third person perspective and perform the same steps to learn how to build objects and structures in an XR world.
The disclosed device may include a lens stack. The lens stack may include a first gradient-index liquid crystal lens and a second gradient-index liquid crystal lens in tandem with the first gradient-index liquid crystal lens. The lens stack may be configured to reach a target optical power based on a first optical power of the first gradient-index liquid crystal lens and a second optical power of the second gradient-index liquid crystal lens. Various other devices, systems, and methods are also disclosed.
G02F 1/29 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
A device is provided. The device includes a waveguide configured to guide an image light to propagate from a light inputting surface to a light outputting surface. The waveguide includes a substrate having a back surface facing an eye-box region of the device and a front surface opposite to the back surface, a plurality of out-coupling structures disposed at the back surface or at least partially inside the substrate, and a medium layer embedded inside the substrate between the out-coupling structures and the front surface. The medium layer has a refractive index that is lower than the substrate. The device also includes an optical lens printed over the back surface of the substrate.
Methods, systems, and storage media for generating audio data includes receiving a text input. The method also includes receiving a plurality of representative audio sources and encoding the plurality of representative audio sources into a plurality of audio tokens. The method includes encoding the text input into a plurality of text representations. The method comprises mapping each audio tokens of the plurality of audio tokens to a text representation of the plurality of text representations. The method also comprises determining a relationship score based on mapping each audio tokens to the text representation, wherein the relationship score identifies a distribution of audio tokens from the plurality of audio tokens. The method and systems can also comprise decoding the subgroup of audio tokens to yield a reconstructed audio source.
G10L 19/018 - Audio watermarking, i.e. embedding inaudible data in the audio signal
G10L 19/02 - Speech or audio signal analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
An image-sensing system includes multiple sensing modules. Each of the multiple sensing modules includes multiple optical sensors arranged in an array. Each of the multiple sensors is configured to be switched on and off to generate analog sensing data. The image-sensing system also includes an analog-to-digital converter (ADC) shared by the multiple optical sensors configured to convert analog sensing data generated by the multiple optical sensors into digital data. The image-sensing system also includes a processor configured to control the multiple sensing modules.
In one embodiment, a method includes receiving, by a first client system, from one or more remote servers, a current version of a neural network model including multiple model parameters, training the neural network model on multiple examples retrieved from a local data store to generate multiple updated model parameters, wherein each of the examples includes one or more features and one or more labels, calculating a user valuation associated with the first client system, wherein the user valuation represents a measure of utility of training the neural network model on the multiple examples, and sending, to one or more of the remote servers, the trained neural network model and the user valuation, wherein the user valuation is associated with a likelihood of the first client system being selected for a subsequent training of the neural network model.
Many users access artificial reality (XR) experiences through their mobile phones. However, it is difficult to translate XR experiences to a two-dimensional (2D) screen in a way that feels intuitive and natural. Thus, the technology can map an interaction plane in a three-dimensional (3D) scene to the 2D screen with as many affordances as possible, even if the plane is not parallel to the mobile phone. The plane can be a fixed surface or a dynamically changeable surface through which the user sends inputs through the 2D screen. The mapping of the plane to the 2D screen can control interaction with a virtual object on the interaction plane in the XR environment, enabling parity between the same experience on XR and non-XR interfaces.
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/04842 - Selection of displayed objects or displayed text elements
G06F 3/04845 - Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
G06F 3/04886 - Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
The disclosed computer-implemented method may include coupling an array of reflective polarizers to a back surface of a back optical substrate; coupling an array of quarter-wave plates to a front surface of the back optical substrate such that the array of quarter-wave plates is aligned with the array of reflective polarizers; molding the back optical substrate with at least one initial mold, wherein the at least one initial mold defines an initial array of optical element surfaces that is aligned with the array of quarter-wave plates; and twin-sheet thermoforming, between a front twin-sheet mold and a back twin-sheet mold, the back optical substrate with a front optical substrate, wherein the front twin-sheet mold defines a front array of optical element surfaces and the back mold defines a back array of optical element surfaces. Various other methods, apparatuses, and systems are also disclosed.
A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.
A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.
An administered authentication system can authenticate an artificial reality device using an authorization record between a user account and an artificial reality device. In some implementations, the authorization record is created in response to activation of a user account-specific key sent to a user-supplied contact, where an artificial reality device identifier was provided with the user-supplied contact. In other implementations, the authorization record is created in response to activation of a user account-specific key provided to the artificial reality device as a code, where activation of the key includes adding an artificial reality device identifier to a key activation message. In yet other implementations, the authorization record is created in response to an application associated with a user account activating an artificial reality device-specific key, with an artificial reality device identifier, that is provided via the artificial reality device.
G06F 21/34 - User authentication involving the use of external additional devices, e.g. dongles or smart cards
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 21/33 - User authentication using certificates
G06F 21/36 - User authentication by graphic or iconic representation
G06F 21/40 - User authentication by quorum, i.e. whereby two or more security principals are required
G06T 19/00 - Manipulating 3D models or images for computer graphics
H04L 9/32 - Arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system
80.
MAPPING A REAL-WORLD ROOM FOR A SHARED ARTIFICIAL REALITY ENVIRONMENT
A room manager can generate mappings for a real-world room that support a shared XR environment. For example, the real-world room can include real-world objects and surfaces, such as a table(s), chair(s), wall(s), door(s), window(s), etc. The room manager can generate XR object definitions based on information received about the real-world room, object(s), and surface(s). For example, the room manager can implement a flow that guides a user equipped with an XR system to provide information for the XR object definitions, such as real-world surfaces that map to the XR object(s), borders (e.g., measured using a component of the XR system), such as borders on real-world surfaces, semantic information (e.g., number of seat assignments at an XR table, size of XR objects, etc.), and other suitable information. Implementations generate previews of the shared XR environment, such as a local preview and a remote preview.
Many users access artificial reality (XR) experiences through their mobile phones. However, it is difficult to translate XR experiences to a two-dimensional (2D) screen in a way that feels intuitive and natural. Thus, the technology can map an interaction plane in a three-dimensional (3D) scene to the 2D screen with as many affordances as possible, even if the plane is not parallel to the mobile phone. The plane can be a fixed surface or a dynamically changeable surface through which the user sends inputs through the 2D screen. The mapping of the plane to the 2D screen can control interaction with a virtual object on the interaction plane in the XR environment, enabling parity between the same experience on XR and non-XR interfaces.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0346 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
G06F 3/04815 - Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
Aspects of the present disclosure are directed to systems for capturing, recording, and playing back steps for building objects and structures in an artificial reality (XR) world. A teacher or creator can initiate a capture context within a build mode of an XR application, during which steps (and potentially other metadata) of a building process are recorded and stored. A XR world building engine can generate an interactive replay of the recorded building process that allows another user to view the building process within an XR environment at the user's preferred pace and/or from different perspectives. In some implementations, the XR world building engine can generate a replay of the teacher's or creator's avatar performing the building process, such that the user can view the building process from a third person perspective and perform the same steps to learn how to build objects and structures in an XR world.
In one embodiment, a method includes receiving a user request from a client system associated with a user, determining that the user request corresponds to a first suspended task, retrieving a first dialog state of the first suspended task from a dialog history associated with the user, generating a summary of the first suspended task based on the first dialog state using a natural-language generating (NLG) module, and sending instructions to the client system for providing the summary of the first suspended task to the user.
In some embodiments, a computer-implemented method includes capturing an image for each flash unit of an electronic device, each image being illuminated during the capturing of the image; obtaining a normalized image from one or more of the illuminated images; and using an illumination-based optimization framework to generate an enhanced three-dimensional (3D) depth image, the illumination-based optimization framework being based on the illuminated image. In some embodiments of the computer-implemented method, the illumination-based optimization framework incorporates the normalized image and 3D depth data associated with the captured image into the generation of the enhanced 3D depth image.
Aspects of the present disclosure are directed to streaming interactive content from a native application executing at an artificial reality (XR) device into an artificial reality environment and/or to nearby XR device(s). A shell environment at an XR system can manage the software components of the system. The shell environment can include a shell application and a three-dimensional shell XR environment displayed to a user. An additional application, natively executing at the XR system, can provide a host version of content and a remote version of content. A two-dimensional virtual object displayed in the shell XR environment can display the host version of the content, and the remote version of the content can be streamed to a remote XR system. The remote XR system can display the remote content within another two-dimensional virtual object, for example in another shell XR environment displayed by the remote XR system.
A system on a chip includes a first subsystem comprising a first memory; a second subsystem comprising a second memory; and an always-on subsystem. The always-on subsystem can comprise processing circuitry configured to: in response to a first activation event, signal the first subsystem to initiate repair operations on the first memory, and in response to a second activation event occurring after the first event, signal the second subsystem to initiate repair operations on the second memory.
Systems and methods for availability-based streaming may include (1) detecting that a user of a messaging service has selected a call-availability element provided within an instance of a messaging thread, generated for the user, that enables digital messaging between the user and a contact of the user, (2) signaling to the user's contact that the user is available for a call via the messaging thread by instructing a device of the contact to display a selectable prompt that indicates that the user is available for the call via the messaging thread, (3) detecting that the user's contact has selected the selectable prompt via the contact's device, and (4) instructing the contact's device to display a call-launch element configured to launch the call between the user and the user's contact via the messaging thread when selected via user input. Various other methods, systems, and computer-readable media are also disclosed.
H04L 51/043 - Real-time or near real-time messaging, e.g. instant messaging [IM] using or handling presence information
H04L 51/216 - Handling conversation history, e.g. grouping of messages in sessions or threads
H04M 1/72436 - User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
H04M 1/72469 - User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
H04M 3/42 - Systems providing special services or facilities to subscribers
A method may include determining an threshold user tolerance level associated with one or more sensitive content classifications. The method may include receiving a request to generate a first user account. The method may include receiving one or more instances of first user account data, wherein the one or more instances of first user account data include at least an indication of the first user's age. The method may include generating, based at least in part on the one or more instances of first user account data, the first user account. The method may include configuring, based at least in part on determining that the first user's age fails to satisfy a sensitive content age threshold, one or more first user account settings to restrict sensitive content at or above the threshold user tolerance level.
In one embodiment, a method includes accessing a speech signal corresponding to a source emotion, generating content units based on the speech signal, generating altered content units for the content units based on a target emotion, determining a respective duration for each of the altered content units based on the target emotion, generating a respective pitch curve for each of the altered content units based on the target emotion and the respective altered duration, and generating an altered speech signal corresponding to the target emotion based on the target emotion, speech characteristics associated with a speaker, the altered content units based on their respective altered durations, and the pitch curves for the altered content units.
G10L 25/63 - Speech or voice analysis techniques not restricted to a single one of groups specially adapted for particular use for comparison or discrimination for estimating an emotional state
G10L 15/22 - Procedures used during a speech recognition process, e.g. man-machine dialog
G10L 25/90 - Pitch determination of speech signals
90.
SYSTEMS AND METHODS FOR IMPROVING TRAINING OF ARTIFICIAL NEURAL NETWORKS
The disclosed computer-implemented method may include (1) selecting, for training of an artificial neural network (ANN), a training batch of points from within a dataset of training points, each training point comprising a plurality of sets of values, where each value corresponds to an index into an embedding space included in the ANN, (2) forming, from the dataset of training points, a neighborhood of training points associated with the training batch such that each member of the neighborhood shares at least one index with at least one training point included in the training batch, (3) choosing, via a cluster analysis method, a cluster of points from the neighborhood of training points associated with the training batch, and (4) training the ANN using the chosen cluster of points from the neighborhood of points associated with the training batch. Various other methods, systems, and computer-readable media are also disclosed.
The disclosed computer-implemented method may include systems and methods for generating a composited single media stream from multiple data streams of broadcasting computing devices. For example, systems and method described herein can receive audio-only streams and metadata from broadcasting computing device. The systems and methods described herein can further combine and transform the received audio-only streams into a single media stream. The systems and methods described herein may also synchronize and composite the metadata back into the single media stream, such that information from the broadcasting computing device may be passed all the way to listener computing devices when the composited single media stream is broadcasted to the listener computing devices. Various other methods, systems, and computer-readable media are also disclosed.
H04N 21/43 - Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronizing decoder's clock; Client middleware
In particular embodiments, a computing system may access a particular image frame and corresponding depth information of a dynamic scene. The depth information is used to generate a point cloud of the particular image frame. The system may generate a first latent representation based on the point cloud. The system may access a sequence of image frames of the dynamic scene and a set of key frames. The system may generate, using a temporal transformer, a second latent representation based on tracking and combining temporal relationship between the sequence of image frames and the set of key frames. The system may access camera parameters for rendering the one or more objects from a desired novel viewpoint and generate a third latent representation. The system may train an improved neural radiance fields (NeRF) based model for free-viewpoint rendering of the dynamic scene based on the first, second, and third latent representations.
A display engine includes an arrayed light source panel including a light source array of individually addressable light sources, each light source being configured to emit a first light beam associated with a first wavelength band. The display engine also includes a beam reshaping module including beam reshaping elements, each beam reshaping element being configured to reshape a first beam profile of the first light beam and output a second light beam with a second beam profile. The display engine also includes a transmissive display driver panel including a display driver module integrated with a pixelated color conversion module that includes a plurality of color conversion units configured to at least partially convert the second light beam into a third light beam associated with a second wavelength band. The display engine also includes an active light modulation medium configured to modulate the third light beam for displaying an image.
The disclosed apparatus may include a wearable haptic ring that features input capabilities relative to a computing system. In various examples, the wearable haptic ring may be designed to curve around a human finger of a wearer with a touchpad that is seamlessly integrated with the ring. For example, the seamlessly integrated touchpad may be operable by another finger of the wearer. Moreover, the haptic ring may include a haptic feedback unit designed to provide haptic feedback in response to input from the wearer. As such, the haptic ring may enable a wide range of user inputs while appearing like a typical ring rather than a computer input/output device. Various other implementations are also disclosed.
G06F 3/01 - Input arrangements or combined input and output arrangements for interaction between user and computer
G06F 3/0354 - Pointing devices displaced or positioned by the user; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
95.
HYBRID ELECTRICALLY AND THERMALLY SWITCHABLE SYSTEM USING HEAT SOURCE
An optical device includes a first optically dimmable switch for providing a first transmittance while the first optically dimmable switch is in a first state and providing a second transmittance distinct from the first transmittance while the first optically dimmable switch is in a second state distinct from the first state. The optical device also includes a dynamic heat source thermally coupled with the first optically dimmable switch. The dynamic heat source is at a first temperature at a first time and is at a second temperature distinct from the first temperature at a second time mutually exclusive from the first time. The optical device may operate as an optical dimming device, which may be used in head-mounted display devices or as dimmable windows or shutters.
G02F 1/13 - Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
H01H 61/02 - Electrothermal relays wherein the thermally-sensitive member is heated indirectly, e.g. resistively, inductively
96.
User Controlled Task Execution with Task Persistence for Assistant Systems
In one embodiment, a method includes receiving a first user request at a client system to suspend a first task being executed by an assistant system operating on the client system, suspending the execution of the first task responsive to the first user request, receiving a second user request at the client system, determining that the second user request is a request to resume the suspended first task based on user interactions with the assistant system with respect to one or more entities associated with the first task, and presenting a prompt to resume the first task at the client system.
G06V 10/764 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
G06V 10/82 - Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
H04L 51/212 - Monitoring or handling of messages using filtering or selective blocking
H04L 51/222 - Monitoring or handling of messages using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
H04L 51/224 - Monitoring or handling of messages providing notification on incoming messages, e.g. pushed notifications of received messages
H04L 51/52 - User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail for supporting social networking services
The disclosed computer-implemented method may include applying, via a sound reproduction system, sound cancellation that reduces an amplitude of various sound signals. The method further includes identifying, among the sound signals, an external sound whose amplitude is to be reduced by the sound cancellation. The method then includes analyzing the identified external sound to determine whether the identified external sound is to be made audible to a user and, upon determining that the external sound is to be made audible to the user, the method includes modifying the sound cancellation so that the identified external sound is made audible to the user. Various other methods, systems, and computer-readable media are also disclosed.
G10K 11/178 - Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
H04R 1/40 - Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
(1) Downloadable computer software for mobile devices and computers, all for the artificial production of human-like speech and text; Downloadable computer software for natural language processing, generation, and understanding; Downloadable computer software for machine-learning based language and speech processing software; Downloadable computer software for use in connection with language models; Downloadable software for using artificial intelligence for conversational query; Downloadable software for using artificial intelligence for speech or language recognition and translation; Downloadable software for using artificial intelligence for processing, generation, and understanding of natural language into machine-executable commands. (1) Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with the artificial production of human-like speech and text; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with natural language processing, generation, and understanding; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with machine-learning based language and speech processing software; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with language models; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for conversational query; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for speech or language recognition and translation; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for processing, generation, understanding of natural language into machine-executable commands.
42 - Scientific, technological and industrial services, research and design
Goods & Services
Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with the artificial production of human-like speech and text; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with natural language processing, generation, and understanding; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with machine-learning based language and speech processing software; Providing online non-downloadable software and software as a service (SaaS) services featuring software for use in connection with language models; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for conversational query; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for speech or language recognition and translation; Providing online non-downloadable software and software as a service (SaaS) services featuring software for using artificial intelligence for processing, generation, understanding of natural language into machine-executable commands
09 - Scientific and electric apparatus and instruments
Goods & Services
Downloadable computer software for mobile devices and computers, all for the artificial production of human-like speech and text; Downloadable computer software for natural language processing, generation, and understanding; Downloadable computer software for machine-learning based language and speech processing software; Downloadable computer software for use in connection with language models; Downloadable software for using artificial intelligence for conversational query; Downloadable software for using artificial intelligence for speech or language recognition and translation; Downloadable software for using artificial intelligence for processing, generation, and understanding of natural language into machine-executable commands.
