A method including: receiving colour images, depth images, and viewpoint information; dividing 3D space occupied by real-world environment into 3D grid(s) of voxels (204); creating 3D data structure(s) comprising nodes, each node representing corresponding voxel; dividing colour image and depth image into colour tiles and depth tiles, respectively; mapping colour tile to voxel(s) whose colour information is captured in colour tile, based on depth information captured in corresponding depth tile and viewpoint from which colour image and depth image are captured; and storing, in node representing voxel(s), reference information indicative of unique identification of colour tile that captures colour information of voxel(s) and corresponding depth tile that captures depth information, along with viewpoint information indicative of viewpoint from which colour image and depth image are captured.
A method including: receiving visible-light images captured using camera(s) and depth data corresponding to said images; identifying image segments of visible-light image that represent objects or their parts belonging to different material categories; detecting whether at least two adjacent image segments in visible-light image pertain to at least two different material categories related to same object category; and when it is detected that at least two adjacent image segments pertain to at least two different material categories related to same object category, identifying at least two adjacent depth segments of depth data corresponding to at least two adjacent image segments; and correcting errors in optical depths represented in at least one of at least two adjacent depth segments, based on optical depths represented in remaining of at least two adjacent depth segments.
G06T 7/593 - Récupération de la profondeur ou de la forme à partir de plusieurs images à partir d’images stéréo
G06V 10/22 - Prétraitement de l’image par la sélection d’une région spécifique contenant ou référençant une forme; Localisation ou traitement de régions spécifiques visant à guider la détection ou la reconnaissance
G06V 10/764 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant la classification, p.ex. des objets vidéo
3.
Tracking system and method incorporating selective control of light sources of controller
A tracking system for use in head-mounted device (HMD) includes light sources arranged spatially around user-interaction controller(s); controller-pose-tracking means arranged in user-interaction controller(s); HMD-pose-tracking means; camera(s) arranged on portion of HMD that faces real-world environment in which HMD is in use; and processor(s) configured to estimate relative pose, based on controller-pose-tracking data and HMD-pose-tracking data; determine sub-set of light sources, based on estimated relative pose and arrangement of light sources; selectively control light sources such that light sources of sub-set are activated, whereas remaining light sources are deactivated; process at least one image, captured by camera(s), to identify operational state of light source(s) of sub-set that is visible in image(s), wherein image(s) is indicative of actual relative pose; and correct estimated relative pose to determine actual relative pose, based on operational state.
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
H05B 47/125 - Commande de la source lumineuse en réponse à des paramètres détectés en détectant la présence ou le mouvement d'objets ou d'êtres vivants en utilisant des caméras
4.
Utilising focussing of light sources in image for controller tracking
A controller-tracking system includes: camera(s) arranged on head-mounted display (HMD); one or more light sources arranged on controller(s) to be tracked, and controller(s) being associated with the HMD. The light sources provide light having wavelength(s). The processor(s) are configured to receive image(s) representing controller(s); identify image segment(s) in image(s) that represents light source(s); determine level of focussing of light source(s) in image(s), based on characteristics associated with pixels of image segment(s); determine distance between camera(s) and light source(s), based on level of focussing, intrinsic parameters of camera(s), and reference focussing distance corresponding to wavelength of light provided by light source(s); and determine pose of controller(s) in global coordinate space of real-world environment, using distance between camera(s) and light source(s).
Disclosed is a headphone adapter (100, 204) having: first element (102) having first part (104) and second part (106) attached to first part, wherein recess (108) is defined between first part and second part; second element (110) having first end (112), second end (114) opposite to first end, and at least one third part (116) extending between first end and second end, wherein second element is rotatably attached to first element at first end; and third element (118) having fourth part (120) and attachment parts (122, 124) extending from fourth part, wherein fourth part is rotatably attached to second element at second end, and wherein headphone adapter, in use, enables attachment of a headphone device (216, 302) to a head-mounted device (208, 306) such that headband (206, 304) of head-mounted device passes through the recess defined in first element, and headband (214) of headphone device is attached to third element.
An imaging system including: a first camera and a second camera corresponding to a first eye and a second eye of a user, respectively; and processor(s) configured to: control the first camera and the second camera to capture a sequence of first images and a sequence of second images, respectively; and apply motion blur correction to one of a given first image and a given second image, whilst applying at least one of: defocus blur correction, image sharpening, contrast enhancement, edge enhancement to another of the given first image and the given second image.
An imaging system including a first camera and a second camera corresponding to a first eye and a second eye of a user, respectively; and at least one processor. The at least one processor is configured to control the first camera and the second camera to capture a sequence of first images and a sequence of second images of a real-world environment, respectively; and apply a first extended depth-of-field correction to one of a given first image and a given second image, whilst applying at least one of: defocus blur correction, image sharpening, contrast enhancement, edge enhancement to another of the given first image and the given second image.
An imaging system including processor(s) and data repository. Processor(s) are configured to: receive images of region of real-world environment that are captured by cameras using at least one of: different exposure times, different sensitivities, different apertures; receive depth maps of region that are generated by depth-mapping means; identify different portions of each image that represent objects located at different optical depths; create set of depth planes corresponding to each image; warp depth planes of each set to match perspective of new viewpoint corresponding to which output image is to be generated; fuse sets of warped depth planes corresponding to two or more images to form output set of warped depth planes; and generate output image from output set of warped depth planes.
A computer-implemented method including: receiving visible-light images captured from viewpoints using visible-light camera(s); creating 3D model of real-world environment, wherein 3D model stores colour information pertaining to 3D points on surfaces of real objects (204); dividing 3D points into groups of 3D points, based on at least one of: whether surface normal of 3D points in group lie within predefined threshold angle from each other, differences in materials of real objects, differences in textures of surfaces of real objects; for group of 3D points, determining at least two of visible-light images in which group of 3D points is captured from different viewpoints, wherein said images are representative of different surface irradiances of group of 3D points; and storing, in 3D model, information indicative of different surface irradiances.
An imaging system includes first camera having negative distortion; second camera, second field of view of second camera being wider than first field of view of first camera, wherein first field of view fully overlaps with portion of second field of view, second camera having negative distortion at said portion and positive distortion at remaining portion; and processor(s) configured to: capture first image and second image; determine overlapping image segment and non-overlapping image segment of second image; and generate output image from first image and second image, wherein: inner image segment of output image is generated from at least one of: first image, overlapping image segment, and peripheral image segment of output image is generated from non-overlapping image segment.
H04N 23/951 - Systèmes de photographie numérique, p. ex. systèmes d'imagerie par champ lumineux en utilisant plusieurs images pour influencer la résolution, la fréquence d'images ou le rapport de cadre
G06T 3/00 - Transformation géométrique de l'image dans le plan de l'image
An imaging system includes first camera; second camera, second field of view of second camera being wider than first field of view of first camera, wherein first field of view overlaps with portion of second field of view; and processor(s) configured to: capture first images and second images, wherein overlapping image segment and non-overlapping image segment of second image correspond to said portion and remaining portion of second field of view; determine blurred region(s) (B1, B2) of first image; and generate output image in manner that: inner image segment of output image is generated from: region(s) of overlapping image segment that corresponds to blurred region(s) of first image, and remaining region of first image that is not blurred, and peripheral image segment of output image is generated from non-overlapping image segment.
Disclosed is a system (100) comprising devices (102 a, 102 b, 200, 300, 304), each device comprising active illuminator, active sensor and processor, wherein processor (108 a) of device (102 a, 300) is configured to: project pattern of light onto surroundings (302), whilst detect reflections of pattern of light off onto surroundings; determine shapes of surfaces present in surroundings and distances of surfaces from pose of device; obtain pattern information indicative of other pattern(s) of light projected by other active illuminator(s) (104 b) of other device(s) (102 b, 304); detect reflections of other pattern(s) from pose of device; determine relative pose of other device(s) with respect to pose of device; and send, to server (110, 208), surface information indicative of shapes and distances of surfaces from pose of device, along with pose information indicative of relative pose of other device(s) with respect to pose of device.
G06T 7/73 - Détermination de la position ou de l'orientation des objets ou des caméras utilisant des procédés basés sur les caractéristiques
G06T 7/521 - Récupération de la profondeur ou de la forme à partir de la projection de lumière structurée
G06V 10/60 - Extraction de caractéristiques d’images ou de vidéos relative aux propriétés luminescentes, p.ex. utilisant un modèle de réflectance ou d’éclairage
G01B 11/25 - Dispositions pour la mesure caractérisées par l'utilisation de techniques optiques pour mesurer des contours ou des courbes en projetant un motif, p.ex. des franges de moiré, sur l'objet
Disclosed is a computer-implemented method comprising: tracking positions and orientations of devices (104, 106, 204a-204f, A-F, 402, 404) within real-world environment (300), each device comprising active sensor(s) (108, 110, 206a-206f); classifying devices into groups, based on positions and orientations of devices within real-world environment, wherein a group has devices whose active sensors are likely to interfere with each other; and controlling active sensors of devices in the group to operate by employing multiplexing.
Disclosed is a system (100, 200) comprising server (102, 202, 308) and data repository (104, 204, 310) storing three-dimensional (3D) environment model, wherein server is configured to: receive, from client device (106, 206, 300), first image(s) of real-world environment captured by camera(s) (108, 208, 302) of client device, along with information indicative of first measured pose of client device measured by pose-tracking means (110, 210, 304) of client device; utilise 3D environment model to generate first reconstructed image(s) from perspective of first measured pose; determine first spatial transformation indicative of difference in first measured pose and first actual pose of client device; calculate first actual pose, based on first measured pose and first spatial transformation; and send information indicative of at least one of: first actual pose, first spatial transformation, to client device for enabling client device to calculate subsequent actual poses.
An encoder for encoding images includes at least one processor configured transform a given input pixel of an input image having (x, y) coordinates in a Cartesian coordinate system into a given transformed pixel of a transformed image having (ρ, θ) coordinates in a log-polar coordinate system, using a log-polar transformation in which a radial distance (ρ) of the given transformed pixel is a logarithm of a distance of the given input pixel from an origin in the Cartesian coordinate system, and an angular distance (θ) of the given transformed pixel is a sum of an arctangent of a slope of a line connecting the given input pixel to the origin and a function of the radial distance, encode the transformed image, by employing a compression algorithm, into an encoded image, and send the encoded image to a display apparatus for subsequent decoding thereat.
H04N 19/60 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant un codage par transformée
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
H04N 19/167 - Position dans une image vidéo, p.ex. région d'intérêt [ROI]
A method implemented by a server communicably coupled to at least two devices, each device including camera(s), the devices being present within same real-world environment. The method includes: receiving, from the devices(s), images captured by respective cameras of the devices; identifying one of the devices whose camera has camera parameter(s) better than camera parameter(s) of camera of another of the devices; training neural network using images captured by camera of one of the devices as ground truth material and using images captured by camera of another of the devices as training material; generating correction information to correct images captured by camera of another of the devices using trained neural network; and correcting the images captured by the camera of the another of the device(s) by utilising the correction information at the server, or sending correction information to another of the devices for correcting the images.
H04N 5/12 - Dispositifs dans lesquels les signaux de synchronisation ne sont actifs que si une différence de phase se produit entre les dispositifs de synchronisation et les dispositifs de balayage synchronisés, p.ex. synchronisation à volants
G06T 7/521 - Récupération de la profondeur ou de la forme à partir de la projection de lumière structurée
G06T 7/80 - Analyse des images capturées pour déterminer les paramètres de caméra intrinsèques ou extrinsèques, c. à d. étalonnage de caméra
18.
SYSTEMS AND METHODS FOR VISUALLY INDICATING STALE CONTENT IN ENVIRONMENT MODEL
A system includes server(s) configured to: receive plurality of images of real-world environment captured by camera(s); process a number of images to detect plurality of objects present in a real-world environment and generate a three-dimensional environment model of the real-world environment; classify each of the objects as either a static or dynamic object; receive current image(s) of the real-world environment; process the current image(s) to detect object(s); determine whether or not the object(s) is/are from amongst the plurality of objects; determine whether the object(s) is a static object or dynamic object when it is determined that the object(s) is/are from amongst the plurality of objects; and for each dynamic object that is represented in the three-dimensional environment model but not in a current image(s), apply a first visual effect to a representation of the dynamic object in the three-dimensional environment model for indicating staleness of the representation.
G06T 19/20 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie Édition d'images tridimensionnelles [3D], p.ex. modification de formes ou de couleurs, alignement d'objets ou positionnements de parties
G06V 10/764 - Dispositions pour la reconnaissance ou la compréhension d’images ou de vidéos utilisant la reconnaissance de formes ou l’apprentissage automatique utilisant la classification, p.ex. des objets vidéo
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
G06T 17/00 - Modélisation tridimensionnelle [3D] pour infographie
Disclosed is a system (100) for implementing object-based camera calibration, the system comprising first camera (102) and processor(s) (104) configured to: detect occurrence of calibration event(s); obtain object information indicative of actual features of calibration objects;
Disclosed is a system (100) for implementing object-based camera calibration, the system comprising first camera (102) and processor(s) (104) configured to: detect occurrence of calibration event(s); obtain object information indicative of actual features of calibration objects;
capture image(s); detect features of at least portion of real-world object(s) represented in image(s) (200); identify calibration object(s) that match real-world object(s), based on comparison of detected features of at least portion of real-world object(s) with actual features of calibration objects; determine camera calibration parameters, based on differences between actual features of calibration object(s) and detected features of at least portion of real-world object(s); and correct distortion(s) in the image(s) and subsequent images captured by first camera using the camera calibration parameters.
An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; determine one of first camera and second camera having lesser occlusion in real-world scene; adjust optical focus of one of first camera and second camera to focus on one of first object and second object having greater optical depth, and adjust optical focus of another of first camera and second camera to focus on another of first object and second object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.
A computer-implemented method including: capturing visible-light images via visible-light camera(s) from view points in real-world environment, wherein 3D positions of view points are represented in coordinate system; dividing 3D space of real-world environment into 3D grid of convex-polyhedral regions; creating 3D data structure including nodes representing convex-polyhedral regions of 3D space; determining 3D positions of pixels of visible-light images based on 3D positions of view points; dividing each visible-light image into portions, wherein 3D positions of pixels of given portion of said visible-light image fall inside corresponding convex-polyhedral region; and storing, in each node, portions of visible-light images whose pixels' 3D positions fall inside corresponding convex-polyhedral region, wherein each portion of visible-light image is stored in corresponding node.
A display apparatus including: light source(s); gaze-tracking means; and processor(s) configured to: determine gaze directions of user's eyes; send, to rendering server, information indicative of gaze direction determined at first time instant; receive image frame(s) generated according to gaze, and being optionally timestamped with second time instant; display image frame(s) at third time instant; determine time lag between any one of: first time instant and third time instant, or second time instant and third time instant; detect whether or not time lag exceeds first predefined threshold; when time lag exceeds first predefined threshold, switch on gaze-lock mode; select forward line of vision as fixed gaze direction; send, to rendering server, information indicative of fixed gaze; and receive image frames generated according to fixed gaze; and display image frames.
A system for facilitating scalable shared rendering, including plurality of servers communicably coupled to each other, each server executing executable instance of rendering software, being communicably coupled to display apparatus(/es), wherein when executed, rendering software causes each server to receive information indicative of poses of users of display apparatus(/es), utilise three-dimensional model(/s) of extended-reality environment to generate images from poses, send images to respective display apparatus(/es) for display, wherein at least one of plurality of servers is configured to detect when total number of display apparatuses to be served exceeds predefined threshold number, and employ new server and execute new executable instance of rendering software when predefined threshold number is exceeded, wherein new display apparatuses are served by new server, thereby facilitating scalable shared rendering.
An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene of real-world environment; determine gaze directions of first eye and second eye; identify line of sight of user and conical region of interest real-world scene; determine optical depths of objects in conical region of interest, wherein at least first object, second object and third object from amongst objects are at different optical depths; adjust optical focus of one of first camera and second camera to focus on first object and second object in alternating manner, whilst adjusting optical focus of another of first camera and second camera to focus on third object; and capture images using adjusted optical focus of cameras.
H04N 13/239 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques utilisant deux capteurs d’images 2D dont la position relative est égale ou en correspondance à l’intervalle oculaire
H04N 13/383 - Suivi des spectateurs pour le suivi du regard, c. à d. avec détection de l’axe de vision des yeux du spectateur
H04N 13/246 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques Étalonnage des caméras
H04N 23/959 - Systèmes de photographie numérique, p. ex. systèmes d'imagerie par champ lumineux pour l'imagerie à grande profondeur de champ en ajustant la profondeur de champ pendant la capture de l'image, p. ex. en maximisant ou en réglant la portée en fonction des caractéristiques de la scène
A system including server(s) configured to: receive, from host device, visible-light images of real-world environment captured by visible-light camera(s); process visible-light images to generate three-dimensional (3D) environment model; receive, from client device, information indicative of pose of client device; utilise 3D environment model to generate reconstructed image(s) and reconstructed depth map(s); determine position of each pixel of reconstructed image(s); receive, from host device, current visible-light image(s); receive, from host device, information indicative of current pose of host device, or determine said current pose; determine, for pixel of reconstructed image(s), whether or not corresponding pixel exists in current visible-light image(s); replace initial pixel values of pixel in reconstructed image(s) with pixel values of corresponding pixel in current visible-light image(s), when corresponding pixel exists in current visible-light image(s); and send reconstructed image(s) to client device.
G06T 19/20 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie Édition d'images tridimensionnelles [3D], p.ex. modification de formes ou de couleurs, alignement d'objets ou positionnements de parties
G06T 17/00 - Modélisation tridimensionnelle [3D] pour infographie
G06T 7/50 - Récupération de la profondeur ou de la forme
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
G06F 3/0346 - Dispositifs de pointage déplacés ou positionnés par l'utilisateur; Leurs accessoires avec détection de l’orientation ou du mouvement libre du dispositif dans un espace en trois dimensions [3D], p.ex. souris 3D, dispositifs de pointage à six degrés de liberté [6-DOF] utilisant des capteurs gyroscopiques, accéléromètres ou d’inclinaiso
26.
Gaze-based non-regular subsampling of sensor pixels
An imaging system including: image sensor including pixels arranged on photo-sensitive surface; and processor configured to: obtain information indicative of gaze direction of user's eye; identify gaze position on photo-sensitive surface; determine first region and second region on photo-sensitive surface, wherein first region includes and surrounds gaze position, while second region surrounds first region; read out first pixel data from each pixel of first region; select set of pixels to be read out from second region based on predetermined sub-sampling pattern; read out second pixel data from pixels of selected set; generate, from second pixel data, pixel data of remaining pixels of second region; and process first pixel data, second pixel data, and generated pixel data to generate image frame(s).
H04N 25/75 - Circuits pour fournir, modifier ou traiter des signaux d'image provenant de la matrice de pixels
H04N 25/40 - Extraction de données de pixels provenant d'un capteur d'images en agissant sur les circuits de balayage, p.ex. en modifiant le nombre de pixels ayant été échantillonnés ou à échantillonner
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
An encoding method and a decoding method. The encoding method includes generating curved image by creating projection of visual scene onto inner surface of imaginary 3D geometric shape that is curved in at least one dimension; dividing curved image into input portion and plurality of input rings; encoding input portion and input rings into first planar image and second planar image, respectively, such that input portion is stored into first planar image, and input rings are packed into corresponding rows of second planar image; and communicating, to display apparatus, first and second planar images and information indicative of sizes of input portion and input rings.
A display apparatus including display, display driver, and processor configured to send input signal to display driver, first part and second part of input signal comprise first pixel data pertaining to portion of first image frame and second pixel data pertaining to second image frame, respectively, first part of input signal further comprises extra pixel data pertaining to second image frame. Display driver is configured to: re-scale pixels of first pixel data based on display resolution; update pixels of second pixel data based on extra pixel data; generate control signal based on re-scaled pixels and updated pixels; drive display using control signal to present visual scene, wherein re-scaled pixels surround updated pixels when displayed on display area.
G09G 3/20 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice
29.
Display apparatuses and methods for facilitating location-based virtual content
A display apparatus including: light source(s) per eye, first tracking means, and processor(s) configured to: process first tracking data, collected by first tracking means, to determine location of display apparatus in real-world environment; obtain software application(s) that is available for location of display apparatus along with metainformation indicative of location in real-world environment with which software application(s) is/are associated; determine relative location of display apparatus with respect to location with which software application(s) is/are associated; execute software application(s) to create and overlay virtual content on image(s) representing real-world environment, based on relative location of display apparatus with respect to location with which software application(s) is/are associated; and display image(s) via light source(s).
An imaging system including visible-light camera(s), pose-tracking means, and processor(s). The processor(s) is/are configured to: control visible-light camera(s) to capture visible-light image, whilst processing pose-tracking data to determine pose of camera(s); obtain three-dimensional model of real-world environment; create occlusion mask, using three-dimensional model; cull part of virtual object(s) to generate culled virtual object(s), wherein virtual object(s) is to be embedded at given position in visible-light image; detect whether width of culled part or remaining part of virtual object(s) is less than predefined percentage of total width of virtual object(s); if width of culled part is less than predefined percentage, determine new position and embed entirety of virtual object(s) at new position to generate extended-reality image; and if width of remaining part is less than predefined percentage, cull entirety of virtual object(s).
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G06T 7/536 - Récupération de la profondeur ou de la forme à partir des effets de perspective, p.ex. en utilisant des points de fuite
G06T 7/586 - Récupération de la profondeur ou de la forme à partir de plusieurs images à partir de plusieurs sources de lumière, p.ex. stéréophotométrie
An imaging apparatus including: an image sensor having a photo-sensitive surface; an optical device arranged on an optical path of light incidenting on the photo-sensitive surface, the optical device being electrically controllable to have a spatially variable focal length; and a processor configured to: generate and send a drive signal to the optical device to compensate for field curvature of optical device by adjusting focal lengths of different portions of the optical device to different extents, wherein a focal length of a first portion of the optical device is higher than a focal length of a second portion of the optical device surrounding the first portion; and control the image sensor to capture a distorted image of a real-world environment.
H04N 5/262 - Circuits de studio, p.ex. pour mélanger, commuter, changer le caractère de l'image, pour d'autres effets spéciaux
G02B 7/04 - Montures, moyens de réglage ou raccords étanches à la lumière pour éléments optiques pour lentilles avec mécanisme de mise au point ou pour faire varier le grossissement
G02B 26/08 - Dispositifs ou dispositions optiques pour la commande de la lumière utilisant des éléments optiques mobiles ou déformables pour commander la direction de la lumière
G02B 27/00 - Systèmes ou appareils optiques non prévus dans aucun des groupes ,
G02F 1/29 - Dispositifs ou dispositions pour la commande de l'intensité, de la couleur, de la phase, de la polarisation ou de la direction de la lumière arrivant d'une source lumineuse indépendante, p.ex. commutation, ouverture de porte ou modulation; Optique non linéaire pour la commande de la position ou de la direction des rayons lumineux, c. à d. déflexion
H04N 5/232 - Dispositifs pour la commande des caméras de télévision, p.ex. commande à distance
32.
TRACKING METHOD FOR IMAGE GENERATION, A COMPUTER PROGRAM PRODUCT AND A COMPUTER SYSTEM
The transmitted information from a gaze tracker camera to a control unit of a VR/AR system can be controlled by an image signal processor (ISP) for use with a camera arranged to provide a stream of images of a moving part of an object in a VR or AR system to a gaze tracking function of the VR or AR system, the image signal processor being arranged to receive a signal from the gaze tracking function indicating at least one desired property of the images and to provide the stream of images to the gaze tracking function according to the signal. The ISP may be arranged to provide the image as either a full view of the image with reduced resolution or a limited part of the image with a second resolution which is high enough to enable detailed tracking of the object.
A method of transmitting image data in an image display system, includes dividing the image data into framebuffers, and for each framebuffer: dividing the framebuffer into a number of vertical stripes, each stripe including one or more scanlines, dividing each vertical stripe into at least a first and a second block, each of the first and the second block comprising pixel data to be displayed in an area of the image, and storing first pixel data in the first block with a first resolution and second pixel data in the second block having a second resolution which is lower than the first resolution, transmitting the framebuffer over the digital display interface to a decoder unit, and unpacking the framebuffer, including upscaling the pixel data in the second block to compensate for the lower second resolution and optionally upscaling the pixel data in the first block.
H04N 19/59 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le codage prédictif mettant en œuvre un sous-échantillonnage spatial ou une interpolation spatiale, p.ex. modification de la taille de l’image ou de la résolution
H04N 19/172 - Procédés ou dispositions pour le codage, le décodage, la compression ou la décompression de signaux vidéo numériques utilisant le codage adaptatif caractérisés par l’unité de codage, c. à d. la partie structurelle ou sémantique du signal vidéo étant l’objet ou le sujet du codage adaptatif l’unité étant une zone de l'image, p.ex. un objet la zone étant une image, une trame ou un champ
G06T 3/40 - Changement d'échelle d'une image entière ou d'une partie d'image
H04N 21/44 - Traitement de flux élémentaires vidéo, p.ex. raccordement d'un clip vidéo récupéré d'un stockage local avec un flux vidéo en entrée ou rendu de scènes selon des graphes de scène MPEG-4
H04N 21/4402 - Traitement de flux élémentaires vidéo, p.ex. raccordement d'un clip vidéo récupéré d'un stockage local avec un flux vidéo en entrée ou rendu de scènes selon des graphes de scène MPEG-4 impliquant des opérations de reformatage de signaux vidéo pour la redistribution domestique, le stockage ou l'affichage en temps réel
34.
Imaging systems and methods for facilitating local lighting
An imaging system including visible-light camera(s), depth sensor(s), pose-tracking means, and server(s) configured to: control visible-light camera(s) and depth sensor(s) to capture visible-light images and depth images of real-world environment, respectively, whilst processing pose-tracking data to determine poses of visible-light camera(s) and depth sensor(s); reconstruct three-dimensional lighting model of real-world environment representative of lighting in different regions of real-world environment; receive, from client application, request message comprising information indicative of location in real-world environment where virtual object(s) is to be placed; utilise three-dimensional lighting model to create sample lighting data for said location, wherein sample lighting data is representative of lighting at given location in real-world environment; and provide client application with sample lighting data.
H04N 13/254 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques en combinaison avec des sources de rayonnement électromagnétique pour l’éclairage du sujet
An imaging system including: first camera and second camera; depth-mapping means; gaze-tracking means; and processor configured to: generate depth map of real-world scene; determine gaze directions of first eye and second eye; identify line of sight and conical region of interest; determine optical depths of first object and second object present in conical region; when first and second objects are placed horizontally opposite, adjust optical focuses of first and second cameras to focus on respective objects on same side as them; when first and second objects are placed vertically opposite, adjust optical focus of one camera corresponding to dominant eye to focus on object having greater optical depth, and adjust optical focus of another camera to focus on another object; and capture first image(s) and second image(s) using adjusted optical focuses of cameras.
A tracking method for tracking a target in a VR/AR system having a tracker function for determining the position of the target, includes obtaining a stream of images of the target, placing two or more markers in determined positions on the target in the image said markers being arranged to follow the movement of the determined positions, detecting the movement of the markers between two images in the stream of images, if the detected movement is within a set of consistency criteria, determining the position of the target based on the detected movement, and if the detected movement is outside the set of consistency criteria, activating the tracker function. This reduces the computation power required for tracking.
A display apparatus comprising: first light source(s) per eye, scanning mirror(s) per eye, pattern converting element per eye, and processor(s) configured to control first light source(s) to emit a light beam, whilst controlling scanning mirror(s) to draw subframe(s) of first image frame over pattern converting element, wherein subframe(s), when drawn, comprises plurality of light spots arranged in first pattern, wherein pattern converting element is employed to direct light beam incident thereon towards target surface, whilst converting first pattern of plurality of light spots into second pattern, thereby producing on target surface output image having spatially-variable resolution.
G09G 5/38 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par l'affichage de dessins graphiques individuels en utilisant une mémoire à mappage binaire avec des moyens pour commander la position de l'affichage
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G02B 26/08 - Dispositifs ou dispositions optiques pour la commande de la lumière utilisant des éléments optiques mobiles ou déformables pour commander la direction de la lumière
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
38.
Systems and methods employing multiple graphics processing units for producing images
A system for producing image frames for display at display device. The system includes graphics processing units including first graphics processing unit and second graphics processing unit that are communicably coupled to each other and pose-tracking means. Second graphics processing unit is configured to: process pose-tracking data, to determine device pose and velocity and/or acceleration with which device pose is changing; execute rendering application(s) to generate framebuffer data corresponding to image frame; and send, to first graphics processing unit, framebuffer data and information indicative of device pose and velocity and/or acceleration. First graphics processing unit is configured to: execute first compositing application to post-process framebuffer data, based at least on said information; and drive light source(s) using post-processed framebuffer data to display image frame.
An AR system is arranged to display an image stream of an environment with one or more virtual objects, each virtual object being associated with a marker in the image stream. The AR system includes a tracking subsystem arranged to track a first pose of the marker in the image, and inform a frame rendering subsystem, which generates a rendering of the VR object and provides the rendering to the reprojecting subsystem together with information about the first pose of the marker and information identifying a set of pixels included in the VR image. The tracking subsystem further determines a second pose of the marker based on detected movement and informs the reprojecting subsystem about the second pose. The reprojecting subsystem renders an image frame including the image stream of the environment with the rendering of the VR object reprojected in dependence of the second pose.
A system including: image sensor including pixels arranged on photo-sensitive surface thereof; and image signal processor configured to: receive, from image sensor, image signals captured by corresponding pixels; and process image signals to generate at least one image. When processing, image signal processor is configured to: determine at least one region within photo-sensitive surface that corresponds to image segment of at least one image over which blend object is to be superimposed; and selectively perform sequence of image signal processes on given image signal and control plurality of parameters employed therefor, based on whether a given pixel that is employed to capture given image signal lies in at least one region or remaining region within photo-sensitive surface.
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G06T 5/50 - Amélioration ou restauration d'image en utilisant plusieurs images, p.ex. moyenne, soustraction
A system including image sensor(s) including a plurality of pixels arranged on a photo-sensitive surface thereof; and image signal processor(s) configured to: receive, from image sensor(s), a plurality of image signals captured by corresponding pixels of image sensor(s); and process the plurality of image signals to generate at least one image, wherein, when processing, image signal processor(s) is configured to: determine, for a given image signal to be processed, a position of a given pixel on the photo-sensitive surface that is employed to capture the given image signal; and selectively perform a sequence of image signal processes on the given image signal and control a plurality of parameters employed for performing the sequence of image signal processes, based on the position of the given pixel.
A display apparatus including: light source(s); camera(s); and processor(s) configured to: display extended-reality image for presentation to user, whilst capturing eye image(s) of user's eyes; analyse eye image(s) to detect eye features; employ existing calibration model to determine gaze directions of user's eyes; determine gaze location of user; identify three-dimensional bounding box at gaze location within extended-reality environment, based on position and optical depth of gaze location; identify inlying pixels of extended-reality image lying within three-dimensional bounding box, based on optical depths of pixels in extended-reality image; compute probability of user focussing on given inlying pixel and generate probability distribution of probabilities computed for inlying pixels; identify at least one inlying pixel calibration target, based on probability distribution; and map position of calibration target to eye features, to update existing calibration model to generate new calibration model.
Disocclusion in a VR/AR system may be handled by obtaining depth and color data for the disoccluded area from a 3D model of the imaged environment. The data may be obtained by raytracing and included in the image stream by the reprojecting subsystem.
An imaging system for correcting visual artifacts during production of extended-reality images for display apparatus. The imaging system includes at least first camera and second camera for capturing first image and second image of real-world environment, respectively; and processor(s) configured to: analyse first and second images to identify visual artifact(s) and determine image segment of one of first image and second image that corresponds to visual artifact(s); generate image data for image segment, based on at least one of: information pertaining to virtual object, other image segment(s) neighbouring image segment, corresponding image segment in other of first image and second image, previous extended-reality image(s), photogrammetric model of real-world environment; and process one of first image and second image, based on image data, to produce extended-reality image for display apparatus.
An imaging system including: first camera; N second cameras, optical axes of first and second cameras being arranged at an angle; and processor(s) configured to: control first camera and N second cameras to capture first image and N second images, second field of view (FOV) is narrower than first FOV and overlaps with portion of first FOV; determine first overlapping portions (P, P′, A, A′, A″), second overlapping portion(s) (Q, B, B′, B″), and third overlapping portion (C) of first image; for given overlapping portion of first image, determine corresponding overlapping portion of at least one of N second images; and process corresponding overlapping portions of first and second images to generate corresponding portion of output image.
A display apparatus including first and second light sources, gaze-tracking means, and processor(s) configured to: process gaze-tracking data to determine gaze direction; identify gaze region; determine first and second portions of gaze region; send, to rendering server, resolution information indicative of at least one of: gaze direction, gaze region, first and second portions of gaze region, different required resolutions of at least two input images; receive said input images comprising first input image(s) and second input image(s), from rendering server; process first input image(s) to generate first region of first output image and second region of second output image; process second input image(s) to generate remaining regions of first and second output images; and display first and second output images via first and second light sources.
A gaze-tracking system for use in head-mounted display apparatus. The gaze-tracking system includes: illuminators; camera; and processor configured to: illuminate illuminators in sequential manner; control camera to capture eye images of user's eye during illumination of illuminators; identify reflection(s) of illuminator in eye image; determine extent of deformation in shape of reflection(s) with respect to shape of illuminator; determine extent of displacement in position of reflection(s) with respect to position of illuminator; compute user-specific score for illuminator based on extents of deformation and displacement; select illuminator(s) based on user-specific scores; illuminate illuminator(s); control camera to capture eye image of user's eye during illumination of illuminator(s); and detect gaze direction of user based upon relative position of pupil of user's eye with respect to reflections of illuminator(s) in eye image.
An optical device. The optical device includes a fibre optic plate having an input surface and an output surface, the fibre optic plate including a plurality of optical fibres; and a colour filter array including a plurality of colour filters formed on at least one of: the input surface, the output surface of the fibre optic plate.
An encoder for encoding images. The encoder includes processor. The processor is configured to: receive, from display apparatus, information indicative of at least one of: head pose of user, gaze direction of user; identify gaze location in input image, based on the at least one of: head pose, gaze direction; divide input image into first input portion and second input portion, wherein first input portion includes and surrounds gaze location; and encode first input portion and second input portion at first compression ratio and at least one second compression ratio to generate first encoded portion and second encoded portion, respectively, wherein at least one second compression ratio is larger than first compression ratio.
A display apparatus including means for tracking pose of user's head, light source(s) and processor configured to: process pose-tracking data to determine position, orientation, velocity and acceleration of head; predict viewpoint and view direction of user in extended-reality environment; determine region of extended-reality environment to be presented, based on viewpoint and view direction; determine sub-region(s) of region whose rendering information is to be derived from previous rendering information of corresponding sub-region(s) of previously-presented region of extended-reality environment; generate rendering information of sub-region(s) based on previous rendering information; send, to rendering server, information indicating remaining sub-regions required to be re-rendered and pose information indicating viewpoint and view direction; receive, from rendering server, rendering information of remaining sub-regions; merge rendering information of sub-region(s) and rendering information of remaining sub-regions to generate image(s); and display image(s) via light source(s).
H04N 13/344 - Affichage pour le visionnement à l’aide de lunettes spéciales ou de visiocasques avec des visiocasques portant des affichages gauche et droit
H04N 13/111 - Transformation de signaux d’images correspondant à des points de vue virtuels, p.ex. interpolation spatiale de l’image
H04L 67/131 - Protocoles pour jeux, simulations en réseau ou réalité virtuelle
H04L 67/12 - Protocoles spécialement adaptés aux environnements propriétaires ou de mise en réseau pour un usage spécial, p.ex. les réseaux médicaux, les réseaux de capteurs, les réseaux dans les véhicules ou les réseaux de mesure à distance
51.
Display apparatuses and methods incorporating image masking
A display apparatus including light source(s), camera(s), head-tracking means, and processor configured to: obtain three-dimensional model of real-world environment; control camera(s) to capture given image of real-world environment, whilst processing head-tracking data obtained from head-tracking means to determine pose of users head with respect to which given image is captured; determine region of three-dimensional model that corresponds to said pose of users head; compare plurality of features extracted from region of three-dimensional model with plurality of features extracted from given image, to detect object(s) present in real-world environment; employ environment map of extended-reality environment to generate intermediate extended-reality image based on pose of users head; embed object(s) in intermediate extended-reality image to generate extended-reality image; and display extended-reality image via light source(s).
A peripheral display apparatus that is wearable by a user. The peripheral display apparatus includes at least two light sources and at least one processor coupled to at least two light sources. The at least two light sources include a first light source and a second light source arranged at a first peripheral portion and a second peripheral portion of a field of view of user, respectively, first peripheral portion and second peripheral portion being positioned at opposite horizontal ends of field of view. The at least one processor or at least one external processor communicably coupled to at least one processor is configured to generate at least two images including a first image and a second image, wherein at least one processor is configured to display first image and second image simultaneously at first light source and second light source, respectively.
G06F 3/14 - Sortie numérique vers un dispositif de visualisation
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
G06F 1/16 - TRAITEMENT ÉLECTRIQUE DE DONNÉES NUMÉRIQUES - Détails non couverts par les groupes et - Détails ou dispositions de structure
H04N 5/247 - Disposition des caméras de télévision
53.
Display apparatus and method incorporating per-pixel shifting
A display apparatus including: image renderer having array of pixels; liquid-crystal device comprising: liquid-crystal structure, wherein portions of liquid-crystal structure are arranged in front of corresponding pixels of said array; and control circuit including circuit elements employed to electrically control corresponding portions of liquid-crystal structure to shift light emanating from corresponding pixels to corresponding target positions; and processor(s) configured to: generate individual drive signals for circuit elements, based on corresponding target positions to which light emanating from corresponding pixels are to be shifted upon passing through corresponding portions of liquid-crystal structure; and send individual drive signals to control circuit to drive circuit elements to address corresponding portions of liquid-crystal structure separately, whilst displaying output image frame via image renderer.
G09G 3/36 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice en commandant la lumière provenant d'une source indépendante utilisant des cristaux liquides
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
54.
Display apparatus and method incorporating gaze-dependent display control
A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.
A display system including: display apparatus; display-apparatus-tracking means; input device; processor. The processor is configured to: detect input event and identify actionable area of input device; process display-apparatus-tracking data to determine pose of display apparatus in global coordinate space; process first image to identify input device and determine relative pose thereof with respect to display apparatus; determine pose of input device and actionable area in global coordinate space; process second image to identify user's hand and determine relative pose thereof with respect to display apparatus; determine pose of hand in global coordinate space; adjust poses of input device and actionable area and pose of hand such that adjusted poses align with each other; process first image, to generate extended-reality image in which virtual representation of hand is superimposed over virtual representation of actionable area; and render extended-reality image.
A system for producing extended-reality images for a display apparatus. The system includes camera(s) and processor communicably coupled to camera(s), wherein processor is configured to: control camera(s) to capture image(s) representing test object present in real-world environment, wherein test object is physically covered three-dimensionally with coded pattern; obtain information pertaining to three-dimensional geometry of coded pattern; analyze image(s) to identify first image segment representing part of coded pattern visible in image(s); determine virtual content to be presented for test object, based on said part of coded pattern; process image(s) to generate extended-reality image(s) in which virtual content is virtually superimposed over said part of the coded pattern, based on information pertaining to three-dimensional geometry of coded pattern.
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
G06T 19/20 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie Édition d'images tridimensionnelles [3D], p.ex. modification de formes ou de couleurs, alignement d'objets ou positionnements de parties
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
An imaging system and a method for producing extended-reality images for a display apparatus. The imaging system includes camera and processor. The processor is configured to: control camera to capture image of real-world environment; analyse captured image to identify first image segment representing input device and to determine location of at least one actionable area of input device in first image segment; determine at least one functional element to be presented for the actionable area, the functional element being indicative of at least one of: functionality of the at least one actionable area, status of the at least one actionable area; and process captured image to generate extended-reality image in which the functional element is virtually superimposed over the actionable area of input device or a virtual representation of the actionable area of input device.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G06T 7/73 - Détermination de la position ou de l'orientation des objets ou des caméras utilisant des procédés basés sur les caractéristiques
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
An imaging system for producing extended-reality images for a display apparatus. The imaging system including camera that is employed to capture input image representing captured region of real-world environment; and processor configured to: generate intermediate image by correcting spatial distortion of input image; determine capturing region of intermediate image representing captured region of real-world environment and non-capturing regions of intermediate image corresponding to non-captured regions of real-world environment; generate image data for non-capturing region of intermediate image, based on at least one of: information pertaining to virtual object that is to be virtually superimposed, capturing region neighbouring non-capturing region, previous extended-reality image, photogrammetric model of real-world environment; and process intermediate image, based on generated image data, to produce extended-reality image to be presented at display apparatus.
An adjustment mechanism for allowing a user to adjust a length of a headband includes a stationary case, a clutch, and a knob. The stationary case defines an opening and a circular recess. The clutch includes a cam arranged within the circular recess and a pinion extending axially from the cam such that the pinion is positioned outside the case via the opening to engage with the headband. The clutch also includes a roller located adjacent to a first cam portion of the cam. The knob has an actuating element arranged between the roller and a tab of the cam. The knob is rotatable in a first direction for allowing the user to shorten the length of the headband. The knob is rotatable in a second direction allowing the user to increase the length of the headband.
communicating, to a display apparatus, the first image, the second image and information indicative of a size of the first input portion and sizes of the plurality of input rings.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
A display apparatus including pose-tracking means; image renderer per eye; liquid-crystal device including liquid-crystal structure and control circuit; and processor. Processor is configured to: process pose-tracking data to determine user's head pose; detect if rate at which head pose is changing is below predefined threshold rate; if yes, switch on lock mode, select head pose for session of lock mode, and generate output image frames according to head pose during session; if no, generate output image frames according to corresponding head poses of user using pose-tracking data; and display output image frames, whilst shifting light emanating to from pixels of image renderer to multiple positions (P1-P9) in sequential and repeated manner, said shifting causes resolution of output image frames to appear higher than display resolution of image renderer.
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G09G 5/02 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par la manière dont la couleur est visualisée
G02B 27/00 - Systèmes ou appareils optiques non prévus dans aucun des groupes ,
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
In a display apparatus, a liquid-crystal structure, arranged in front of an image renderer, is controlled to shift light of a given sub-pixel to target positions according to a shifting sequence in a repeated manner, while output image frames are displayed. To generate a given output image frame, a given target position to which the light is to be shifted is determined based on the shifting sequence. An input colour value of the given sub-pixel provided in a given input image frame is then adjusted to generate an output colour value of the given sub-pixel for the given output image frame, based on an output colour value of at least one other sub-pixel whose light overlaps with the given target position during display of a previous output image frame, and a retention coefficient between a colour of the at least one other sub-pixel and a colour of the given sub-pixel.
G09G 5/02 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par la manière dont la couleur est visualisée
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G09G 3/36 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice en commandant la lumière provenant d'une source indépendante utilisant des cristaux liquides
63.
Display apparatus and method incorporating gaze-based modulation of pixel values
A display apparatus including gaze-tracking means, image renderers, liquid-crystal devices including liquid-crystal structure and control circuit, to shift light emanating from given pixel of image renderer to multiple positions, given pixel including colour component; and processor configured to: process gaze-tracking data to determine gaze direction of user's eye; determine gaze point; display first output image frame; detect if magnitude of difference between first output value and initial second output value of colour component of given pixel in first and second output image frames exceeds first threshold difference; when detected that magnitude of difference exceeds first threshold difference, update initial second output value to sum of first output value and product of distance factor and difference between initial second output and first output values; and display second output image frame.
G09G 5/02 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par la manière dont la couleur est visualisée
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G09G 3/36 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice en commandant la lumière provenant d'une source indépendante utilisant des cristaux liquides
64.
LED-based display apparatus and method incorporating sub-pixel shifting
A display apparatus including: image renderer including light-emitting diodes that are to be employed as sub-pixels of image renderer; liquid-crystal device including liquid-crystal structure and control circuit, wherein liquid-crystal structure is arranged in front of light-emitting diodes of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from light-emitting diode to target positions on image plane according to shifting sequence in repeated manner; and processor(s) configured to render output sequence of output image frames via image renderer, wherein shift in light emanating from light-emitting diode to target positions causes resolution of output image frames to appear higher than display resolution of image renderer.
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G09G 5/02 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par la manière dont la couleur est visualisée
G09G 3/32 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice utilisant des sources lumineuses commandées utilisant des panneaux électroluminescents semi-conducteurs, p.ex. utilisant des diodes électroluminescentes [LED]
G09G 3/36 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice en commandant la lumière provenant d'une source indépendante utilisant des cristaux liquides
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
65.
Imaging system and method for producing images using means for adjusting optical focus
An imaging system for producing images for display apparatus. Imaging system includes at least one imaging unit arranged to face real-world scene including camera, optical element including first optical portion and second optical portion having different focal lengths, first focal length of first optical portion is smaller than second focal length of second optical portion, and means for adjusting optical focus; and processor. Processor is configured to obtain gaze direction of user; determine region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
H04N 5/262 - Circuits de studio, p.ex. pour mélanger, commuter, changer le caractère de l'image, pour d'autres effets spéciaux
H04N 5/232 - Dispositifs pour la commande des caméras de télévision, p.ex. commande à distance
G02B 27/00 - Systèmes ou appareils optiques non prévus dans aucun des groupes ,
G02B 7/09 - Montures, moyens de réglage ou raccords étanches à la lumière pour éléments optiques pour lentilles avec mécanisme de mise au point ou pour faire varier le grossissement adaptés pour la mise au point automatique ou pour faire varier le grossissement de façon automatique
G03B 13/36 - Systèmes de mise au point automatique
G03B 30/00 - Modules photographiques comprenant des objectifs et des unités d'imagerie intégrés, spécialement adaptés pour être intégrés dans d'autres dispositifs, p.ex. des téléphones mobiles ou des véhicules
66.
Display apparatus and method of compensating for visual artifacts
A display apparatus including first display or projector for displaying first images for first eye; second display or projector for displaying second images for second eye; first portion and second portion arranged to face first and second eyes; means for tracking poses of first and second eyes relative to first and second optical axes, respectively; and processor. Processor or external processor is configured to: obtain given pose of given eye relative to given optical axis; generate information pertaining to given visual artifact that is formed over given image at image plane when given image is displayed; determine artifact-superposing portion of given image; and process given image based on generated information and artifact-superposing portion, to generate given artifact-compensated image. Processor displays given artifact-compensated image via given display or projector.
A system for facilitating shared rendering between display devices including first display device and second display device that are communicably coupled with first computing device and second computing device, respectively. The system includes means for tracking pose of first display device, means for tracking pose of second display device, image server, first client, second client. First client is configured to: send, to image server, first information indicative of pose of first display device; receive first image frame; render first image frame at first display device; receive second information indicative of pose of second display device; send, to image server, second information; receive second image frame; and send second image frame, wherein second client renders second image frame at second display device.
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G06F 3/14 - Sortie numérique vers un dispositif de visualisation
G06T 7/73 - Détermination de la position ou de l'orientation des objets ou des caméras utilisant des procédés basés sur les caractéristiques
68.
Encoder and encoding method for mitigating discrepancies in reconstructed images
An encoder including data processing arrangement configured to analyze depth information pertaining to input image to identify depth edge(s) and to determine location of depth edge(s); analyze input image to identify edges of objects and to determine locations of said edges; select, amongst edges in input image, matching edge(s) whose location matches with location of depth edge(s); obtain intermediate decoded image by decoding intermediate encoded image obtained from intermediate encoding of input image; analyze intermediate decoded image to identify edges of objects and to determine locations of said edges; determine edge(s) in intermediate decoded image that corresponds to matching edge(s); modify pixel values in input image and/or optical depths in depth information, based on difference in location of determined edge(s) in intermediate decoded image and location of matching edge(s); and encode input image and depth information, upon said modification, to generate encoded data.
A display apparatus including an image renderer per eye; a liquid-crystal device including a liquid-crystal structure and a control circuit, the liquid-crystal structure being arranged in front of image-rendering surface of image renderer, wherein liquid-crystal structure is to be electrically controlled, via control circuit, to shift light emanating from a given pixel of the image renderer to a plurality of positions in a sequential and repeated manner; and at least one processor configured to render a sequence of output image frames via the image renderer, wherein a shift in the light emanating from the given pixel of the image renderer to the plurality of positions causes a resolution of the output image frames to appear higher than a display resolution of the image renderer.
G09G 5/02 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation caractérisés par la manière dont la couleur est visualisée
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G09G 3/36 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques pour la présentation d'un ensemble de plusieurs caractères, p.ex. d'une page, en composant l'ensemble par combinaison d'éléments individuels disposés en matrice en commandant la lumière provenant d'une source indépendante utilisant des cristaux liquides
G02F 1/1333 - Dispositions relatives à la structure
G02F 1/1347 - Disposition de couches ou de cellules à cristaux liquides dans lesquelles un faisceau lumineux est modifié par l'addition des effets de plusieurs couches ou cellules
70.
Imaging system and method using projection apparatus
A projection apparatus including an array of infrared emitters, the infrared emitters of said array being arranged in a first pattern; a plurality of liquid-crystal cells and corresponding control circuits, a given liquid-crystal cell being arranged in front of a corresponding infrared emitter of said array; and a processor configured to generate drive signals for driving the control circuits in a random or pseudorandom manner; and control the plurality of liquid-crystal cells individually, via the corresponding control circuits, to project a second pattern of light spots onto objects present in a real-world environment, wherein, when driven by a given drive signal, a given control circuit electrically controls a corresponding liquid-crystal cell to any of: block light emanating from a corresponding infrared emitter, transmit the light in an unbended manner, bend the light.
G02F 1/1333 - Dispositions relatives à la structure
G02F 1/135 - Cellules à cristaux liquides associées structurellement avec une couche photoconductrice ou ferro-électrique dont les caractéristiques peuvent être optiquement ou électriquement modifiées
G02F 1/1335 - Association structurelle de cellules avec des dispositifs optiques, p.ex. des polariseurs ou des réflecteurs
71.
Display apparatus and method of correcting image distortion therefor
A display apparatus including first and second displays or projectors that display first and second images for first and second eyes, respectively; first and second portions facing first and second eyes, respectively, first and second portions having first (F-F′) and second (S-S′) optical axes, respectively; means for tracking positions and orientations of first and second eyes relative to corresponding optical axes, respectively; and processor. The processor or external processor obtains current relative positions and orientations of both eyes; determines first and second transformations for first and second input image frames, respectively, given transformation being applied to correct apparent per-pixel distortions produced when given input image frame is displayed; and applies first and second transformations to generate first and second distortion-corrected image frames, respectively, wherein processor renders first and second distortion-corrected image frames.
A system for producing images for a display apparatus. The system includes image source(s) and processor. The processor is configured to obtain information indicative of angular size of field of view providable by image renderer of display apparatus; obtain information indicative of gaze direction of user; receive sequence of images from image source(s); and process sequence of images to generate sequence of processed images. When processing sequence of images, processor is configured to crop a given image, based on gaze direction of user and angular size of field of view, to generate processed image. Angular size of field of view represented by processed image is larger than angular size of field of view providable by the image renderer.
A display system including display or projector , camera, means for tracking position and orientation of user's head, and processor. The processor is configured to control camera to capture images of real-world environment using default exposure setting, whilst processing head-tracking data to determine corresponding positions and orientations of user's head with respect to which images are captured; process images to create environment map of real-world environment; generate extended-reality image from images using environment map; render extended-reality image; adjust exposure of camera to capture underexposed image of real-world environment; process images to generate derived image; generate next extended-reality image from derived image using environment map; render next extended-reality image; and identify and modify intensities of oversaturated pixels in environment map, based on underexposed image and position and orientation with respect to which underexposed image is captured.
A display system and method for correcting drifts in camera poses. Images are captured via camera, and camera poses are determined in global coordinate system. First features are extracted from first image. Relative pose of first feature with respect to camera is determined. Pose of first feature in global coordinate system is determined, based on its relative pose and first camera pose. Second features are extracted from second image. Relative pose of second feature with respect to camera is determined. Pose of second feature in global coordinate system is determined, based on its relative pose and second camera pose. Matching features are identified between first features and second features. Difference is determined between pose of feature based on first camera pose and pose of feature based on second camera pose. Matching features that satisfy first predefined criterion based on difference are selected. Correction transform that, when applied to second camera pose, yields corrected second camera pose is generated, such that corrected differences between poses of matching features based on corrected second camera pose and corresponding poses of matching features based on first camera pose satisfy second predefined criterion. Correction transform is applied to second camera pose. Second image is processed, based on corrected second camera pose, to generate extended-reality image.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G06T 7/80 - Analyse des images capturées pour déterminer les paramètres de caméra intrinsèques ou extrinsèques, c. à d. étalonnage de caméra
G06T 7/70 - Détermination de la position ou de l'orientation des objets ou des caméras
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
H04N 13/246 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques Étalonnage des caméras
75.
Display apparatus and method using projection matrices to generate image frames
A display apparatus including display or projector, means for tracking position and orientation of user's head, and processor coupled to display or projector and said means. The processor or external processor communicably coupled to processor is configured to obtain head-tracking data indicative of position and orientation; process head-tracking data to determine current position and orientation of user's head and velocity and/or acceleration with which position and orientation is changing; predict first and second position and orientation of user's head at time t1 and t2, respectively; determine first and second projection matrices to be applied to three-dimensional image data of given frame, respectively; and apply first and second projection matrices to said image data to generate first image frame and second image frame, respectively. Processor is configured to render first and second image frame at time t1 and t2, respectively.
G03B 21/14 - Projecteurs ou visionneuses du type par projection; Leurs accessoires - Détails
H04N 9/31 - Dispositifs de projection pour la présentation d'images en couleurs
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
An imaging system for producing images for a display apparatus, the imaging system including: at least one camera; means for tracking an orientation of the at least one camera; and at least one processor communicably coupled to said camera and said means. The at least one processor is configured to: create and store an N-dimensional data structure representative of an environment; for a plurality of orientations of the at least one camera, determine values of camera attributes to be employed to capture a given image from a given orientation and update the N-dimensional data structure with the determined values; access the N-dimensional data structure to find values of camera attributes for a current orientation; and control the at least one camera to employ the found values for capturing an image of real-world scene from the current orientation.
A display apparatus including means for detecting user's gaze direction; first light source; second light source; configuration (108, 208, 306) of reflective elements to split light to create copies of second image; optical waveguides whose outlets are arranged in tiled layout; opacity masks arranged at inlets of waveguides; and processor. Input image is processed to generate first and second images. Processor is configured to: display first and second images; and for optical waveguides, control respective opacity masks to block respective copies of second image or selectively allow portions of respective copies of second image to pass through towards inlets of waveguides. Light from first light source is optically combined with light exiting outlets of waveguides, to produce output image.
An imaging system for producing images for a display apparatus. The imaging system includes at least one camera, and processor communicably coupled to the at least one camera. The processor is configured to: obtain, from display apparatus, information indicative of current gaze direction of a user; determine, based on current gaze direction of the user, an object of interest within at least one display image, wherein the at least one display image is representative of a current view presented to user via display apparatus; adjust, based on a plurality of object attributes of the object of interest, a plurality of camera attributes of the at least one camera for capturing a given image of a given real-world scene; and generate from the given image a view to be presented to user via display apparatus.
H04N 5/232 - Dispositifs pour la commande des caméras de télévision, p.ex. commande à distance
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G06T 7/62 - Analyse des attributs géométriques de la superficie, du périmètre, du diamètre ou du volume
79.
Imaging system and method for producing images using means for adjusting optical focus
An imaging system for producing images for a display apparatus. Imaging system includes at least one imaging unit including camera, optical element including first optical portion and second optical portion having different focal lengths, and means for adjusting optical focus; means for generating depth or voxel map; and processor. Processor is configured to obtain gaze direction of user; determine optical depth of object present in region of interest within real-world scene; and control means for adjusting optical focus of imaging unit, based on optical depth of object and focal lengths of first and second optical portions, to capture warped image of real-world scene, the warped image having spatially-uniform angular resolution.
G06K 9/00 - Méthodes ou dispositions pour la lecture ou la reconnaissance de caractères imprimés ou écrits ou pour la reconnaissance de formes, p.ex. d'empreintes digitales
G02F 1/29 - Dispositifs ou dispositions pour la commande de l'intensité, de la couleur, de la phase, de la polarisation ou de la direction de la lumière arrivant d'une source lumineuse indépendante, p.ex. commutation, ouverture de porte ou modulation; Optique non linéaire pour la commande de la position ou de la direction des rayons lumineux, c. à d. déflexion
G06T 19/00 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie
An input device including first sensor that measures first sensor data indicative of at least one of: pressure applied to input device, presence or absence of given object in proximity of input device, distance of given object from input device, position and orientation of input device; and processor coupled to first sensor. Processor processes first sensor data to determine state of input device, said state indicating whether or not input device is lying on given object; obtains, from user device, context information pertaining to visual scene being presented to user; and controls input device to operate in first mode of operation or second mode of operation based on said state and context information. Input device acts as computer mouse during first mode of operation and as six-degrees-of-freedom controller during second mode of operation.
A63F 13/20 - Dispositions d'entrée pour les dispositifs de jeu vidéo
A63F 13/211 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types utilisant des capteurs d’inertie, p.ex. des accéléromètres ou des gyroscopes
A63F 13/24 - Dispositions d'entrée pour les dispositifs de jeu vidéo - Parties constitutives, p.ex. manettes de jeu avec poignées amovibles
A63F 13/218 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types utilisant des capteurs de pression, p.ex. générant un signal proportionnel à la pression exercée par le joueur
A63F 13/2145 - Dispositions d'entrée pour les dispositifs de jeu vidéo caractérisées par leurs capteurs, leurs finalités ou leurs types pour localiser des contacts sur une surface, p.ex. des tapis de sol ou des pavés tactiles la surface étant aussi un dispositif d’affichage, p.ex. des écrans tactiles
81.
Synchronizing light sources and optics in display apparatuses
A display apparatus communicably coupled with server arrangement. Display apparatus includes means for tracking user's gaze; means for tracking pose of display apparatus; light source; optical element; and processor. Processor is configured to: process gaze-tracking data; process pose-tracking data; send, to server arrangement, gaze information and apparatus information, server arrangement predicts gaze information and apparatus information, and processes input image to generate image based on predictions; receive, image, predicted gaze information, and predicted apparatus information; determine adjustment required in configuration of light source and optical element prior to displaying image; determine if portion of previous image is to be displayed during adjustment; if yes, display said portion during adjustment; if no, switch off or dim light source during adjustment; display image via light source after adjustment.
G06T 7/73 - Détermination de la position ou de l'orientation des objets ou des caméras utilisant des procédés basés sur les caractéristiques
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G06F 3/0346 - Dispositifs de pointage déplacés ou positionnés par l'utilisateur; Leurs accessoires avec détection de l’orientation ou du mouvement libre du dispositif dans un espace en trois dimensions [3D], p.ex. souris 3D, dispositifs de pointage à six degrés de liberté [6-DOF] utilisant des capteurs gyroscopiques, accéléromètres ou d’inclinaiso
82.
Distance-imaging system and method of distance imaging
A distance-imaging system including an illuminating unit that projects a spatially non-uniform pattern of light spots onto objects present in real-world environment, first portion of said pattern having higher density of light spots than second portion of said pattern; at least one camera that captures image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with said camera, wherein first optical portion of said optical element has higher magnification factor than second optical portion of said optical element, reflections of said first and second portions of spatially non-uniform pattern of light spots being differently magnified and/or de-magnified by said first and second optical portions, respectively.
A tracking system for use in head-mounted display apparatus includes at least one emitter that emits signals; a first receiver and a second receiver that sense the emitted signals and generate sensor data, the first receiver and the second receiver being arranged on a first portion and a second portion, respectively, wherein the first portion faces a user when the head-mounted display apparatus is worn by the user, and the second portion is a part of a user-interaction controller of a head-mounted display; and a processor configured to process the generated sensor data to determine relative positions and orientations of first receiver and second receiver with respect to the emitter, and to determine a relative position and orientation of the second receiver with respect to the first receiver.
G01S 5/02 - Localisation par coordination de plusieurs déterminations de direction ou de ligne de position; Localisation par coordination de plusieurs déterminations de distance utilisant les ondes radioélectriques
G01S 5/18 - Localisation par coordination de plusieurs déterminations de direction ou de ligne de position; Localisation par coordination de plusieurs déterminations de distance utilisant des ondes ultrasonores, sonores ou infrasonores
G01S 5/16 - Localisation par coordination de plusieurs déterminations de direction ou de ligne de position; Localisation par coordination de plusieurs déterminations de distance utilisant des ondes électromagnétiques autres que les ondes radio
An imaging system including infrared light source, imaging unit and processor. Imaging unit includes first and second image-sensor chips, semi-transparent reflective element, infrared filter arranged to block transmission of infrared light towards first image-sensor chip, and means for transmitting infrared light received from overlapping field of view towards second image-sensor chip, whilst blocking transmission of infrared light received from non-overlapping field of view towards second image-sensor chip. First and second image-sensor chips are controlled to capture first and second images of real-world environment, wherein portion of second image-sensor chip that receives infrared light from overlapping field of view captures depth information pertaining to overlapping field of view. Extended-reality image is generated from first and second images, based on depth information.
G09G 5/00 - Dispositions ou circuits de commande de l'affichage communs à l'affichage utilisant des tubes à rayons cathodiques et à l'affichage utilisant d'autres moyens de visualisation
H04N 5/74 - Dispositifs de projection pour reproduction d'image, p.ex. eidophor
H04N 5/33 - Transformation des rayonnements infrarouges
A display apparatus includes an image renderer per eye, at least one optical element arranged on an optical path between the image renderer and an image plane and a processor coupled to the image renderer. The processor or an image source communicably coupled to the processor is configured to generate a warped image based upon the optical properties of the first optical portion and the second optical portion. The processor is configured to render the warped image via the image renderer, wherein projections of a first portion and a second portion of the warped image are to be differently magnified by the first optical portion and the second optical portion of the at least one optical element, respectively, to produce the image on the image plane in a manner that the produced image appears de-warped to a user. The image has a spatially-variable angular resolution on an image plane.
A display apparatus includes means for detecting gaze direction of user; processor configured to process input image based upon gaze direction to generate first and second images; first and second image renderers to render first and second images; optical combiner; first array of micro-prisms to split light emanating from second image renderer into multiple directions to produce multiple projections of second image; optical element to direct said multiple projections towards optical combiner; and optical shutter arranged between optical element and optical combiner, wherein optical shutter allows given portion of said multiple projections to pass, whilst blocking remaining portion of said multiple projections. The optical combiner optically combines projection of first image with given portion of said multiple projections, to produce on image plane output image having spatially-variable angular resolution. The processor controls optical shutter based upon detected gaze direction, whilst first and second images are being rendered.
H04N 13/346 - Reproducteurs d’images utilisant des prismes ou des miroirs semi-transparents
H04N 13/344 - Affichage pour le visionnement à l’aide de lunettes spéciales ou de visiocasques avec des visiocasques portant des affichages gauche et droit
87.
Imaging unit, display apparatus and method of displaying
A display apparatus includes an imaging unit, an image renderer and a processor. The imaging unit includes a camera for capturing an image of a given real-world scene and an optical element arranged on an optical path of a projection of the given real-world scene. The projection of the given real-world scene is differently magnified by first and second optical-element portions of the optical element in a manner that the captured image has a variable angular resolution across a field of view of the optical element. An angular resolution of a first portion of the captured image is greater than an angular resolution of a second portion of the captured image. The processor is configured to process the captured image to generate an output image and render the output image via the image renderer.
H04N 13/383 - Suivi des spectateurs pour le suivi du regard, c. à d. avec détection de l’axe de vision des yeux du spectateur
H04N 13/239 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques utilisant deux capteurs d’images 2D dont la position relative est égale ou en correspondance à l’intervalle oculaire
H04N 13/344 - Affichage pour le visionnement à l’aide de lunettes spéciales ou de visiocasques avec des visiocasques portant des affichages gauche et droit
88.
Display apparatus and method using reflective elements and opacity mask
A display apparatus including means for detecting gaze direction of user; first and second image renderers; processor, processor or external processor processes input image to generate first image and second image, processor renders first and second images simultaneously; configuration of reflective elements arranged to split light emanating from second image renderer into plurality of directions to produce plurality of projections of second image in tiled layout; optical combiner; and opacity mask that is controlled based upon gaze direction to selectively allow given portion of the projections to pass through towards optical combiner, whilst blocking remaining portion of projections. Optical combiner is arranged to optically combine projection of first image with given portion of the projections, to produce on image plane an output image.
A direct retinal projection apparatus including means for detecting a gaze direction of a user, a projector, a first optical element, an actuator and a processor. The first optical element includes different optical portions having different optical properties with respect to magnification. The processor is configured to render a warped image having a spatially-uniform angular resolution via the projector, whilst adjusting an orientation of the first optical element via the actuator, based on the detected gaze direction, to direct a projection of the warped image from the first optical element towards a retina of a user's eye. Projections of different portions of the warped image are differently magnified by the different optical portions of the first optical element to produce on the retina of the user's eye a de-warped image having a spatially-variable angular resolution.
H04N 13/383 - Suivi des spectateurs pour le suivi du regard, c. à d. avec détection de l’axe de vision des yeux du spectateur
H04N 13/239 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques utilisant deux capteurs d’images 2D dont la position relative est égale ou en correspondance à l’intervalle oculaire
H04N 13/344 - Affichage pour le visionnement à l’aide de lunettes spéciales ou de visiocasques avec des visiocasques portant des affichages gauche et droit
A display apparatus includes a plurality of housings connected by adjustable device for setting spacing between centers of the plurality of housings, each housing including: first image source mounted to side of housing; second image source mounted to housing angularly offset from first image source, wherein second image source includes higher resolution and narrower image field of view than first image source; optical combiner positioned in housing between first and second image sources, on which first image from first image source and second image from second image source are superimposed and made visible to user's eye; magnification lens for magnifying second image to increase image field of view; eyepiece lens for reducing focal distance between the optical combiner and the user's eye; and controller configured to control output of second image source to render colors to compensate for distortion and chromatic aberrations introduced by magnification lens.
G02B 7/04 - Montures, moyens de réglage ou raccords étanches à la lumière pour éléments optiques pour lentilles avec mécanisme de mise au point ou pour faire varier le grossissement
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G02B 27/00 - Systèmes ou appareils optiques non prévus dans aucun des groupes ,
91.
System and method for producing images for display apparatus
A system for producing images for display apparatus includes an image source to obtain an input image and a processor configured to obtain information of a gaze direction of a user, determine a region of interest of the input image based on the gaze direction, and process the input image to generate a first with a first region that is blurred with respect to region of interest, and a second image corresponding to the region of interest. The processor adjusts an intensity of pixels within the first region and an intensity of pixels within the second image. When an intensity of a given pixel within the region of interest is lower than or equal to a predefined intensity threshold, an intensity of a corresponding pixel within the first region is lower than an intensity of a corresponding pixel within the second image.
A system for processing images for display apparatus, system is communicably coupled to display apparatus, display apparatus including first and second image renderers, system includes image source and processor, wherein image source produces input image, processor of system being configured to: process input image to generate first image such that first region of first image is blurred and its intensity is reduced with respect to intensity of corresponding region of input image; and process input image to generate second image, second image corresponding to cropped region of input image, intensity of second image being adjusted according to intensity of aforesaid first region; wherein processor of system or processor of display apparatus renders first and second images at first and second image renderers, respectively, projections of rendered first and second images being optically combined such that projection of rendered second image overlaps with projection of first region of first image.
A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
G06T 19/20 - Transformation de modèles ou d'images tridimensionnels [3D] pour infographie Édition d'images tridimensionnelles [3D], p.ex. modification de formes ou de couleurs, alignement d'objets ou positionnements de parties
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
G06F 3/00 - Dispositions d'entrée pour le transfert de données destinées à être traitées sous une forme maniable par le calculateur; Dispositions de sortie pour le transfert de données de l'unité de traitement à l'unité de sortie, p.ex. dispositions d'interface
G06F 3/0481 - Techniques d’interaction fondées sur les interfaces utilisateur graphiques [GUI] fondées sur des propriétés spécifiques de l’objet d’interaction affiché ou sur un environnement basé sur les métaphores, p.ex. interaction avec des éléments du bureau telles les fenêtres ou les icônes, ou avec l’aide d’un curseur changeant de comport
94.
Display apparatus and method of displaying using light source and beam scanning arrangement
A display apparatus includes at least one light source per eye, the at least one light source being operable to emit a light beam; at least one beam scanning arrangement per eye, the at least one beam scanning arrangement being configured to direct the light beam towards a projection surface, and to sweep the light beam according to a scanning pattern, the scanning pattern being substantially in a form of a spiral; and a processor configured to control the at least one light source and the at least one beam scanning arrangement to draw at least a first region of an input image over the projection surface, wherein a resolution of the first region of the input image is to vary as a function of an angular distance from a centre of the spiral.
G02F 1/29 - Dispositifs ou dispositions pour la commande de l'intensité, de la couleur, de la phase, de la polarisation ou de la direction de la lumière arrivant d'une source lumineuse indépendante, p.ex. commutation, ouverture de porte ou modulation; Optique non linéaire pour la commande de la position ou de la direction des rayons lumineux, c. à d. déflexion
95.
Imaging system, display apparatus and method of producing mixed-reality images
An imaging system for producing mixed-reality images for display apparatus. The imaging system includes a camera and a processor communicably coupled to the camera. The processor is configured to control the camera to capture image of real-world environment; analyze the image to identify surface that displays visual content; compare the visual content displayed in the image with reference image of the visual content to determine size, position and orientation of the surface with respect to the camera; process the reference image of the visual content to generate processed image of the visual content; and replace the visual content displayed in the image with the processed image to generate mixed-reality image, wherein resolution of the processed image is higher than resolution of the visual content displayed in the image.
A display apparatus including at least one image renderer; light sources; controllable scanning mirrors; at least two actuators associated with the controllable scanning mirrors; means for detecting gaze direction of user; and a processor communicably coupled to the aforementioned components. The processor is configured to: (a) obtain an input image and determine region of visual accuracy thereof; (b) process the input image to generate a context image and a focus image; (c) determine a focus area within a projection surface over which the focus image is to be drawn; (d) render the context image; (e) draw the focus image; and (f) control the actuators to align the controllable scanning mirrors. The processor is configured to perform (d), (e) and (f) substantially simultaneously, and optically combine a projection of the drawn focus image with a projection of the rendered context image to create a visual scene.
G06T 17/00 - Modélisation tridimensionnelle [3D] pour infographie
G09G 3/02 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques par traçage ou balayage d'un faisceau lumineux sur un écran
A display apparatus including at least one light source per eye; at least one controllable scanning mirror per eye; means for detecting gaze direction of user; and a processor communicably coupled to the aforementioned components. The processor is configured to (a) obtain an input image and determine region of visual accuracy thereof; (b) generate pixel data corresponding to at least a first region and a second region of the input image, wherein the second region substantially corresponds to the region of visual accuracy of the input image, while the first region substantially corresponds to a remaining region of the input image, wherein the first region have a first resolution, while the second region have a second resolution, the second resolution being higher than the first resolution; and (c) control the at least one light source and the at least one controllable scanning mirror to draw the aforementioned regions.
H04N 13/32 - Reproducteurs d’images pour visionnement sans avoir recours à des lunettes spéciales, c. à d. utilisant des affichages autostéréoscopiques utilisant des fenêtres en mouvement ou des sources lumineuses en mouvement
G02B 27/00 - Systèmes ou appareils optiques non prévus dans aucun des groupes ,
H04N 19/167 - Position dans une image vidéo, p.ex. région d'intérêt [ROI]
H04N 9/31 - Dispositifs de projection pour la présentation d'images en couleurs
G02B 26/12 - Systèmes de balayage utilisant des miroirs à facettes multiples
G02B 26/08 - Dispositifs ou dispositions optiques pour la commande de la lumière utilisant des éléments optiques mobiles ou déformables pour commander la direction de la lumière
G06F 3/01 - Dispositions d'entrée ou dispositions d'entrée et de sortie combinées pour l'interaction entre l'utilisateur et le calculateur
98.
Gaze-tracking system and method of tracking user's gaze using reflective element
A gaze-tracking system for use in a head-mounted display apparatus. The gaze-tracking system includes at least one illuminator to emit light pulses for illuminating a user's eye; at least one camera to capture image of reflections of the light pulses; at least one reflective element arranged on an optical path of the reflections of the light pulses, such that when incident upon the at least one reflective element, the reflections of the light pulses are reflected towards the at least one camera; at least one actuator associated with the at least one reflective element, wherein the at least one actuator moves the at least one reflective element; and a processor configured to: process the at least one image to detect a gaze direction of user; and control the at least one actuator to adjust, based upon the detected gaze direction, position of the at least one reflective element.
An imaging system for producing images to be displayed to user via a head-mounted display apparatus that includes means for detecting gaze direction of user. The imaging system includes a first outer camera and a second outer camera, at least one inner camera, and processor coupled to aforesaid cameras and means for detecting gaze direction. The processor is configured to (i) obtain inter-pupillary distance of user with respect to user's gaze at infinity; (ii) receive detected gaze direction; (iii) control first outer camera, second outer camera and at least one inner camera to capture first outer image, second outer image and at least one inner image of a scene; and (iv) process first outer image and inner image to generate first view of the scene, and process second outer image and inner image to generate second view of the scene, based upon inter-pupillary distance and detected gaze direction.
H04N 13/25 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques utilisant plusieurs capteurs d’images aux caractéristiques différentes autres que la position ou le point de vue, p.ex. avec des différences dans la résolution ou les propriétés de saisie de couleurs; Commande des caractéristiques d’un capteur par les signaux d’images d’un autre capteur
G09G 3/00 - Dispositions ou circuits de commande présentant un intérêt uniquement pour l'affichage utilisant des moyens de visualisation autres que les tubes à rayons cathodiques
H04N 13/344 - Affichage pour le visionnement à l’aide de lunettes spéciales ou de visiocasques avec des visiocasques portant des affichages gauche et droit
100.
System and method of enhancing user's immersion in mixed reality mode of display apparatus
A system and a method for enhancing a user's immersion in a mixed reality mode of head-mounted display apparatus, the system being at least communicably coupled to the aforesaid display apparatus. The system includes at least one camera communicably coupled to a processor. The processor controls said camera to capture sequence of images of real-world environment; analyse sequence of images to identify spatial geometry of real objects in real-world environment and material categories to which real objects belong; process sequence of images to generate sequence of mixed-reality images, based upon spatial geometry and material category of at least one real object that is represented by at least one virtual object in sequence of mixed-reality images, wherein visual behaviour of at least one virtual object emulates at least one material property associated with material category of the at least one real object; and render the sequence of mixed-reality images.
brevets
