What are major events in the development of XR both theoretical and practical History plato ‘cave victorian 3D link flight simulators Sensorama NASA View System Palmer Luckey,Oculus
IAaPreProcessingModel: module 1-5
Crucial Skill in Education 4Rs reading writing rithemetic researching Researching implies to use what is called the scientific method behavioral research Why the Scientific Method Our modern way of life is largely a creation of science and technology Understanding how people obtain their research results fostering and backing up creative thinking learn about limitations It’s fun Peirce’s Methods of Fixing Beliefs scientific and non-scientific thinking differs Peirce systematically analysed different approaches by distinguishing the method of tenacity, authority, a priori method,and scientific method Empirical Reasoning and scientific method Spatial Presence
Social XR spatial presence social presence self embodiment agency multi-modol non verbal cues The Impact and Vision of Immersive Tech future of human communication: building it responsibly,together Immersive media: Face-to-Face »AR>MR> Agrumented Reality»VR words> 2Dpictures> 3D immersive Applications XR collaboration: Microsoft Mesh Vision Metaverse: Meta’Vision Spatial Computation: Apple Vision pro capacablity Digital Human balance technology and artistry Point clouds,Meshes,NeRF,3D Gaussian Splatting 3D Gaussian Splatting can not measure but see fill the gap Neural Radiance Field deep learning for reconstructing a 3D from sparse 2D image AI based Dynamic scenarios sycohronous cameras limited field fo fview heavy post processing minics reality using custom-caotured Why is it challenging? Generative AL ,LLMs: Computing power and reasoning engine for creation Ethical considerations: Balancing Potention and Responsiblity USERS data privacy and control inclusive accessible safe and secure digital worlds digital human human righte and risks Application transforming lives with impact and responsibility:healthcare , education Life-Like AR -example view remote collaboration tp global expertise Vision for the future of human connection integrated to sensory
Digital Twins: from/for Earth Observation Heigh estimation 3D virtual urban scene reconstruction terrestrial videogrammetry
Sense of Place GEO as a place-based theme Informal Local context Experiential Engagement Geo-visualization Timeline traditional mapping and mapmaking 3D CAD based Virtual Globes Immersion parallax physical reality head-mounted display Embodied Coginition Mind> Body > Environment Two level model of spatial presence Attention allocation spatial situation model self-location possible actions spatial presence From technology to user experience technological affordances(自解释)> immersion application experience Sensing the world Data from multiple sources Immersive Visualization Visualization provides insight> abstract data made visually accessible,communication everything is about cognition> perceiving, understanding , deciding spatial understanding is an important part of place-based cognition> XR is space creator, XR aids cognition, but in practice it can be complex and messy Cognitive Load Theory Intrinsic load germane load> task extraneous load > unnecessary Seductive(有吸引力的) details Design is the key Body-based interactions Isovist the spatial extent visible from a given viewpoint
What is Design Thinking? Design Thinking Process Empathize define ideate prototype test
Recap Animation considerations Inverse-Kinetics Why optimise 3D models for game engine use? Higher polygon counts in the scene can decrease the frame rate
Part 1 Creating Realism XR Realism 3D environment: 3D Assets, Particle Effects, Lighting/Lights, Animations, Texturing/ Materials Material Explained make 3D models look realistic glossiness and reflection Complex material » Layers Classes of Materials Bitmap texture: Old Wall Texture Procedural maps: Procedural Wood Texture General Concepts of Light Maps Diffuse Ambience Specular ![[cd0066a2b1a3020289607c36f3c5771.png]] Combining Types of Materials Diffuse Color Diffuse – Light spread evenly across the surface. there is no black line in your photo no shadow Specular Maps Specular Map Specular Color Map Specular Level Map Glossiness Map affect the specular region of a shiny object Luminance Map brightness of a surface based on the map’s grayscale intensity Opacity Map use grayscale bitmap images to control opacity and transparency reflect Bump Map The different intensities of light and dark tones of the grayscale bitmap
Why it so important Fundamentally different from other media Feels like you are in a different place Immersion (technology) creates a Sense of presence