3D Human Internal Organs Representation Model (Updates)

ISO/IEC JTC 1/SC 24/WG 9 & Web3D Meetings

January 21-24, 2019

Myeong Won Lee (The University of Suwon) Requirements (1) • 3D printing and scanning • Interface to 3D printers for internal organs • Interface to 3D scanners for internal organs

3dprintingindustry.com pinterest.com 3dprint.com

2019-1-22 SC24 Plenary & WG Meetings 2 imedicin.worpress.com 3dprintingindustry.com en.people.cn Requirements (2) • Human health care service applications • Internal organs representation • Human health device and information service

cargocollective.com cargocollective.com imedicalapps.com

mediafocus.com 123rf.com 123rf.com 2019-1-22 SC24 Plenary & WG Meetings 3 3D Digital Human Modeling (1)

• Concepts • Provision with digital processing functionalities for an entire human body in 3D using all visual and functional information about internal organs as well as external human surface model and skeleton motion • 3D modeling and animation technology for digital information processing that can represent shapes, properties, function, and motion for human bodies, including internal organs • Standardized 3D digital information necessary for developing 3D medical and health care applications

2019-1-22 SC24 Plenary & WG Meetings 4 3D Digital Human Modeling (2)

• Required technologies • Shape modeling of internal and external whole bodies in partial or whole forms using graphics technology • Motion modeling of internal and external whole bodies in partial or whole forms using graphics technology • For all visual human models, functional properties should be able to be defined and combined for shape and motion modeling of a human model

2019-1-22 SC24 Plenary & WG Meetings 5 Humanoid Body Related Standards

• ISO/IEC 19774 Humanoid Animation: 2006 V1.0 (IS) • ISO/IEC 19774 Humanoid Animation – Part 1: Architecture V2.0 (DIS) • ISO/IEC 19774 Humanoid Animation – Part 2: Motion Capture V2.0 (DIS) • ISO 7250-1: 2008 Basic human body measurements for technological design – Part 1: Body measurement definitions and landmarks • ISO/TR 7250-2: 2010 Basic human body measurements for technological design – Part 2: Statistical summaries of body measurements from national populations • ISO 7250-3: 2015 Basic human body measurements for technological design – Part 2: Worldwide and regional design ranges for use in product standards

2019-1-22 SC24 Plenary & WG Meetings 6 Standardization Topics

• Representation data model for visualizing human internal organs and their functionalities • Modeling data exchange format of human internal organs • Animation data exchange format of human internal organs • Interface data model for representing functions of medical and health devices with human internal models in 3D scenes

2019-1-22 SC24 Plenary & WG Meetings 7 Representation Data Model for Human Internal Organs • Modeling data model • Soft object representation • Soft object modeling • Landmarks • Data model for shape representation • Animation data model • Animation methods • Animation parameters • Animation definition • Data model for animation representation • Interface data model with medical and health devices

2019-1-22 SC24 Plenary & WG Meetings 8 Internal Organs commons.wikimedia.org

2019-1-22 SC24 Plenary & WG Meetings 9 Internal Organs Set vectorStock.com

2019-1-22 SC24 Plenary & WG Meetings 10 Internal Organs Set

Digestive System Circulatory System Urinary System - - Heart - Kidney - - Ureter - - Bladder - - - Pancreas - Gallbladder -

2019-1-22 SC24 Plenary & WG Meetings 11 Digestive System

2019-1-22 SC24 Plenary & WG Meetings 12 Digestive organs

Esophagus Gallbladder Stomach Large intestine

Small intestine Pancreas Liver

2019-1-22 SC24 Plenary & WG Meetings 13 Digestive System Modeling

3ds Max Viewport Shot

x3d Viewer

2019-1-22 SC24 Plenary & WG Meetings 14 Digestive System - Esophagus

http://www.wikipedia.com/ https://www.innerbody.com/image dige01/dige03-new2.html

2019-1-22 SC24 Plenary & WG Meetings 15 Esophagus Modeling

3ds Max Viewport Shot

Esophagus

x3d Viewer

2019-1-22 SC24 Plenary & WG Meetings 16 Esophagus X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 17 Digestive System - Stomach

2019-1-22 SC24 Plenary & WG Meetings 18 Digestive System - Stomach

2019-1-22 SC24 Plenary & WG Meetings 19 Stomach Modeling

3ds Max Viewport Shot

esophagus fundus cardia

Pyloric canal body

Pyloric sphincter x3d Viewer Image Pyloric antrum

2019-1-22 SC24 Plenary & WG Meetings 20 Stomach Modeling

muscularis

subserosa esophagus

mucosa serosa fundus

cardia duodenum

body e

pyloric canal pyloric sphincter pyloric antrum Stomach Stomach layer

2019-1-22 SC24 Plenary & WG Meetings 21 Stomach X3D

Problem in layers modeling: Some polygons turned outside and intermingled

2019-1-22 SC24 Plenary & WG Meetings 22 Stomach X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 23 Digestive organs - Duodenum

2019-1-22 SC24 Plenary & WG Meetings 24 Duodenum Modeling

3ds Max Viewport Shot

duodenum1

Rendering Image duodenum2

duodenum3

duodenum4

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 25 Duodenum X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 26 Digestive System – Small Intestine ()

http://www.innerbody.com/

2019-1-22 SC24 Plenary & WG Meetings 27 Small Intestine Modeling

3ds Max Viewport Shot

x3d Viewer Image ileum

2019-1-22 SC24 Plenary & WG Meetings 28 Digestive System – Problem of Small Intestine Modeling

problem

Overlapping polygon

wrl x3d 2019-1-22 SC24 Plenary & WG Meetings 29 Small Intestine Animation using Interpolators

2019-1-22 SC24 Plenary & WG Meetings 30 Small Intestine X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 31 Digestive System – Large Intestine

https://medium.com/@vincentmarger/nutrition-and-digestion- large-intestine-71dab5c05aaf

Front of abdomen, showing the large intestine, with the stomach and small intestine in gray outline http://www.innerbody.com/image digeov/dige10-new3.html https://en.wikipedia.org/wiki/Large intestine

2019-1-22 SC24 Plenary & WG Meetings 32 Large Intestine Modeling

3ds Max Viewport Shot Splenic Flexure

Ascending Colon

Cecum

Sigmoid Colon

Appendix x3d Viewer Image Anus

2019-1-22 SC24 Plenary & WG Meetings 33 Large Intestine X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 34 Abdominal Regions

2019-1-22 SC24 Plenary & WG Meetings 35 Digestive System - Pancreas

Anatomy of the pancreas https://www.innerbody.com/image/endo03.html https://en.wikipedia.org/wiki/Pancreas

2019-1-22 SC24 Plenary & WG Meetings 36 Pancreas Modeling

3ds Max Viewport Shot

tail body

x3d Viewer Image head

2019-1-22 SC24 Plenary & WG Meetings 37 Pancreas X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 38 Digestive System - Gallbladder

The gallbladder sits beneath the liver eHealthStar.com https://en.wikipedia.org/wiki/Gallbladder

http://www.innerbody.com/image digeov/dige04-new.html

2019-1-22 SC24 Plenary & WG Meetings 39 Gallbladder Modeling

3ds Max Viewport Shot duct neck

body

fundus

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 40 Gallbladder X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 41 Digestive System - Liver

Location of human liver (in red) http://www.innerbody.com/image Sections of the human Liver digeov/card10-new2.html https://en.wikipedia.org/wiki/Liver https://www.webmd.com/digestive-disorders/picture-of-the-liver#1 / © 2014 WebMD, LLC. All rights reserved.

2019-1-22 SC24 Plenary & WG Meetings 42 Liver Modeling

3ds Max Viewport Shot

Right liver Left liver

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 43 Liver X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 44 Circulatory System

http://www.fit-ed.org/ http://www.3dscience.com/3D_Models/Human_Anatomy/Solid_Models/ solid-3d-human-anatomy-model-collection

2019-1-22 SC24 Plenary & WG Meetings 45 Circulatory System - Heart

The heart, showing valves, arteries and veins. The https://www.innerbody.com/image/card01.html white arrows show the normal direction of blood flow https://en.wikipedia.org/wiki/Heart

2019-1-22 SC24 Plenary & WG Meetings 46 Heart Modeling

3ds Max Viewport Shot Heart Aorta

Heart Pulmonary Artery Heart Superior Vena Cava

Heart Rendering Image Heart Right Pulmonary Vein Atrium Heart Left Auricle

Heart Left Heart Right Atrium Auricle

Heart Inferior Heart Left Vena Cava Ventricle

Heart Right Heart Artery x3d Viewer Image Ventricle 2019-1-22 SC24 Plenary & WG Meetings 47 Heart X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 48 Urinary System

https://www.cincinnatichildrens.org/health/u/urinary-system

2019-1-22 SC24 Plenary & WG Meetings 49 Urinary System Modeling

3ds Max Viewport Shot

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 50 Circulatory System - Kidney

https://therevealer.org/the-patient-body-whats-a-kidney-worth/ https://www.innerbody.com/image_repo01/dige24-new.html

2019-1-22 SC24 Plenary & WG Meetings 51 Kidney Modeling

3ds Max Viewport Shot

Kidney Right

Kidney Left

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 52 Kidney X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 53 Circulatory System - Ureter

https://www.innerbody.com/image_urinov/repo15-new2.html https://www.mayoclinic.org/

2019-1-22 SC24 Plenary & WG Meetings 54 Ureter Modeling

3ds Max Viewport Shot

Ureter right Ureter left

x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 55 Ureter X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 56 Circulatory System - Bladder

https://www.innerbody.com/image_urinov/repo15-new2.html https://www.mayoclinic.org/

2019-1-22 SC24 Plenary & WG Meetings 57 Bladder Modeling

3ds Max Viewport Shot

Bladder x3d Viewer Image

2019-1-22 SC24 Plenary & WG Meetings 58 Bladder X3d Structure

2019-1-22 SC24 Plenary & WG Meetings 59 X3D Structure . . . 2019-1-22 SC24 Plenary & WG Meetings 60 Internal organs data model

• Modeling • Organ • Regions • Region name • Region meta interface • Geometry • Appearance • Layers • Layer name • Layer meta interface • Geometry • Appearance • Animation • Region based keyframe animation • Region based motion capture animation

2019-1-22 SC24 Plenary & WG Meetings 61 Level of details for representation

• Based on eye investigation • LOD 1 • Organ level representation (stomach, lever, ..) • LOD 2 • Region level representation for each organ • LOD 3 • Layer representation

2019-1-22 SC24 Plenary & WG Meetings 62 Conclusions

• Representation data model for human internal organs • Modeling data model • Animation data model • Interface data model with medical and health devices • Modeling: region and layer based modeling • Level of details (LOD1, LOD2, and LOD3) • Region partitioning and landmarks • Layer definition • Animation: region and layer based deformation • Definition of deformation parameters • Interface with medical and health devices • Definition of information from devices • Meta information related to specific parts of an organ

2019-1-22 SC24 Plenary & WG Meetings 63