Jump to content

iPhone 13 Max LiDAR Tech to 3D Material?


BigAl3D

Recommended Posts

I know it's not that hard to create basic and decent PBR materials from quality images. I'm curious if anyone has experience using Apple's LiDAR tech in their newer phones to extract the depth map for use in Substance for example? I will be getting samples of rugs that I will be adding to archvis-style 3D rooms instead of traditional photography. I have recently tried dropping a detail rug sample into Adobe Substance 3D Sampler and it did a decent job of giving me a Bump and Normal map. (See link. It wouldn't let me upload the image).

 

Just looking for options to increase the realism and wondered if the new tech might be useful. Thanks.

 

https://www.dropbox.com/s/uktvbojp3sbawrh/RugTest_Substance.jpg?dl=0

Link to comment

I'm very interested in this, BigAl3d. Nice image!

 

I have an iPhone 13. I recently terminated my Adobe Substance Suite subscription, but have a full current Substance Painter license via Steam. I would be curious to see what the depth map looks like for the image you posted.

 

I would think there are other pipelines for this that don't rely on Substance Sampler.

Link to comment
19 hours ago, BigAl3D said:

I know it's not that hard to create basic and decent PBR materials from quality images. I'm curious if anyone has experience using Apple's LiDAR tech in their newer phones to extract the depth map for use in Substance for example? I will be getting samples of rugs that I will be adding to archvis-style 3D rooms instead of traditional photography. I have recently tried dropping a detail rug sample into Adobe Substance 3D Sampler and it did a decent job of giving me a Bump and Normal map. (See link. It wouldn't let me upload the image).

 

Just looking for options to increase the realism and wondered if the new tech might be useful. Thanks.

 

https://www.dropbox.com/s/uktvbojp3sbawrh/RugTest_Substance.jpg?dl=0

Maybe this app?https://tenebrislab.github.io/livenormal/

Link to comment
23 hours ago, BigAl3D said:

I know it's not that hard to create basic and decent PBR materials from quality images. I'm curious if anyone has experience using Apple's LiDAR tech in their newer phones to extract the depth map for use in Substance for example? I will be getting samples of rugs that I will be adding to archvis-style 3D rooms instead of traditional photography. I have recently tried dropping a detail rug sample into Adobe Substance 3D Sampler and it did a decent job of giving me a Bump and Normal map. (See link. It wouldn't let me upload the image).

 

Just looking for options to increase the realism and wondered if the new tech might be useful. Thanks.

 

https://www.dropbox.com/s/uktvbojp3sbawrh/RugTest_Substance.jpg?dl=0


Not LIDAR but you can extract textures with photometric stereo capture, it's the way to go to capture detailled surface information. There are some nodes in SD Designer to process this kind of data. The process is really simple and you can get interesting results very quickly. But the "PBR" part is the most difficult one, with much work to do to get consistent and repeatable result.

Some links : 

https://substance3d.adobe.com/tutorials/courses/Your-smartphone-is-a-material-scanner

https://substance3d.adobe.com/tutorials/courses/Art-by-Rens-Substance-3D-Designer-Scan-Processing

 

https://dabarti.com/capture/

 

https://dabarti.com/vfx/dabarti-capture-basics-capturing-textures-using-mobile-phone/

 

 

 

Edited by JohnDo
added links (see edit history)
Link to comment

I don't think Apple Lidar is on that level where it can harvest all the detail. At least that's my experience. Photogrammetry works so much better, buy again, its a totally different thing!

Link to comment

IMO Applies LIdar does a disservice to the word Lidar, its very low resolution and imprecise. honestly the face Scanner on the front side does a better job with fine details. I think for something like this a photogrammetry solution will give better results.

Link to comment

lidar on the iphone simply cant resolve that detail you would find in a rug, no point trying. Youll have a better chance with the face scanner using "3d scanner app", but even then, photo to normal/displacement map conversion apps will work better as you can feed them a nice 8k still photo or two. 

Link to comment
×
×
  • Create New...

Copyright Core 4D © 2023 Powered by Invision Community