/r/3dConversion
About the conversion of flat 2d images into 3d images (anaglyph, parallel view, cross view, wigglegram, etc).
This subreddit is about the conversion of flat 2d images into 3d images (anaglyph, parallel view, cross view, wigglegram, etc).
Other subreddits related to stereo photography and 3d:
/r/3dConversion
I'm in the process of converting the film Barnyard (2006) in 3D using iw3.
There's some warping around characters in the scene, but depth looks great.
Is there any programs better than OWL 3D or close in comparison? I like it but it takes way too long on a high end computer even for 2 minute videos. Ive also used iw3 but it doesnt understand how to make the image pop out of the screen and only adds depth. It also has alot of artifacts.
ok this is the best settings l use which l find to be good in iw3 and very little bg errors one thing l only use 1080 clips not 4k l upscale my clips in DaVinci Resolve l am using v19 hope you find this helpful
MY LIST SO FAR MORE WILL FOLLOW
3D SBS 4K Aquaman and the Lost Kingdom 60FPS COMPLETE
3D SBS 4K The Chronicles of Riddick SE 60FPS COMPLETE
3D SBS Pitch.Black 60FPS COMPLETE
3D SBS 4K Riddick 60 FPS COMPLETE
3D SBS 4K Dune SE 60 FPS COMPLETE
3D SBS 4K SE King.Kong 60 FPS COMPLETE
3D SBS 4K Godzilla.X.Kong.The.New.Empire 60 FPS COMPLETE
3D SBS 4K Kingdom.of.the.Planet.of.the.Apes 60FPS COMPLETE
3D SBS 4K The Abyss 60 FPS COMPLETE
3D SBS 4K The Predator 60 FPS COMPLETE
3D SBS 4K Prey 60FPS COMPLETE
3D SBS 4K The Chronicles of Riddick SE 60FPS
3D SBS 4K Alien Resurrection 60 FPS"
3D SBS 4K Alien 3 SE 60 FPS"
3D SBS 4K Alien 60 FPS"
3D SBS 4K Alien vs. Predator 60 FPS"
3D SBS 4K Alien.Covenant 60 FPS"
3D SBS 4K Aliens 60 FPS"
3D SBS 4K Aliens.vs.Predator.Requiem 60 FPS"
3D SBS 4K Aquaman and the Lost Kingdom 60FPS"
3D SBS 4K Batman.Begins 60 FPS"
3D SBS 4K Blade Runner 60FPS"
3D SBS 4K Doctor.Strange.in.the.Multiverse.of.Madness 60 FPS"
3D SBS 4K Dune SE 60 FPS"
3D SBS 4K G.I.Joe.The.Rise.Of.Cobra 60 FPS"
3D SBS 4K Godzilla 60 FPS"
3D SBS 4K Godzilla.X.Kong.The.New.Empire 60 FPS"
3D SBS 4K Iron Man 2 60 FPS"
3D SBS 4K Iron Man 60 FPS"
3D SBS 4K Kingdom.of.the.Planet.of.the.Apes 60FPS"
3D SBS 4K Mission.Impossible.Dead.Reckoning.Part.One 60 FPS"
3D SBS 4K Predator 2 60 FPS"
3D SBS 4K Predator 60 FPS"
3D SBS 4K Predators 60 FPS"
3D SBS 4K Prey 60FPS"
3D SBS 4K Riddick 60 FPS"
3D SBS 4K SE King.Kong 60 FPS"
3D SBS 4K Star Wars Episode I The Phantom Menace 60 FPS"
3D SBS 4K Star Wars Episode II - Attack Of The Clones 60 FPS"
3D SBS 4K Star Wars Episode V The Empire Strikes Back 60 FPS"
3D SBS 4K Star Wars.Episode.III.Revenge.Of.The.Sith 60 FPS"
3D SBS 4K Star Wars.Episode.IV.A.New.Hope 60 FPS"
3D SBS 4K Star Wars.Episode.VI.Return.of.the.Jedi 60 FPS"
3D SBS 4K Terminator.3.Rise.of.the.Machines 60 FPS"
3D SBS 4K Terminator.Salvation 60 FPS"
3D SBS 4K The Abyss 60 FPS"
3D SBS 4K The Chronicles of Riddick SE 60FPS"
3D SBS 4K The Predator 60 FPS"
3D SBS 4K The Terminator 60 FPS"
3D SBS 4K The.Dark.Knight 60 FPS"
3D SBS 4K The.Dark.Knight.Rises 60 FPS"
3D SBS Pitch.Black 60FPS"
3D SBS 4K bad.boys 2 60 FPS
3D SBS 4K Bad.Boys.for.Life 60 FPS
3D SBS 4k Bad Boys Ride or Die 60FPS
3D SBS 4K bad.boys 60 FPS
3D SBS 4k Blade 60FPS
3D SBS 4k Blade 2 60FPS
3D SBS 4k Blade.Trinity 60FPS
this is what it is called nunif on github l have used it for two months and it is amazing l can convert a 24min clip in to 3d sbs in 40mins out put quality you have options it uses as a option crf conversion l use 16 it is about 15gb l have a rtx 6000 gpu
Short Name |
---|
ZoeD_N |
ZoeD_K |
ZoeD_NK |
ZoeD_Any_N |
ZoeD_Any_K |
Any_S |
Any_B |
Any_L |
Any_V2_S |
Any_V2_B |
Any_V2_L |
Any_V2_N_S |
Any_V2_N_B |
Any_V2_N_L |
Any_V2_K_S |
Any_V2_K_B |
Any_V2_K_L |
Personally, I recommend ZoeD_N
, Any_B
or ZoeD_Any_N
. ZoeD_Any_N
looks the best for 3D scene. The DepthAnything models have more accurate foreground and background segmentation, but the foreground looks slightly flat.
For art/anime, DepthAnything is better than ZoeDepth.
These models are licensed under cc-by-nc-4.0 (Non Commercial). These are not available by default due to conflicts with nunif MIT license.
If you want to use it, agree to the pre-trained model license and place the checkpoint file yourself.
Short Name | Path |
---|---|
Any_V2_B | iw3/pretrained_models/hub/checkpoints/depth_anything_v2_vitb.pth |
Any_V2_L | iw3/pretrained_models/hub/checkpoints/depth_anything_v2_vitl.pth |
Any_V2_N_L | iw3/pretrained_models/hub/checkpoints/depth_anything_v2_metric_hypersim_vitl.pth |
Any_V2_K_L | iw3/pretrained_models/hub/checkpoints/depth_anything_v2_metric_vkitti_vitl.pth |
These files can be downloaded from Models section of https://huggingface.co/depth-anything
I have tested the results with the following software.
Pigasus works perfectly for SBS 3D videos, images, and Samba drive(SMB). However, I am not a big fan of its user interface and user experience.
If you can only choose one software, I would recommend this one.
With recent updates(v1.1.6), most features of 3D Full SBS are now working. However, the following features have not yet been implemented.
VR Player detects media format by filename. Adding _LRF_Full_SBS
suffix to the filename will identify the file as full side-by-side 3D media.
When specifying a directory with -o
option, it is automatically output as a filename with {original_filename}_LRF_Full_SBS.(png|mp4)
.
Reference:
LRF
https://hanginghatstudios.com/pigasus-faq/#acc-tb_obg1300-0Full_SBS
, https://forum.skybox.xyz/d/2161-skybox-vr-quest-v116-added-multi-language-keyboard-and-castingSBS
or LR
(LRF
seems to not work), https://deovr.com/app/doc#namingI confirmed that _LRF_Full_SBS
works with all of the above software.
When --vr180
option is specified, the video is output in VR180 format (equirectangular).
This is usually not recommended because of poor usability during playback.
This is useful if your video player does not have the ability to play Full SBS 3D videos or if you want to post the video on Youtube.
When --half-sbs
option is specified, the video is output in Half SBS format (subsampled at half resolution).
Older VR devices may only support this format. Also, you may need to add _3dh_
to the filename to play it.
When --tb
or --half-tb
option is specified, the video is output in TopBottom format.
TopBottom format can be played back with higher resolution than SBS on some 3D TVs (Polarized/Passive 3D system).
When --anaglyph
option is specified, the video is output in Red-Cyan Anaglyph 3D format.
(On GUI, select Anaglyph *
option in Stereo Format
)
Currently, the following methods are supported.
Method |
---|
color |
half-color |
gray |
wimmer |
wimmer2 |
dubois |
dubois2 |
Reference:
For video, I recommend --pix-fmt yuv444p
or --pix-fmt rgb24
option. yuv420p
(by default) uses 4:2:0 chroma subsampling, red colors are degraded and cause ghosting artifacts (crosstalk).
JPEG have the same problem so I recommend using PNG (by default) instead.
Also, --convergence 0.5 --divergence 2.0
is recommended.
This tends to happen with outdoor scene photos.
There are several ways to fight this problem.
--foreground-scale 3
option--remove-bg
option--divergence 4 --convergence 0 --foreground-scale 3 --remove-bg
When --remove-bg
is specified, the background area is removed using rembg with U2-net's human segmentation model, before estimating depthmap.
Please post to the issue about the format of the video.
By default, FPS is limited to 30fps. Use --max-fps 128
option.
This is a problem with SBS 3D video that it cannot be rendered in actual size scale.
You can try adjusting scale manually.
--ipd-offset
option(You own size
in GUI) to adjust IPD offsetIt is better to adjust IPD offset on VR Player, but you can also apply IPD offset to the output image.
On SKYBOX Player, set the 3D effect slider to around < -0.3.
On Pigasus, set Settings > Advanced Settings > IPD
slider to large.
Also, on Pigasus, you can zoom and pan the image by double-clicking the trigger button on the VR controller.
Use --low-vram
option.
I tested this program on RTX 3070 Ti (8GB VRAM, Linux) and GTX 1050 Ti (4GB VRAM, Laptop, Windows). Both work with the default option.
Use --rotate-left
(rotate 90 degrees to counterclockwise) or --rotate-right
(rotate 90 degrees to clockwise) option to fix the rotation.
Use --vf yadif
option to deinterlace the video source. You can use ffmpeg's video filter with --vf
option.
Note that
See https://ffmpeg.org/ffmpeg-filters.html
When preset=slower|veryslow|placebo
is used for high resolution video, it may produce video files that are not supported by hardware decoder. If you have been using that setting, try preset=medium
.
First check the results with a few samples. There are two ways.
The following command processes video keyframes about every 4 seconds and outputs the result as 3D photos (image files).
python -m iw3 --keyframe --keyframe-interval 4 -i input_video.mp4 -o output_dir/
The following command processes video frames every 2 seconds and outputs the result as 3D slideshow-like video (video file).
python -m iw3 --max-fps 0.5 -i input_video.mp4 -o output_dir/
If the results are acceptable, process the full video.
--method row_flow
(by default) is currently only trained for the range 0.0 <= divergence <= 2.5
and 0.0 <= convergence <= 1.0
.
https://github.com/nagadomi/nunif/blob/master/iw3/README.md
Check this 2d to 3d converter . It works better then some of the best subscription software
Made some scripts for using depth anything to process videos and using disparity mapping in python thought I would share here. Could probably do with some cleanup and a gui.
I'm just starting to try my hand at 3D conversions. Bought a sub to Owl3D for starters, but every time I try a conversion, it seems to freeze at 1% (Process Frame Dynamics). According to my PC monitoring, the CPU (i9) and GPU (RTX 4080) are both at 0%, so it's not doing anything.
I've tried it several times with the same result. Anyone else have this issue with Owl3D?
As u can see the black borders added are set up and keying out the background thus bringing the foreground above the border giving that super pop out effect that will be amazing in bigscreen vr. This effect seems to be achieved the best when u use small black borders to big and it’s to much for ur eyes to small and u lose the effect all together. This is a game changer.
Hope u guys enjoy it’s in parallel view so it is Vr ready.
So! i added a lens distortion giving the 2d video a fisheye lens effect as similar as possible to the effect a 360 or 180 degree camera lens set up might produce and now im running it through 3dcombine6 creating a side by side 3D version of it simulating a depth camera, essentially if done correctly i may be able to achieve a relatively viewable 180 degree vr video experience use parallel method for viewing the sample in the picture.