.png){kind=icon}
返回
Rendering acceleration based on JND-guided sampling prediction
.png){kind=icon}
PRE
AI
DOI：10.1007/s00530-023-01238-z.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
When using Monte Carlo Path Tracing (MCPT) method to render 3D scenes, artifacts may occur due to insufficient sampling, and directly increasing the number of samples can increase the time cost of the rendering algorithm. An effective strategy is to adaptively allocate the number of samples per pixel in an iterative manner. However, iterative operations introduce additional computational overhead during the rendering process. To solve this problem, we proposed a rendering acceleration method that does not require iterative computation. This method combines the Just Noticeable Difference (JND) information and uses a neural network to predict the sampling matrix of the scene, which is adjusted based on the lighting information in the pre-rendered image. First, we extract the JND information of pre-rendered images during the preprocessing and estimate the fast convergence regions in the scene (such as environment map regions, light source regions, etc.). Then, we use Conv-LSTM to estimate the JND features of high-quality rendered images. We design a multi-feature fusion network to predict the number of samples required for each pixel during the rendering process. The network takes the preprocessed pre-rendered images as the input of the encoder, which are fused with the output of Conv-LSTM as the input of the decoder to output the corresponding sampling matrix. In addition, we noticed that areas with darker lighting are more difficult to converge during the rendering process. Therefore, we calculated the lighting clustering results of the pre-rendered image and adjusted the sampling matrix output by the sampling prediction model based on the lighting clustering results. The experimental results indicate that our method has better performance compared to the current methods.
Keyword:
Rendering acceleration
Rendering sampling
JND
Visual perception
期刊
IF:
3.1
论文数:
2.8K
被引数:
2.7K
机构
引用论文
.png){kind=icon}
Gender Differences in the Risk of Ischemic Heart Disease According to Healthcare Utilization and Medication Adherence among Newly Treated Korean Hypertensive Patients根据医疗资源利用和药物治疗依从性，新治疗韩国高血压患者缺血性心脏病风险的性别差异
OAAI
OAAI分享收藏分享收藏Estimation of the true infection rate and infection fatality rate of coronavirus disease 2019 in each country估计每个国家2019冠状病毒病的真实感染率和感染病死率OAAI
OAAI分享收藏Association Between Work Absence and Health Services Utilization and Costs Among Employed Individuals With Arthritis关节炎患者工作缺勤与卫生服务利用及成本之间的关联
PREAI
分享收藏
查看更多内容