I try to understand more about the update in multivariate fixed point iteration. I saw the examples where the updates have the same variable (the wrt. variable of partial differentiation) on both sides of update equation

$$H_{kj} = \frac{H_{kj}}{\sum_{i}\sum_{k}W_{ik}H_{kj}}$$ $$W_{ik} = \frac{W_{ik}}{\sum_{j}\sum_{k}W_{ik}H_{kj}}$$

I think I also saw the update that the wrt variable is on the LHS. Are there any differences between these two ways? And is it possible that the set of updates for each variable can be mixed: some variables are on the both side of update equation and some are not like this below?

$$H_{lkj} = \sum_{i}\phi_{lki}V_{ij}/\sigma_{l}$$ $$\phi_{lki} = \sum_{j}H_{lkj}V_{ij}/\sigma_{l}$$ $$\sigma_{l} = \sigma_{l}(\sum_{ij}V_{ij}+)\sum_{ijk}\phi_{lki}V_{ij}$$


Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.