Skip to main content

A New Algorithm for Multimodal Soft Coupling

  • Conference paper
  • First Online:
Latent Variable Analysis and Signal Separation (LVA/ICA 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10169))

Abstract

In this paper, the problem of multimodal soft coupling under the Bayesian framework when variance of probabilistic model is unknown is investigated. Similarity of shared factors resulted from Nonnegative Matrix Factorization (NMF) of multimodal data sets is controlled in a soft manner by using a probabilistic model. In previous works, it is supposed that the probabilistic model and its parameters are known. However, this assumption does not always hold. In this paper it is supposed that the probabilistic model is already known but its variance is unknown. So the proposed algorithm estimates the variance of the probabilistic model along with the other parameters during the factorization procedure. Simulation results with synthetic data confirm the effectiveness of the proposed algorithm.

This work has been partly supported by the European project ERC-2012-AdG-320684-CHESS and also by the Center for International Scientific Studies and Collaboration (CISSC).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lahat, D., Adalı, T., Jutten, C.: Challenges in multimodal data fusion. In: 2014 22nd European Signal Processing Conference (EUSIPCO), pp. 101–105 September 2014

    Google Scholar 

  2. Acar, E., Kolda, T.G., Dunlavy, D.M.: All-at-once optimization for coupled matrix and tensor factorizations. arXiv preprint arXiv:1105.3422 (2011)

  3. Acar, E., Rasmussen, M.A., Savorani, F., Næs, T., Bro, R.: Understanding data fusion within the framework of coupled matrix and tensor factorizations. Chemometr. Intell. Lab. Syst. 129, 53–63 (2013)

    Article  Google Scholar 

  4. Seichepine, N., Essid, S., Févotte, C., Cappé, O.: Soft nonnegative matrix co-factorization. IEEE Trans. Signal Process. 62(22), 5940–5949 (2014)

    Article  MathSciNet  Google Scholar 

  5. Rivet, B., Duda, M., Guérin-Dugué, A., Jutten, C., Comon, P.: Multimodal approach to estimate the ocular movements during EEG recordings: a coupled tensor factorization method. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6983–6986 (2015)

    Google Scholar 

  6. Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: Advances in Neural Information Processing Systems, pp. 556–562 (2001)

    Google Scholar 

  7. Farias, R.C., Cohen, J.E., Comon, P.: Exploring multimodal data fusion through joint decompositions with flexible couplings. IEEE Trans. Signal Process. 64(18), 4830–4844 (2016)

    Article  MathSciNet  Google Scholar 

  8. Ozerov, A., Févotte, C.: Multichannel nonnegative matrix factorization in convolutive mixtures for audio source separation. IEEE Trans. Audio Speech Lang. Process. 18(3), 550–563 (2010)

    Article  Google Scholar 

  9. Seichepine, N., Essid, S., Févotte, C., Cappé, O.: Soft nonnegative matrix co-factorizationwith application to multimodal speaker diarization. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 3537–3541, May 2013

    Google Scholar 

  10. Sawada, H., Kameoka, H., Araki, S., Ueda, N.: Multichannel extensions of nonnegative matrix factorization with complex-valued data. IEEE Trans. Audio Speech Lang. Process. 21(5), 971–982 (2013)

    Article  Google Scholar 

  11. Févotte, C., Bertin, N., Durrieu, J.L.: Nonnegative matrix factorization with the itakura-saito divergence: with application to music analysis. Neural Comput. 21(3), 793–830 (2009)

    Article  MATH  Google Scholar 

  12. Févotte, C.: Majorization-minimization algorithm for smooth itakura-saito nonnegative matrix factorization. In: 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1980–1983, May 2011

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Farnaz Sedighin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Sedighin, F., Babaie-Zadeh, M., Rivet, B., Jutten, C. (2017). A New Algorithm for Multimodal Soft Coupling. In: Tichavský, P., Babaie-Zadeh, M., Michel, O., Thirion-Moreau, N. (eds) Latent Variable Analysis and Signal Separation. LVA/ICA 2017. Lecture Notes in Computer Science(), vol 10169. Springer, Cham. https://doi.org/10.1007/978-3-319-53547-0_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-53547-0_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-53546-3

  • Online ISBN: 978-3-319-53547-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics