Mice and primates use distinct strategies for visual segmentation
- PMID: 36790170
- PMCID: PMC9981152
- DOI: 10.7554/eLife.74394
Mice and primates use distinct strategies for visual segmentation
Abstract
The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is 'figure-ground segmentation', the delineation of figures as distinct from backgrounds. To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed that the texture dependence of both the mouse's behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.
Keywords: evolutionary biology; macaque; mouse; mouse lemur; mouse vision; neuroscience; object localization; rhesus macaque; segmentation; treeshrew.
© 2023, Luongo, Liu et al.
Conflict of interest statement
FL, LL, CH, JH, JW, FL, DH, DT No competing interests declared
Figures
![Figure 1.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig1.gif)
![Figure 2.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig2.gif)
![Figure 2—figure supplement 1.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig2-figsupp1.gif)
![Figure 2—figure supplement 2.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig2-figsupp2.gif)
![Figure 3.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig3.gif)
![Figure 4.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig4.gif)
![Figure 5.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig5.gif)
![Figure 5—figure supplement 1.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig5-figsupp1.gif)
![Figure 6.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig6.gif)
![Figure 7.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig7.gif)
![Figure 7—figure supplement 1.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig7-figsupp1.gif)
![Figure 7—figure supplement 2.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig7-figsupp2.gif)
![Figure 7—figure supplement 3.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-fig7-figsupp3.gif)
![Author response image 1.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-sa2-fig1.gif)
![Author response image 2.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-sa2-fig2.gif)
![Author response image 3.](https://cdn.statically.io/img/www.ncbi.nlm.nih.gov/pmc/articles/instance/9981152/bin/elife-74394-sa2-fig3.gif)
Update of
- doi: 10.1101/2021.07.04.451059
Similar articles
-
Figure-ground segmentation based on motion in the archerfish.Anim Cogn. 2024 Apr 15;27(1):33. doi: 10.1007/s10071-024-01873-7. Anim Cogn. 2024. PMID: 38616235 Free PMC article.
-
Functional modules for visual scene segmentation in macaque visual cortex.Proc Natl Acad Sci U S A. 2023 Aug 8;120(32):e2221122120. doi: 10.1073/pnas.2221122120. Epub 2023 Jul 31. Proc Natl Acad Sci U S A. 2023. PMID: 37523552 Free PMC article.
-
Pattern and Component Motion Responses in Mouse Visual Cortical Areas.Curr Biol. 2015 Jun 29;25(13):1759-64. doi: 10.1016/j.cub.2015.05.028. Epub 2015 Jun 11. Curr Biol. 2015. PMID: 26073133 Free PMC article.
-
Representation of Naturalistic Image Structure in the Primate Visual Cortex.Cold Spring Harb Symp Quant Biol. 2014;79:115-22. doi: 10.1101/sqb.2014.79.024844. Epub 2015 May 5. Cold Spring Harb Symp Quant Biol. 2014. PMID: 25943766 Free PMC article. Review.
-
Central neural mechanisms for detecting second-order motion.Curr Opin Neurobiol. 1999 Aug;9(4):461-6. doi: 10.1016/S0959-4388(99)80069-5. Curr Opin Neurobiol. 1999. PMID: 10448168 Review.
Cited by
-
Modular horizontal network within mouse primary visual cortex.Front Neuroanat. 2024 Apr 8;18:1364675. doi: 10.3389/fnana.2024.1364675. eCollection 2024. Front Neuroanat. 2024. PMID: 38650594 Free PMC article.
-
Figure-ground segmentation based on motion in the archerfish.Anim Cogn. 2024 Apr 15;27(1):33. doi: 10.1007/s10071-024-01873-7. Anim Cogn. 2024. PMID: 38616235 Free PMC article.
-
Efficient coding of natural images in the mouse visual cortex.Nat Commun. 2024 Mar 19;15(1):2466. doi: 10.1038/s41467-024-45919-3. Nat Commun. 2024. PMID: 38503746 Free PMC article.
-
Involvement of superior colliculus in complex figure detection of mice.Elife. 2024 Jan 25;13:e83708. doi: 10.7554/eLife.83708. Elife. 2024. PMID: 38270590 Free PMC article.
-
Functional modules for visual scene segmentation in macaque visual cortex.Proc Natl Acad Sci U S A. 2023 Aug 8;120(32):e2221122120. doi: 10.1073/pnas.2221122120. Epub 2023 Jul 31. Proc Natl Acad Sci U S A. 2023. PMID: 37523552 Free PMC article.
References
-
- Berens P, Freeman J, Deneux T, Chenkov N, McColgan T, Speiser A, Macke JH, Turaga SC, Mineault P, Rupprecht P, Gerhard S, Friedrich RW, Friedrich J, Paninski L, Pachitariu M, Harris KD, Bolte B, Machado TA, Ringach D, Stone J, Rogerson LE, Sofroniew NJ, Reimer J, Froudarakis E, Euler T, Román Rosón M, Theis L, Tolias AS, Bethge M. Community-Based benchmarking improves spike rate inference from two-photon calcium imaging data. PLOS Computational Biology. 2018;14:e1006157. doi: 10.1371/journal.pcbi.1006157. - DOI - PMC - PubMed
-
- Brendel W, Bethge M. Approximating CNNs with Bag-of-Local-Features Models Works Surprisingly Well on ImageNet. arXiv. 2019 doi: 10.48550/arXiv.1904.00760. http://arxiv.org/abs/1904.00760 - DOI
-
- Chen H, Venkatesh R, Friedman Y, Wu J, Tenenbaum JB, Yamins DLK, Bear DM. Unsupervised Segmentation in Real-World Images via Spelke Object Inference. arXiv. 2022 doi: 10.48550/arXiv.2205.08515. http://arxiv.org/abs/2205.08515 - DOI
Publication types
MeSH terms
Associated data
Grants and funding
LinkOut - more resources
Full Text Sources