2025 Hyper Recent •CC0 1.0 Universal

This work is dedicated to the public domain. No rights reserved.

Access Preprint From Server
June 3rd, 2025
Version: 1
Vanderbilt University
animal behavior and cognition
biorxiv

Assessing Attentiveness and Cognitive Engagement across Tasks using Video-based Action Understanding in Non-Human Primates

Cheung, S.-M.Open in Google Scholar•Neumann, A.Open in Google Scholar•Womelsdorf, T.Open in Google Scholar

Background: Distractibility and attentiveness are cognitive states that are expressed through observable behavior. The effective use of behavior observed in videos to diagnose periods of distractibility and attentiveness is still not well understood. Video-based tools for classifying cognitive states from behavior have high potential to serve as versatile diagnostic indicators of maladaptive cognition. New method: We describe an analysis pipeline that classifies cognitive states using a 2-camera set-up for video-based estimation of attentiveness and screen engagement in nonhuman primates performing cognitive tasks. The procedure reconstructs 3D poses from 2D labeled DeepLabCut videos, reconstructs the head/yaw orientation relative to a task screen, and arm/hand/wrist engagements with task objects, to segment behavior into an attentiveness and engagement score. Results: Performance of different cognitive tasks were robustly classified from video within a few frames, reaching >90% decoding accuracy with [≤]3min time segments. The analysis procedure allows setting subject-specific thresholds for segmenting subject specific movements for a time-resolved scoring of attentiveness and screen engagement. Comparison with existing methods: Current methods also extract poses and segment action units; however, they haven\'t been combined into a framework that enables subject-adjusted thresholding for specific task contexts. This integration is needed for inferring cognitive state variables and differentiating performance across various tasks. Conclusion: The proposed method integrates video segmentation, scoring of attentiveness and screen engagement, and classification of task performance at high temporal resolution. This integrated framework provides a tool for assessing attention functions from video.

Similar Papers

biorxiv
Thu Jun 05 2025
Deep learning from videography as a tool for measuring E. coli infection in poultry
Poultry farming is threatened by regular outbreaks of Escherichia coli (E. coli) that lead to significant economic losses and public health risks. However, traditional surveillance methods often lack sensitivity and scalability. Early detection of infected poultry using minimally invasive procedures is thus essential for preventing epidemics. To that end, we leverage recent advancements in compute...
Scheidwasser, N.
•
Poulsen, L. L.
•
Leow, P. R.
•
Khurana, M. P.
...•
Duchene, D. A.
biorxiv
Thu Jun 05 2025
Aggressive trait selection influences life-history trade-offs, favoring survival over reproductive success in Drosophila melanogaster males
Life history traits are all essential traits linked to development, survival and reproduction, directly influencing individual fitness. Limited environmental or physiological resources force organisms to balance competing demands, leading to fundamental trade-offs, particularly between survival and reproduction. Male aggression often enhances reproductive success by improving resource acquisition ...
Defert, A.
•
Gout, R.
•
Pennot, G.
•
Jamme, F.
...•
Trannoy, S.
biorxiv
Thu Jun 05 2025
Solo songs, duets, and territory defense across seasons in female Galapagos Yellow Warblers (Setophaga petechia aureola)
While the function of bird song has been well studied in male songbirds, the function of female song is less well understood. This is partly due to a historical view of females occupying a passive role compared with males, which led to ignoring female song even in some well-studied species. We report one such case in yellow warblers (Setophaga petechia), as no other study investigated female song ...
Yelimlies, A.
•
Alban Morales, K.
•
Akcay, C.
•
Kleindorfer, S.
biorxiv
Thu Jun 05 2025
Fentanyl reinforcement history has sex-specific effects on multi-step decision-making
It is commonly thought that drug addiction involves a transition to habitual control of action, where the choice to consume drugs becomes automatized and reflects a failure to deliberate over possible negative outcomes. Determining whether the pursuit of addictive drugs is habitual is hampered by a lack of behavior assessments suitable for use during a bout of drug seeking. Therefore, to understan...
Garr, E.
•
Cheng, Y.
•
Dong, A.
•
Janak, P. H.
biorxiv
Wed Jun 04 2025
Motor deficits in the McGill-R-Thy1-APP transgenic rat model of Alzheimer's Disease
The McGill-R-Thy1-APP rat is a transgenic model of Alzheimers Disease (AD) which expresses APP with two mutations found in cases of familial AD, resulting in the development of amyloid pathology and cognitive deficits. Motor deficits are common symptoms of AD, emerging early in the disease, and are correlated with AD neuropathology and cognitive symptoms. This study evaluated heterozygous and homo...
Roddick, K.
•
Northrup, P. A.
•
Schellinck, H. M.
•
Brown, R. E.
biorxiv
Wed Jun 04 2025
Underappreciated role of environmental enrichment in alleviating depression and anxiety: Quantitative evidence synthesis of rodent models
Environmental enrichment has long been recognized as a non-pharmacological intervention to mitigate mental health issues, yet its efficacy, and heterogeneity of treatment effects across experimental contexts remain underexplored. Heterogeneity of treatment effects, which reflects variability in individual responses to interventions, is a critical factor in determining the generalizability and pers...
Yang, Y.
•
Liu, M.
•
Morrison, K.
•
Lagisz, M.
•
Nakagawa, S.
biorxiv
Wed Jun 04 2025
BuzzWatch: uncovering multi-scale temporal patterns in mosquito behavior through continuous long-term monitoring
Understanding the temporal dynamics of mosquito behavior is essential for developing effective interventions against pathogen transmission. However, limited knowledge exists about the environmental, physiological, and genetic factors influencing mosquito activity patterns. This knowledge gap is partly due to a lack of tools to accurately quantify the behavior of free-flying mosquitoes over extende...
Maire, T.
•
Wan, Z.
•
Lambrechts, L.
•
Hol, F. J.
biorxiv
Tue Jun 03 2025
Cadences of the Collective: Conspecific Stimulation Patterns Interact with Endogenous Rhythms to Cue Socially Mediated Response Shifts
Many animals form behavioral collectives, and optimal interaction patterns often differ across social contexts. Sensory scenes generated by many interacting conspecifics are complex. Thus, maintaining socially-calibrated interaction patterns necessitates that individuals distill key features from conspecific scenes to guide continued adjustments to social fluctuations. Tungara frogs produce mating...
Larter, L. C.
•
Cushing, C. W.
•
Ryan, M. J.
biorxiv
Tue Jun 03 2025
How bats exit a crowded colony when relying on echolocation only - a modeling approach
Bats face a complex navigation challenge when emerging from densely populated roosts, where vast numbers take off at once in dark, confined spaces. Each bat must avoid collisions with walls and conspecifics while locating the exit, all amidst overlapping acoustic signals. This crowded environment creates the risk of acoustic jamming, in which the calls of neighboring bats interfere with echo detec...
Mazar, O.
•
Yovel, Y.
biorxiv
Tue Jun 03 2025
Group handling using Mus-Bus, a cage-transfer cum enrichment device reduces stress, anxiety and time taken for cage changes and enhances voluntary interaction in C57BL/6NCrl mice
It has been proven that tail-lifting mice can cause stress, anxiety and aversive behaviour, and this finding has made scientists develop less stressful techniques like cupping and tunnel-handling. All these techniques have a disadvantage in that they can only handle mice individually and not in groups. This study produces scientific evidence on the advantages of group handling of laboratory mice f...
Vijayakumar Sreelatha, H.
•
Prajapati, A. K.
•
Mehta, K.