Every spring, river herring populations migrate from Massachusetts coastal waters to start their annual journey up rivers and streams to freshwater spawning habitat. River herring have confronted extreme inhabitants declines over the previous a number of many years, and their migration is extensively monitored throughout the area, primarily via conventional visible counting and volunteer-based applications.
Monitoring fish motion and understanding inhabitants dynamics are important for informing conservation efforts and supporting fisheries administration. With the annual herring run getting underway this month, researchers and useful resource managers as soon as once more tackle the problem of counting and estimating the migrating fish inhabitants as precisely as attainable.
A workforce of researchers from the Woodwell Local weather Analysis Heart, MIT Sea Grant, the MIT Laptop Science and Synthetic Intelligence Lab (CSAIL), MIT Lincoln Laboratory, and Intuit explored a brand new monitoring methodology utilizing underwater video and pc imaginative and prescient to complement citizen science efforts. The researchers — Zhongqi Chen and Linda Deegan from the Woodwell Local weather Analysis Heart, Robert Vincent and Kevin Bennett from MIT Sea Grant, Sara Beery and Timm Haucke from MIT CSAIL, Austin Powell from Intuit, and Lydia Zuehsow from MIT Lincoln Laboratory — revealed a paper describing this work within the journal Distant Sensing in Ecology and Conservation this February.
The open-access paper, “From snapshots to steady estimates: Augmenting citizen science with pc imaginative and prescient for fish monitoring,” outlines how current developments in pc imaginative and prescient and deep studying, from object detection and monitoring to species classification, supply promising real-world options for automating fish counting with improved effectivity and knowledge high quality.
Conventional monitoring strategies are constrained by time, environmental circumstances, and labor depth. Volunteer visible counts are restricted to transient daytime sampling home windows, lacking nighttime motion and brief migration pulses, when a whole lot of fish move by throughout the span of some minutes. Whereas applied sciences like passive acoustic monitoring and imaging sonar have superior steady fish monitoring below sure circumstances, essentially the most promising and low-cost possibility — guide evaluation of underwater video — continues to be labor-intensive and time-consuming. With the rising demand for automated video processing options, this research presents a scalable, cost-effective, and environment friendly deep learning-based system for dependable automated fish monitoring.
The workforce constructed an end-to-end pipeline — from in-field underwater cameras to video labeling and mannequin coaching — to attain automated, pc vision-powered fish counting. Movies had been collected from three rivers in Massachusetts: the Coonamessett River in Falmouth, the Ipswich River (Ipswich), and the Santuit River in Mashpee.
To arrange the coaching dataset, the workforce chosen video clips with variations in lighting, water readability, fish species and density, time of day, and season to make sure that the pc imaginative and prescient mannequin would work reliably throughout various real-world situations. They used an open-source internet platform to manually label the movies frame-by-frame with bounding containers to trace fish motion. In whole, they labeled 1,435 video clips and annotated 59,850 frames.
The researchers in contrast and validated the pc imaginative and prescient counts with human video critiques, stream-side visible counts, and knowledge from passive built-in transponder (PIT) tagging. They concluded that fashions skilled on various multi-site and multi-year knowledge carried out finest and produced season-long, high-resolution counts in step with historically established estimates. Going one step additional, the system offered insights into migration habits, timing, and motion patterns linked to environmental components. Utilizing video from the 2024 Coonamesset River migration, the system counted 42,510 river herring and revealed that upstream migration peaked at daybreak, whereas downstream migration was largely nocturnal, with fish using darker, quieter intervals to keep away from predators.
With this real-world utility, the researchers intention to advance pc imaginative and prescient in fisheries administration and supply a framework and finest practices for integrating the expertise into conservation efforts for a variety of aquatic species. “MIT Sea Grant has been funding work on this matter for a while now, and this glorious work by Zhongqi Chen and colleagues will advance fisheries monitoring capabilities and enhance fish inhabitants assessments for fisheries managers and conservation teams,” Vincent says. “It should additionally present training and coaching for college kids, the general public, and citizen science teams in help of the ecologically and culturally vital river herring populations alongside our coasts.”
Nonetheless, continued conventional monitoring is important for sustaining consistency in long-term datasets till fisheries administration companies totally implement automated counting techniques. Even then, pc imaginative and prescient and citizen science must be seen as complementary. Volunteers will likely be mandatory for digital camera upkeep and for contributing on to the pc imaginative and prescient workflow, from video annotation to mannequin verification. The researchers envision that integrating citizen observations and pc vision-generated knowledge will assist create a extra complete and holistic strategy to environmental monitoring.
This work was funded by MIT Sea Grant, with extra help offered by the Northeast Local weather Adaptation Science Heart, an MIT Abdul Latif Jameel Water and Meals Techniques seed grant, the AI and Biodiversity Change World Heart (supported by the Nationwide Science Basis and the Pure Sciences and Engineering Analysis Council of Canada), and the MIT Undergraduate Analysis Alternatives Program.
