In a UK-first, Insight360 uses machine learning to combine voice transcription and video information to deliver real-time insight, creating a 360-degree view of your experience at sea.
But what do we mean by a 360-degree view? This is generated by stitching together layers of data about what’s happening at sea when you are fishing, during a wildlife sighting or bycatch event. Insight360’s voice-transcription component records the accounts of those onboard, layering this knowledge over video footage, to build a 360-degree view that continuously improves over time.
GPS captures the location and cameras automatically record the haul. Onboard microphones use voice recognition to capture the observations of the skipper and crew, hands-free – meaning those onboard can speak directly to the system and describe the sighting or event, while they work.
A speech to text engine transcribes these notes, while machine learning uses targeted snippets of video and audio data to provide a 360 degree view of the event. This is then sent back to the Insight360 team onshore for analysis, offering new insights.
Over time Insight360 will learn to recognise bycatch in a net. One day, it may help to better understand cetacean behaviours and prevent bycatch happening in the first place.
The technology used is simple, pre-existing and affordable. Insight360 combines these components in a new way, offering a step-change in bycatch monitoring and amplifying the voices of those with the most experience – fishers themselves.
Engineered, tested and continuously refined with commercial fishermen, Insight360 allows you to record interactions with non-target marine life in a way that fits the practicalities of being at sea and working aboard a fishing vessel. Delivering real-time insight, with Insight360:
Information
When activated onboard, a voice recorder captures the crew's observations when they speak about cetacean behaviour or detail a bycatch event.
Data
All lightweight and hands-free tech, a voice-to-text converter transcribes these notes, cameras film the haul and GPS flags the location.
360° Insight
Machine learning then combines this data and information to provide a 360° view of fishing activity, cetacean sightings, and bycatch events.
Refined with fishing industry participants who have been integral to the design, development, testing and practical application of the tool, Insight360’s Beta system is currently undergoing sea trials aboard five commercial vessels working off the South West of England.
Involved in the Insight360 story from the start, these fishermen work closely with our engineering team, providing their expertise to ensure the tool is practically suited to the needs of fishing – from installation and functionality to the bespoke needs of different fisheries.
Based on their feedback, since its initial test Alpha phase, Insight360 has been enhanced to incorporate additional functionality such as automatic haul detection and a user interface via which those onboard can view what Insight360 is recording.
The system also boasts the ability to host multiple cameras, meaning it can capture sightings data as well as record hauls. And because there’s no such thing as one size fits all when it comes to fishing, additional bespoke components to suit different gear types are currently being explored.
During trials, Insight360 will be regularly tested, evaluated, and updated with our partners onboard. Following their completion in the summer of 2024, all systems will be upgraded to a final model, co-created with industry. Our end goal is the development of a system that can automatically detect a bycatch event and capture a fisherman’s spoken notes.
Along with increasing our understanding of bycatch events, with the Insight360 tool we can also begin to see how often bycatch is not occurring and gain a better understanding into the level of bycatch in a specific fishery.