AI – Gravity Media

*English version below

AI & Innovatie bij Gravity Media

Slimmer en efficiënter werken, sneller produceren en meer ruimte voor creativiteit; dat is de belofte van AI. Maar de toekomst van media wordt niet alleen bepaald door veranderende technologie, ook door de mensen die ermee werken. Daarom krijgt kunstmatige intelligentie binnen Gravity Media steeds meer vorm, in de producties, maar vooral onder collega’s. Innovatie is voor Gravity Media geen afdeling, maar een houding. “Bedenken wat we nóg beter, efficiënter, slimmer of sneller kunnen, daar krijgen wij energie van.”

AI is allang geen ver-van-je-bedshow meer voor Gravity Media. Al jaren wordt er geëxperimenteerd met toepassingen die het werk efficiënter en kwalitatief beter maken. Dat begon jaren geleden al met speech-to-text: het automatisch omzetten van spraak in tekst, zodat redacties sneller materiaal kunnen doorzoeken. “Toen was de techniek nog pril,” vertelt product- en innovatiemanager Cafer Poslu, “maar inmiddels is de nauwkeurigheid zo goed dat we de data direct kunnen gebruiken in de montage. Daardoor kunnen editors bijvoorbeeld binnen enkele seconden alle fragmenten terugvinden waarin iemand over ‘blauwe schoenen’ praat. Dat scheelt enorm veel tijd.” AI speelt een sleutelrol in de toekomstvisie van Gravity Media. Cafer: “We zijn een facilitaire partij. Dat betekent dat klanten bij ons terechtkomen als ze expertise nodig hebben. Dan is het belangrijk dat wij weten wat er mogelijk is in de markt en hoe we dat kunnen toepassen. Niet alleen voor onszelf, maar juist voor onze klanten.”

Maatwerk

Om AI optimaal in de workflows te integreren kiest Gravity Media er bewust de toepassing in nauwe samenwerking met klanten vorm te geven. “We onderzoeken welke tools en technologieën het meest relevant en effectief zijn en hoe ze écht kunnen bijdragen aan het productieproces. Zo krijgen klanten niet alleen inzicht in wat er mogelijk is, maar ook in welke impact bepaalde toepassingen hebben op hun eigen workflow. Vanuit onze adviserende rol zetten we onze kennis en ervaring in om geschikte oplossingen te selecteren, testen en vertalen naar praktische tools die aantoonbare meerwaarde bieden, in efficiëntie, kwaliteit én tijdswinst.”

Mensenwerk

Technologie optimaliseert dus de processen, waardoor er meer tijd overblijft voor het creatieve vakmanschap. “AI mag nooit het menselijke vervangen,” benadrukt Cafer. “Het moet ons ondersteunen. Wij willen dat creatieven juist meer ruimte krijgen voor wat ze het liefst doen: maken. Als AI helpt om onze repeterende taken – het zogenaamde ‘monnikenwerk’ – uit handen te nemen, kunnen mensen zich richten op het creatieve proces. Dat is waar de kwaliteit vandaan komt.” Om AI breder te verankeren in de organisatie, worden collega’s gestimuleerd om te leren, experimenteren en hun kennis te delen. In summer schools konden ze laagdrempelig kennismaken met AI. Cafer: “Wat kan het, hoe gebruik je het, hoe prompt je goed? Want dat is een vak op zich: leren hoe je een AI-systeem aanstuurt om het juiste resultaat te krijgen. Die trainingen werken; mensen worden nieuwsgierig en gaan zelf ontdekken wat het voor hun werk kan betekenen.”

Changemakers

Cafer merkt dat AI voor velen nog een vaag gegeven kan zijn. “Je weet dat het er is, maar nog niet wat er allemaal mogelijk is en hoe je het moet toepassen. Daardoor blijft het een complex en ongrijpbaar iets.” Om het voor collega’s concreet te maken neemt Gravity Media deel aan het Changemakers-programma. Cafer: “Dat gaat verder dan alleen begrijpen wat AI is en hoe we het kunnen inzetten, het gaat ook om collega’s activeren. Hoe brengen we AI naar de voorgrond?” Negen maanden lang volgen deelnemers uit verschillende mediabedrijven een traject waarin AI, design thinking en persoonlijk leiderschap samenkomen. Bryan Boor, hoofd van de vakgroep Live Graphics, is een van de deelnemers: “Changemakers is een programma waarin je zoveel mogelijk bagage krijgt om uiteindelijk verandering teweeg te brengen in je eigen organisatie,” vertelt hij. “Je leert theoretisch wat AI is en hoe je het kunt inzetten om jouw problematiek op te lossen. Maar je werkt ook aan jezelf. Hoe presenteer je een idee, hoe overtuig je anderen, hoe neem je mensen mee in verandering? Dat maakt het programma zo sterk. We hoeven niet in negen maanden een product te lanceren. We moeten vooral een beweging starten. Dat AI iets normaals wordt binnen onze organisatie. Dat collega’s niet denken: ‘Dat is niets voor mij’, maar juist: ‘Wat kan ik ermee?’”

Dat past bij hoe Gravity Media innovatie ziet: als iets wat begint bij mensen. Cafer: “We kunnen de slimste tools hebben, maar zonder draagvlak gebeurt er niets. Daarom is het Changemakers-programma zo waardevol. Door kennis te delen, gaan we sneller vooruit. We willen met AI onze processen verbeteren en nieuwe diensten ontwikkelen, maar altijd op een manier die past bij wie we zijn: menselijk, betrokken en professioneel.”

ENGLISH VERSION BELOW

AI and innovation at Gravity Media

Work smarter, more efficient, produce faster, create more room for creativity. That is the promise of AI. But the future of media is shaped not only by changing technology, it is shaped by the people who use it. That is why artificial intelligence is taking on a bigger role within Gravity Media, in productions and especially among colleagues. For Gravity Media, innovation is not a department, it is a mindset. “Thinking about what we can do even better, more efficient, smarter or faster, that is what energises us.”

AI has long since stopped being something distant for Gravity Media. For years we have been experimenting with applications that make the work more efficient and improve quality. This started years ago with speech to text, the automatic conversion of speech to text so that editorial teams can search material more quickly. “The technology was still in its infancy back then,” says product and innovation manager Cafer Poslu, “but the accuracy is now so good that we can use the data directly in the edit. That allows editors to find within seconds all the clips in which someone talks about blue shoes. It saves a huge amount of time.”
AI plays a key role in Gravity Media’s vision for the future. Cafer: “We are a facilities partner. That means clients come to us when they need expertise. It is important that we know what is possible in the market and how we can apply it. Not only for ourselves, but above all for our clients.”

Tailor made

To integrate AI optimally into workflows, Gravity Media deliberately shapes each application in close collaboration with clients. “We research which tools and technologies are most relevant and effective and how they can truly contribute to the production process. That way clients gain insight into what is possible and into the impact that certain applications have on their own workflow. From our advisory role we use our knowledge and experience to select and test suitable solutions and translate them into practical tools that deliver proven added value in efficiency, quality and time savings.”

People first

Technology optimises processes, which leaves more time for creative craftsmanship. “AI should never replace the human element,” Cafer emphasizes. “It should support us. We want creatives to have more room for what they love to do most, to make. If AI helps to take repetitive tasks off our hands, the so called monk’s work, people can focus on the creative process. That is where quality comes from.”
To anchor AI more broadly in the organisation, colleagues are encouraged to learn, experiment and share knowledge. During summer schools they could get to know AI in an accessible way. Cafer: “What can it do, how do you use it, how do you prompt well. That is a discipline in its own right, learning how to steer an AI system to get the right result. These trainings work. People become curious and start discovering for themselves what it can mean for their work.”

Changemakers

Cafer notices that AI can still feel vague for many. “You know it is there, but not yet what is possible and how to apply it. That keeps it complex and elusive.” To make it concrete for colleagues, Gravity Media is taking part in the Changemakers program. Cafer: “It goes beyond understanding what AI is and how we can use it. It is also about activating colleagues. How do we bring AI to the foreground.”
For nine months, participants from different media companies follow a track in which AI, design thinking and personal leadership come together. Bryan Boor, head of the Live Graphics discipline, is one of the participants. “Changemakers is a program that gives you as much baggage as possible to ultimately bring about change in your own organisation,” he says. “You learn in theory what AI is and how you can deploy it to solve your challenges. You also work on yourself. How do you present an idea, how do you persuade others, how do you bring people along in change. That is what makes the program so strong. We do not have to launch a product in nine months. We mainly need to start a movement. That AI becomes something normal within our organization. That colleagues do not think, that is not for me, but rather, what can I do with it.”

That fits the way Gravity Media views innovation, as something that starts with people. Cafer: “We can have the smartest tools, but without support nothing happens. That is why the Changemakers program is so valuable. By sharing knowledge, we move forward faster. We want to improve our processes with AI and develop new services, but always in a way that matches who we are, human, engaged and professional.”

The Free University of Bozen led an experimentation (5VREAL) on systems using AI to recognize phases and parameters of play in Volleyball and to generate data associated with video to be used either at a strategic level (supporting the development of game tactics) or to increase fan engagement (Fan engagement) by producing highlights with real-time augmented reality graphics for inclusion in the event’s TV program.
As part of this experimentation, 5G network-based remote broadcast production techniques and technologies played a twofold role. The first, to make possible the capture of images and their transfer into the Edge Cloud that hosts the AI-based systems. The second, to enable the creation of real-time highlights and make them available for playout at the director’s office.

The 5VREAL project was the recipient of a MIMIT call aimed at promoting the use of the 5G network and computing resources in proximity data centers (Edge Datacenters or MECs) for audiovisual production and applications employing artificial intelligence.

The Free University of Bozen/Bolzano was the leader of a grouping of institutions and companies engaged in the development of technologies useful for achieving the goal. In particular, the Bruno Kessler Foundation (FBK) and UniBZ were involved in the development of artificial intelligence-based systems for analyzing game phases. Small Pixels developed and made available their AI-based technology for improving the video quality of content that has undergone compression processes. Taking advantage of the capacity and flexibility of its 5G network, Vodafone installed dedicated indoor coverage at the Trento sports hall to ensure the necessary performance for the mobile devices deployed there. It also built a private network that would allow them to connect with the Edge Computing resources set up inside EMG Italy’s MCR in Cologno Monzese.
EMG Italy built the entire technological infrastructure of the datacenter, made its production facilities available and oversaw the implementation of a low-latency remote contribution and production system based on what Vodafone has already experimented with its 5G Remote Media Production Platform.

The result of the trial was demonstrated at an event at The T-Quotidiano arena (sports hall in Trento). The comprehensive process set up by the partners allowed a volleyball match to be filmed with 4 cameras connected both in 5G to the remote production system at the edge datacenter in Cologno and to the Nova 126 mobile unit. In addition to the Broadcast cameras, the event was filmed with 3 Smartphones, also connected in 5G to the Edge Cloud in Cologno, to demonstrate the possibility of having all the AI-based tracking part even when the event is not produced for TV broadcast.

The result of the AI-based systems’ processing was displayed on a tablet where, in addition to the event video, game data extracted from the systems were scrolled through, while augmented reality-enriched clips were inserted into the event program in the form of highlights. The extracted data and generated content could also be consulted after the event for game analysis useful for developing game strategies.

Vodafone’s 5G Remote Media Production Platform and EMG Italy’s expertise

The trial thus benefited from the 5G network solution developed by Vodafone for remote video contribution and production applications, which was extended by adding the Edge Computing node built at EMG Italy’s Cologno Monzese MCR datacenter. In order to benefit from maximum performance in terms of low latency and reliability, the Edge Computing infrastructure has been made directly accessible from devices enabled on Vodafone’s 5G network through a direct and virtually dedicated connection.
In this way, devices equipped with special SIMs (not commercial SIMs, to be clear) benefit from advanced features such as network slicing, which reserves the necessary resources for them to have a relevant amount of bandwidth (especially in upload) and extremely low latency levels. Without these resources, they could not enable the transmission over wireless networks of high-quality video streams in real time.

Moreover, such devices benefit from a direct and dedicated connection, almost as if “there was a direct line” between the indoor coverage equipment in the arena and EMG’s Edge Cloud.
All thanks to the large capacity and advanced capabilities of Vodafone’s 5G infrastructure. In order to maximize the performance of its network for audiovisual contribution and production uses, Vodafone contributed to the development of dedicated devices that were acquired and managed by EMG Italy for the occasion.
These devices, which can be likened to “backpacks” commonly known in the broadcast industry, represent an “extreme” evolution of it in that, in addition to possessing audio/video capabilities superior to what is available on the market today, they add to technologies such as bonding a precise integration with the operator’s network.

The result is that, regardless of where in Italy one connects via one or more SIMs, data will arrive at the data center in Cologno Monzese in an average time of about 15 milliseconds without traversing the Internet and therefore without being impacted in terms of bandwidth availability and latency. In practice, what will impact the characteristics of the link (bandwidth and latency) will only be the quality of the radio access, which, however, is improved thanks to the characteristics of the terminal. In fact, the latter, in addition to being equipped with 5 latest-generation 5G network interfaces, also benefits from a case design designed to optimize radio performance. This is because, despite the benefits derived from the specific integration of the device into the network and the dedicated resources at the access level, the device plays a key role in that it must be able to take advantage of capabilities and technologies made available by the network in order to be able to perform very well.
In the course of the experimentation, and particularly in the Trento event, exceptional access performance was verified that allowed the terminals to have connectivity with more than 700Mb/s download and 100 Mb/s upload and with transport latencies always below 20ms.

The result is that, regardless of where in Italy one connects via one or more SIMs, the data arrives at the data center in Cologno Monzese in an average time of
Video contribution latency, thanks to the encoding and decoding performance of the devices and systems in the datacenter is always less than 150ms thus enabling the realization of any contribution or remote direction activity.
The experimentation also benefited from the technology made available by Small Pixels, which, thanks to its software developed together with the University of Florence and based on pre-trained artificial intelligence neural networks, allows for a clear increase in video quality with the same compression technology and available bandwidth.
In fact, the technology developed by Small Pixels proved crucial in eliminating visual artifacts such as pixelation, noise and distortion, on the contributions made by smartphones, helping to optimize both streaming and real-time transmission. This made it possible to use streams generated by ordinary smartphones to feed the UniBZ and FBK systems dedicated to game data analysis and ball tracking, as well as for all subsequent data interpretations.

The infrastructure created in EMG Italy’s datacenter in Cologno represents a consolidated asset that lends itself to future evolutions for the provision of new services similar to those implemented during the trial, namely: Remote Production, On-site Wireless Production, Video Analysis on AI-based systems, augmented reality content generation, etc. All with the simplicity and speed of deployment resulting from mobility over a 5G network.
“On the infrastructure of EMG Italy and Vodafone,” emphasizes Luca Bertoldi IT Manager of EMG Italy, “advanced solutions have been developed that allow to manage a director or MCR directly from remote locations, offering also the possibility to operate a mobile director.
It is enough to have an access point to Vodafone’s 5G network to control a direction and manage 3-4 cameras efficiently.”

Luca Sampietro, Product Marketing Manager 5G Vertical Solutions at Vodafone points out that “we have worked side by side with EMG Italy and the other members of the grouping not for the purpose of pure experimentation, but because we are confident that 5G can contribute strongly to innovating the broadcasting industry in a structural way.”

On Site Wireless Production

This is an adjunct workflow to remote production where, direction is done on handheld devices connected to the 5G network. The typical application could be for sporting events that take place outdoors and would be expensive to produce using traditional methods where the use of the program is more than just broadcasting. A typical example might be a mountain bike race where the organizer wants to have strong on-site audience engagement through ledwalls but also wants a streaming broadcast. A remote production solution would bring few benefits compared to using an OB truck, which would still be expensive. With this solution, taking advantage of the virtualized control room in the datacenter, cameras scattered around the competition grounds send signals that are displayed in real time on tablets (or notebooks that may also have dedicated control panels) from which video mixer, audio mixer, graphics, and clip contribution is managed. The program can thus be sent to both the streaming platform and the ledwall via a 5G device with SDI/HDMI/IP inputs and outputs.

The edge infrastructure currently available in the EMG Italy datacenter could safely handle up to 6 to 8 multi-camera events in different locations, with the signals carried via mobile devices specifically developed for Vodafone’s MMPP.
These systems, in addition to providing extremely low latency that allows for remote event direction, include broadcast-specific features such as multiple 12G SDI inputs and outputs to handle up to 4 video inputs or more than one video return simultaneously with 2 4K inputs for each device, along with two intercom circuits and other audio inputs/outputs; essential features for use in the broadcast environment.
Each device integrates five 5G modems and a high-performance encoding and decoding engine, capable of achieving encoding latencies of ½ frame.
EMG Italy’s platform design was overseen by Luca Sciotti, who has been active in supporting Vodafone in the development of the 5G Remote Media Production platform and mobile devices for several years now.

His comment on the sidelines of the trial results was, “These are solutions that, as they grow along with the coverage and performance of mobile networks, open up new production scenarios or improve the processes of existing ones. One thinks of the possibility of using these high-performance devices even in the studio where they can guarantee superior performance in terms of functionality, quality and latency to those of traditional radio camera systems, or the possibility of managing the production of an event totally on site without the need to move the expensive and cumbersome means that remain indispensable for high-level productions anyway.”

Contribution

Among the distinctive features of 5G Remote Media Production is the ability to allow point-to-point contribution anywhere, even between non-professional mobile devices, albeit high-end ones. Let’s not forget that the latest iPhones have very high video quality and are already used today for some journalistic contributions.
Unlike other solutions on the market, in fact, devices combined with cloud servers and other infrastructural components are not required. 2 devices and a connection are sufficient to allow the exchange between them of 4 video signals in total (even UHD), service communications and control signals, etc. All with latencies that stand at 150ms point-to-point and high reliability due to the fact that you are in all respects on a dedicated portion of the network.