Towards a GenAI-assisted multimodal workflow for media productions

Le résumé fourni par la source

This study introduces an innovative workflow for media productions that integrates multimodal generative artificial intelligence (GenAI) tools such as GPTs, Midjourney, Runway Gen-3, Suno and ElevenLabs, with the aim of improving the efficiency and creative potential of these tools in simplifying the content generation process. The workflow is named GenAI-assisted workflow, and it generates high-quality audiovisual content with consistent aesthetics and coherence by using prompt engineering and model fine-tuning. This GenAI-assisted workflow enhances production flexibility, supports rapid iteration, and maintains high-quality output. Experimental results demonstrate that the efficiency of media productions has been significantly improved, enabling different forms of media content to achieve a consistent effect that meets the standards of the professional industry. This study also highlights the potential of the GenAI-assisted workflow to reduce human intervention and expand creative possibilities and provides valuable insight into the future application of GenAI in achieving automated multimodal media productions. (A video generated by the GenAI-assisted workflow is shown in https://www.youtube.com/watch?v=yNg7zq8Mxtk.)

Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.