Getting creative with AI – playing about with some free on-line apps

On Thursday 11th January we looked at some of the websites offering free access to tools using AI for creating video and music. We also looked at Chat GPT4 in the guise of Microsoft’s CoPilot in the Edge browser.

Here are some of the links: https://builtin.com/artificial-intelligence/ai-apps25 Top AI Apps to Know
These AI apps put the power of artificial intelligence right in your hand.
This article covers chatbots,, image editing and creation, virtual assistants, education and health and wellness, maps and navigation and transcription.

This article summarises the best AI text-to-video generators for turning a script into a video
https://kwicut.media.io/blog/text-to-video-generator.html

Chris signed up with Media io : https://www.media.io which is a collection of portable on-line AI tools which includes:
Video Tools
Video Enhancer
Tiktok Watermark Remover
AI Video Clipper AI Video Clipper AI
AI Video Generator AI Video Generator AI
Online Video Editor Video Editor
Video Converter Video Converter
Audio Tools
Ai Music Generator AI Music Generator
ai vocal generator AI Song Cover Generator NEW
Vocal Remover Vocal Remover
Noise Reducer Noise Reducer
Audio Converter Audio Converter
Audio Compressor Audio Compressor
Photo Tools
Portrait Generator AI Portrait Generator
Image Enhancer Image Enhancer HOT
Photo Watermark Remover Watermark Remover
AI Gender Swap AI Face Editor AI
Passport Photo Maker Passport Photo Maker
Background Remover Background Remover

We took a look at AI song covers – you can upload the audio of your favourite song and hear it sung by Donald Trump ( !). The Media iO site linked to Wondershare, and an app “Wondershare presentory” to create a presentation using text prompts. https://presentory.wondershare.com/app/dashboard When we provided the prompt, “Cooking with Rice“, It created a comprehensive script describing rice cooking all over the world and then slide layouts, including a live video input of the presenter. We could see how this could be a useful business tool.

We looked at Kwicut: https://kwicut.media.io which has video editing tools including a Text-based AI Video Editor.

We played with Visla: https://www.visla.us/ai-video-generator/text-to-video : All-in-one Video Storytelling AI powered video creation platform that enables teams and individuals to easily record, edit, and share high-quality videos. We challenged it with the following prompt: An old man is walking down the sidewalk with his walking stick. Suddenly he sees a wild boar charging at him. With great agility, he uses his walking stick to jump over the wild boar. and got this: https://app.visla.us/project/view/1195072526766657536 ….interesting, but a bit off the mark!

Then looked at RASK https://www.rask.ai a powerful AI dubbing tool which can clone your voice and have it speak in 130+ languages and watched a multispeaker example. It looked impressive, but given the complexity of languages, machine translation is far from perfect and despite Rask’s over-the-top optimism proof reading is still necessary!

It’s possible that voice cloning can be used to help movie actors adopt a different accent, since the final dialogue can be recorded and added later (by ADR –  automated dialogue replacement) e.g. the Irish actor, Paul Mescal has acquired an impressive American accent in his new film “Foe” which surprised his fans so much that some suggested his voice had been dubbed…(or perhaps cloned and tweaked to have a US accent?) https://nypost.com/2024/01/08/entertainment/paul-mescal-fans-are-shook-over-his-american-accent-in-foe/

This led us to: https://www.linkedin.com/pulse/aiyou19-top-ai-tools-used-hollywood-films-from-voice-cloning-elias/ AI&YOU#19: The Top AI Tools used in Hollywood Films: from Voice Cloning to Re-aging. This included a film made with AI tools by Jon Finger: ” I made another film with Ai. This time I used #runwayml ‘s text to video Ai #gen2 . Each shot was prompted. Voices generated with #elevenlabs. I wrote the story based on a tweet #gpt4 wrote: “I just had a dream that I was an AI and woke up in a lab. What does it mean?”

This was OK for a science fiction movie, but the people looked plastic and very artificial. The we looked at snippets of the following video which describes in detail how the author made a short Avatar trailer using various free AI editing tools: ” Welcome to the future of filmmaking! 🎬 In this video, we’ll take you on an exciting journey into the world of AI-powered cinema, where creativity knows no bounds and your dreams become cinematic reality. Discover the power of FREE AI tools that will transform your imagination abilities and elevate your filmmaking skills to a whole new level. Whether you’re a seasoned filmmaker or just starting out, this comprehensive guide will walk you through the process of creating a stunning cinematic masterpiece, all without breaking the bank.”

We challenged ChatGPT4 in the guise of Microsoft Edge’s Co-Pilot to create a video – but it can’t do videos (yet). We then asked it to create “a painting of Jávea beach in the style of Degas” and got this:

Hmmm ..It looks more like Alicante than Jávea. We asked Co-Pilot to translate a block of Spanish text copied from a web-based newspaper, which it did very well.

Poco a poco – we will see how these tools develop. Some will fall by the wayside, the better ones will survive. In the meantime, so-called AI will be incorporated in all manner of things. In many cases, it will not be AI at all, just a dumb sensor built into a device and masquerading as AI.

Christine Betterton-Jones – knowledge junkie